2024-09-19T05:00:32.876 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:00:32.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:00:32.988 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/dbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911662' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5vcwf1PGYKlbkdwtmNTw0mFCaz54V3ZblEwE5+9ZBWcgEq93rrJ4DRmJka3ukAsJ+22RKlsVfGFNGwpvEd6DM= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwl6ZKuXxHZ0+/0eoNuLCTWcb3UyF42eJ3poi3tvTZPAL9kQ3BUbIO23sGDubiHPmWjItyCNf6gHBOflrN/yyM= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOn/gmCXYslWpgJh1fXbPbgxNj1mlO8m9aRXHoVk0QuIii4zuvwgR0o6lztmCT6Vl1oRjppmHserg6Nv0I38GSs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - quiescer: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:00:32.989 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:00:32.989 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:00:32.989 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:00:32.991 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:00:33.013 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:00:33.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:00:33.013 INFO:teuthology.packaging:ref: None 2024-09-19T05:00:33.013 INFO:teuthology.packaging:tag: None 2024-09-19T05:00:33.013 INFO:teuthology.packaging:branch: squid 2024-09-19T05:00:33.013 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:00:33.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:00:33.210 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:00:33.211 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:00:33.220 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:00:33.220 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:00:33.230 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:00:33.248 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:00:33.254 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:00:33.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:55:34.653161', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5vcwf1PGYKlbkdwtmNTw0mFCaz54V3ZblEwE5+9ZBWcgEq93rrJ4DRmJka3ukAsJ+22RKlsVfGFNGwpvEd6DM='} 2024-09-19T05:00:33.290 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:55:34.651459', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwl6ZKuXxHZ0+/0eoNuLCTWcb3UyF42eJ3poi3tvTZPAL9kQ3BUbIO23sGDubiHPmWjItyCNf6gHBOflrN/yyM='} 2024-09-19T05:00:33.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:55:34.649392', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOn/gmCXYslWpgJh1fXbPbgxNj1mlO8m9aRXHoVk0QuIii4zuvwgR0o6lztmCT6Vl1oRjppmHserg6Nv0I38GSs='} 2024-09-19T05:00:33.309 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:00:33.315 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:00:33.315 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:00:33.315 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:00:33.315 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:00:33.389 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9da3817be0>, signals=[15]) 2024-09-19T05:00:33.389 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:00:33.395 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:00:33.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T05:00:33.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:33.475 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-19T05:00:33.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:33.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-09-19T05:00:33.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:33.630 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:00:33.636 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-19T05:00:33.654 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-19T05:00:33.654 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-19T05:00:33.711 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:33.712 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:33.713 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:33.713 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:33.713 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-19T05:00:33.734 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-19T05:00:33.753 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-19T05:00:33.753 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-19T05:00:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-19T05:00:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-19T05:00:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:33.813 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-19T05:00:33.834 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-09-19T05:00:33.852 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-09-19T05:00:33.853 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:33.911 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:33.912 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:33.912 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:33.912 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:33.912 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:33.912 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:33.912 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-09-19T05:00:33.943 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:00:33.953 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:00:33.958 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:00:33.958 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:33.961 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:33.963 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:33.979 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:00:33.984 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:00:33.984 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:34.018 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:34.020 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:34.141 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:00:34.218 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:00:34.233 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:00:34.233 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T05:00:34.233 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T05:00:34.234 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:00:34.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:00:34.251 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T05:00:34.308 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:00:34.309 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-503.el9.x86_64 2024-09-19T05:00:34.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-09-19T05:00:37.987 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-19T05:00:43.521 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-19T05:00:48.713 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.5 MB 00:01 2024-09-19T05:00:50.272 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-19T05:00:51.401 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-19T05:00:56.999 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-19T05:00:58.997 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:00:58.997 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:00:59.095 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T05:00:59.102 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T05:00:59.103 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-09-19T05:00:59.104 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:00:59.104 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 79 M 2024-09-19T05:00:59.104 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 126 M 2024-09-19T05:00:59.104 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T05:00:59.267 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 339 kB/s | 36 kB 00:00 2024-09-19T05:01:03.067 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-19T05:01:03.709 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.6 MB/s | 35 MB 00:04 2024-09-19T05:01:03.976 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.1 MB/s | 29 MB 00:04 2024-09-19T05:01:03.976 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:01:03.976 INFO:teuthology.orchestra.run.smithi001.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-19T05:01:04.684 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T05:01:05.047 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T05:01:05.047 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T05:01:06.011 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T05:01:06.011 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T05:01:08.603 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T05:01:09.404 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:01:09.493 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:01:12.224 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:01:12.354 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:01:17.482 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:01:17.530 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:22.828 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:02:01.854 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:02:01.894 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:02:02.241 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:02:02.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:02:02.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:02:02.242 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:02:03.088 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:02:03.089 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T05:02:03.435 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:02:03.517 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.518 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:02:03.518 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:02:03.518 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:02:03.518 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:02:03.518 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T05:02:03.518 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:02:03.518 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:02:03.577 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:02:03.577 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:02:03.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-19T05:02:03.609 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:02:03.610 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:02:03.611 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-19T05:02:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:02:03.611 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:02:03.611 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:02:03.612 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:02:03.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:02:04.241 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-19T05:02:05.602 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:02:05.635 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-19T05:02:05.636 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-19T05:02:05.651 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.7jzDlOSVW8 2024-09-19T05:02:05.652 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7jzDlOSVW8 2024-09-19T05:02:05.717 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.7jzDlOSVW8 2024-09-19T05:02:05.855 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.7jzDlOSVW8 is 6KB 2024-09-19T05:02:05.905 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.7jzDlOSVW8 2024-09-19T05:02:05.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:02:05.987 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:02:05.987 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:02:05.987 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:02:05.987 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:02:05.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:02:06.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-19T05:02:36.135 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T05:02:36.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T05:02:36.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:36.139 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T05:03:45.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T05:03:45.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:45.568 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T05:03:45.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T05:03:45.992 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:03:45.992 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T05:03:46.008 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:03:46.008 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:03:46.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:03:46.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:03:47.009 DEBUG:teuthology.parallel:result is None 2024-09-19T05:03:47.010 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:03:47.017 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:03:47.017 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:47.020 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:47.022 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:47.041 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:03:47.047 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:03:47.054 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:03:47.054 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:47.080 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:47.082 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:47.119 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:03:47.126 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:03:47.126 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:03:47.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:47.170 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:03:47.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:47.187 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:47.190 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:47.212 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:47.246 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.261 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.277 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.298 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.340 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.367 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:47.369 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:03:47.376 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:03:47.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:47.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:47.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:47.409 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:03:47.419 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:03:47.419 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:47.448 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:47.451 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:47.468 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:47.544 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:47.597 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:47.682 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:47.724 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:03:47.724 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:47.792 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:47.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:47.895 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:47.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:48.024 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:03:48.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:48.093 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:48.139 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:48.190 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:48.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:48.317 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:03:48.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:48.385 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-19T05:03:48.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-19T05:03:48.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-09-19T05:03:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:48.447 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:48.465 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:48.803 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:03:48.812 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:03:48.812 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:03:48.822 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:03:48.833 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:03:48.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-19T05:03:48.922 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-19T05:03:48.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-19T05:03:48.973 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-19T05:03:48.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-09-19T05:03:49.040 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-09-19T05:03:49.042 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:03:49.042 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-19T05:03:49.082 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-19T05:03:49.083 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-19T05:03:49.105 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-19T05:03:49.105 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-09-19T05:03:49.134 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-09-19T05:03:49.134 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:03:49.134 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:49.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:49.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:49.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:49.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:49.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:49.254 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:03:49.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:49.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:49.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:49.778 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:03:49.787 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:03:49.799 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:03:49.801 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:08:13.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2024-09-19T05:08:13.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T05:08:13.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:08:14.061 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T05:08:14.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T05:08:14.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-19T05:08:14.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:08:14.220 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-19T05:08:14.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-19T05:08:14.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-19T05:08:14.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:08:14.382 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-19T05:08:14.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-19T05:08:14.463 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:08:14.474 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:08:14.475 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:08:14.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:08:14.477 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:08:14.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:08:14.480 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:08:14.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:08:14.510 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:08:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:08:14.526 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:08:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:08:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:08:14.552 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:08:14.554 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-19T05:08:14.555 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-19T05:08:14.567 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-19T05:08:14.567 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-19T05:08:14.579 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-09-19T05:08:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:08:14.582 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:08:14.591 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-09-19T05:08:14.596 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:08:14.597 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:08:14.606 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:08:14.621 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:08:14.655 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:08:14.658 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:08:14.658 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T05:08:14.658 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.659 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.659 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.659 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:08:14.665 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:08:14.665 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-19T05:08:14.665 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.665 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.665 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.666 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:08:14.688 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:08:14.688 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-19T05:08:14.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.689 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:08:14.690 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:08:14.697 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:08:14.697 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:08:14.698 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:08:14.698 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:08:14.703 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:08:14.703 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:08:14.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:08:14.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:08:14.706 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:08:14.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:08:14.707 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:08:14.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:08:14.850 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:08:14.851 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:08:14.857 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:08:14.857 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:08:14.866 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:08:14.866 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:08:14.962 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:08:14.963 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:08:14.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:08:14.967 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:08:14.967 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:08:14.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:08:14.977 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:08:14.977 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:08:14.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:08:14.990 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:08:14.990 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:08:14.994 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:08:14.994 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:08:15.003 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:08:15.004 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:08:15.057 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:08:15.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:08:15.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:08:15.134 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:08:15.135 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:08:15.149 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:08:15.199 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-09-19T05:08:15.199 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-19T05:08:15.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-19T05:08:15.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-09-19T05:08:15.215 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-19T05:08:15.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-19T05:08:15.429 INFO:teuthology.orchestra.run.smithi082.stdout:45 files removed 2024-09-19T05:08:15.438 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-19T05:08:15.452 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-19T05:08:15.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:08:15.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:08:15.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:08:16.002 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-19T05:08:16.025 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-19T05:08:16.031 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T05:08:16.287 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T05:08:16.316 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:08:16.326 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T05:08:16.553 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T05:08:16.574 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-19T05:08:16.601 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:08:17.045 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-19T05:08:17.099 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T05:08:17.326 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T05:08:18.984 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-19T05:08:22.537 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-19T05:08:23.002 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T05:08:23.560 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-19T05:08:25.286 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-19T05:08:26.157 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T05:08:28.612 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T05:08:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-19T05:08:30.238 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-19T05:08:30.395 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-19T05:08:31.375 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T05:08:31.458 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T05:08:31.771 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-19T05:08:34.009 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:34.010 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:34.024 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:08:34.025 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:08:34.026 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:08:34.027 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:08:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:08:34.032 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:08:34.033 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:08:34.101 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-19T05:08:34.127 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:08:34.128 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:08:34.129 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:08:34.130 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:08:34.131 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:08:34.132 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:08:34.133 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:08:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:08:34.135 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:08:34.136 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:08:34.137 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:08:34.138 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:08:34.139 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:08:34.140 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:08:34.141 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-19T05:08:34.142 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-19T05:08:34.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:08:34.144 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 226 M 2024-09-19T05:08:34.144 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-19T05:08:35.039 INFO:teuthology.orchestra.run.smithi060.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-19T05:08:35.289 INFO:teuthology.orchestra.run.smithi060.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.5 MB/s | 896 kB 00:00 2024-09-19T05:08:35.381 INFO:teuthology.orchestra.run.smithi060.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:08:35.406 INFO:teuthology.orchestra.run.smithi060.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.2 MB/s | 145 kB 00:00 2024-09-19T05:08:35.607 INFO:teuthology.orchestra.run.smithi060.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-19T05:08:35.657 INFO:teuthology.orchestra.run.smithi060.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-19T05:08:36.066 INFO:teuthology.orchestra.run.smithi060.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T05:08:36.133 INFO:teuthology.orchestra.run.smithi060.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.0 MB/s | 4.7 MB 00:00 2024-09-19T05:08:36.199 INFO:teuthology.orchestra.run.smithi060.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 379 kB/s | 25 kB 00:00 2024-09-19T05:08:36.675 INFO:teuthology.orchestra.run.smithi060.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T05:08:36.733 INFO:teuthology.orchestra.run.smithi060.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T05:08:36.814 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-09-19T05:08:36.934 INFO:teuthology.orchestra.run.smithi060.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 13 MB/s | 17 MB 00:01 2024-09-19T05:08:36.959 INFO:teuthology.orchestra.run.smithi060.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 120 kB/s | 27 kB 00:00 2024-09-19T05:08:36.984 INFO:teuthology.orchestra.run.smithi060.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T05:08:37.017 INFO:teuthology.orchestra.run.smithi060.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T05:08:37.043 INFO:teuthology.orchestra.run.smithi060.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T05:08:37.068 INFO:teuthology.orchestra.run.smithi060.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:08:37.072 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:08:37.102 INFO:teuthology.orchestra.run.smithi060.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.4 MB/s | 506 kB 00:00 2024-09-19T05:08:37.160 INFO:teuthology.orchestra.run.smithi060.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 775 kB/s | 45 kB 00:00 2024-09-19T05:08:37.244 INFO:teuthology.orchestra.run.smithi060.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T05:08:37.345 INFO:teuthology.orchestra.run.smithi060.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T05:08:37.370 INFO:teuthology.orchestra.run.smithi060.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.3 MB/s | 161 kB 00:00 2024-09-19T05:08:37.395 INFO:teuthology.orchestra.run.smithi060.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T05:08:37.420 INFO:teuthology.orchestra.run.smithi060.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T05:08:37.445 INFO:teuthology.orchestra.run.smithi060.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T05:08:37.471 INFO:teuthology.orchestra.run.smithi060.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:08:37.521 INFO:teuthology.orchestra.run.smithi060.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T05:08:37.605 INFO:teuthology.orchestra.run.smithi060.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T05:08:37.630 INFO:teuthology.orchestra.run.smithi060.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 293 kB/s | 32 kB 00:00 2024-09-19T05:08:37.655 INFO:teuthology.orchestra.run.smithi060.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T05:08:37.989 INFO:teuthology.orchestra.run.smithi060.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.9 MB/s | 3.6 MB 00:00 2024-09-19T05:08:38.039 INFO:teuthology.orchestra.run.smithi060.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T05:08:38.140 INFO:teuthology.orchestra.run.smithi060.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-19T05:08:38.165 INFO:teuthology.orchestra.run.smithi060.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 393 kB/s | 49 kB 00:00 2024-09-19T05:08:38.190 INFO:teuthology.orchestra.run.smithi060.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 327 kB/s | 16 kB 00:00 2024-09-19T05:08:38.215 INFO:teuthology.orchestra.run.smithi060.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T05:08:38.258 INFO:teuthology.orchestra.run.smithi060.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T05:08:38.283 INFO:teuthology.orchestra.run.smithi060.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 272 kB/s | 18 kB 00:00 2024-09-19T05:08:38.367 INFO:teuthology.orchestra.run.smithi060.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 735 kB/s | 80 kB 00:00 2024-09-19T05:08:38.817 INFO:teuthology.orchestra.run.smithi060.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T05:08:38.851 INFO:teuthology.orchestra.run.smithi060.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 395 kB/s | 191 kB 00:00 2024-09-19T05:08:38.876 INFO:teuthology.orchestra.run.smithi060.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T05:08:38.918 INFO:teuthology.orchestra.run.smithi060.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T05:08:38.949 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:38.950 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:38.952 INFO:teuthology.orchestra.run.smithi060.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-19T05:08:38.962 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:08:38.963 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:08:38.964 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:08:38.964 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:08:38.966 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:08:38.969 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:08:38.969 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:08:38.985 INFO:teuthology.orchestra.run.smithi060.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T05:08:39.011 INFO:teuthology.orchestra.run.smithi060.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T05:08:39.033 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-19T05:08:39.036 INFO:teuthology.orchestra.run.smithi060.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:08:39.060 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:08:39.061 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:08:39.062 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:08:39.063 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:08:39.064 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:08:39.065 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:08:39.066 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:08:39.067 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:08:39.069 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:08:39.070 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:08:39.071 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:08:39.072 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout:====================================================================================== 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 8 Packages 2024-09-19T05:08:39.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:08:39.074 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 226 M 2024-09-19T05:08:39.074 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-19T05:08:39.095 INFO:teuthology.orchestra.run.smithi060.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-19T05:08:39.178 INFO:teuthology.orchestra.run.smithi060.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-19T05:08:39.220 INFO:teuthology.orchestra.run.smithi060.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 853 kB/s | 107 kB 00:00 2024-09-19T05:08:39.237 INFO:teuthology.orchestra.run.smithi060.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-19T05:08:39.279 INFO:teuthology.orchestra.run.smithi060.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T05:08:39.305 INFO:teuthology.orchestra.run.smithi060.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-19T05:08:39.330 INFO:teuthology.orchestra.run.smithi060.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-19T05:08:39.380 INFO:teuthology.orchestra.run.smithi060.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-19T05:08:39.385 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:39.385 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:08:39.399 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:08:39.400 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:08:39.401 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:08:39.403 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:08:39.405 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:08:39.405 INFO:teuthology.orchestra.run.smithi060.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T05:08:39.407 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:08:39.409 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:08:39.473 INFO:teuthology.orchestra.run.smithi060.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-19T05:08:39.477 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:08:39.497 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:08:39.498 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:08:39.499 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:08:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:08:39.501 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:08:39.502 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:08:39.503 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:08:39.504 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:08:39.505 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:08:39.506 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:08:39.507 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:08:39.508 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-19T05:08:39.509 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:08:39.510 INFO:teuthology.orchestra.run.smithi060.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-19T05:08:39.510 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 226 M 2024-09-19T05:08:39.510 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T05:08:39.523 INFO:teuthology.orchestra.run.smithi060.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T05:08:39.565 INFO:teuthology.orchestra.run.smithi060.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-19T05:08:39.590 INFO:teuthology.orchestra.run.smithi060.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-19T05:08:39.615 INFO:teuthology.orchestra.run.smithi060.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-19T05:08:39.641 INFO:teuthology.orchestra.run.smithi060.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-19T05:08:39.666 INFO:teuthology.orchestra.run.smithi060.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T05:08:39.700 INFO:teuthology.orchestra.run.smithi060.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T05:08:39.725 INFO:teuthology.orchestra.run.smithi060.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-19T05:08:39.765 INFO:teuthology.orchestra.run.smithi082.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T05:08:39.836 INFO:teuthology.orchestra.run.smithi060.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T05:08:39.901 INFO:teuthology.orchestra.run.smithi060.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-19T05:08:39.966 INFO:teuthology.orchestra.run.smithi082.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-19T05:08:39.976 INFO:teuthology.orchestra.run.smithi060.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-19T05:08:40.010 INFO:teuthology.orchestra.run.smithi060.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-19T05:08:40.035 INFO:teuthology.orchestra.run.smithi060.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-19T05:08:40.057 INFO:teuthology.orchestra.run.smithi082.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T05:08:40.093 INFO:teuthology.orchestra.run.smithi060.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T05:08:40.119 INFO:teuthology.orchestra.run.smithi060.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T05:08:40.133 INFO:teuthology.orchestra.run.smithi082.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:08:40.165 INFO:teuthology.orchestra.run.smithi001.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 32 kB/s | 6.6 kB 00:00 2024-09-19T05:08:40.194 INFO:teuthology.orchestra.run.smithi060.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-19T05:08:40.219 INFO:teuthology.orchestra.run.smithi060.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-09-19T05:08:40.233 INFO:teuthology.orchestra.run.smithi082.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-19T05:08:40.278 INFO:teuthology.orchestra.run.smithi060.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:08:40.309 INFO:teuthology.orchestra.run.smithi082.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-19T05:08:40.353 INFO:teuthology.orchestra.run.smithi060.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-09-19T05:08:40.378 INFO:teuthology.orchestra.run.smithi060.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-19T05:08:40.404 INFO:teuthology.orchestra.run.smithi060.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-19T05:08:40.429 INFO:teuthology.orchestra.run.smithi060.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-19T05:08:40.454 INFO:teuthology.orchestra.run.smithi060.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T05:08:40.479 INFO:teuthology.orchestra.run.smithi060.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-19T05:08:40.534 INFO:teuthology.orchestra.run.smithi082.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-19T05:08:40.538 INFO:teuthology.orchestra.run.smithi060.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T05:08:40.572 INFO:teuthology.orchestra.run.smithi060.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-19T05:08:40.647 INFO:teuthology.orchestra.run.smithi060.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-19T05:08:40.664 INFO:teuthology.orchestra.run.smithi060.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 459 kB/s | 42 kB 00:00 2024-09-19T05:08:40.689 INFO:teuthology.orchestra.run.smithi060.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-19T05:08:40.723 INFO:teuthology.orchestra.run.smithi060.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-19T05:08:40.742 INFO:teuthology.orchestra.run.smithi082.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T05:08:40.748 INFO:teuthology.orchestra.run.smithi060.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-19T05:08:40.773 INFO:teuthology.orchestra.run.smithi060.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-19T05:08:40.784 INFO:teuthology.orchestra.run.smithi082.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T05:08:40.799 INFO:teuthology.orchestra.run.smithi060.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-19T05:08:40.824 INFO:teuthology.orchestra.run.smithi060.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-19T05:08:40.866 INFO:teuthology.orchestra.run.smithi060.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-09-19T05:08:40.891 INFO:teuthology.orchestra.run.smithi060.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 662 kB/s | 44 kB 00:00 2024-09-19T05:08:40.933 INFO:teuthology.orchestra.run.smithi060.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T05:08:40.959 INFO:teuthology.orchestra.run.smithi060.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 533 kB/s | 36 kB 00:00 2024-09-19T05:08:41.001 INFO:teuthology.orchestra.run.smithi060.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-19T05:08:41.034 INFO:teuthology.orchestra.run.smithi060.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-19T05:08:41.059 INFO:teuthology.orchestra.run.smithi060.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-09-19T05:08:41.201 INFO:teuthology.orchestra.run.smithi082.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 16 MB/s | 11 MB 00:00 2024-09-19T05:08:41.235 INFO:teuthology.orchestra.run.smithi060.stdout:(100/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-19T05:08:41.251 INFO:teuthology.orchestra.run.smithi082.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T05:08:41.260 INFO:teuthology.orchestra.run.smithi060.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-19T05:08:41.285 INFO:teuthology.orchestra.run.smithi060.stdout:(102/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 382 kB/s | 96 kB 00:00 2024-09-19T05:08:41.310 INFO:teuthology.orchestra.run.smithi060.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-19T05:08:41.327 INFO:teuthology.orchestra.run.smithi082.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 361 kB/s | 27 kB 00:00 2024-09-19T05:08:41.369 INFO:teuthology.orchestra.run.smithi060.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T05:08:41.402 INFO:teuthology.orchestra.run.smithi082.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 423 kB/s | 32 kB 00:00 2024-09-19T05:08:41.411 INFO:teuthology.orchestra.run.smithi060.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T05:08:41.440 INFO:teuthology.orchestra.run.smithi060.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-19T05:08:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.4 MB/s | 751 kB 00:00 2024-09-19T05:08:41.507 INFO:teuthology.orchestra.run.smithi001.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.5 MB/s | 5.4 MB 00:01 2024-09-19T05:08:41.562 INFO:teuthology.orchestra.run.smithi060.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T05:08:41.599 INFO:teuthology.orchestra.run.smithi001.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T05:08:41.603 INFO:teuthology.orchestra.run.smithi082.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.6 MB/s | 163 kB 00:00 2024-09-19T05:08:41.604 INFO:teuthology.orchestra.run.smithi060.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 994 kB/s | 26 kB 00:00 2024-09-19T05:08:41.629 INFO:teuthology.orchestra.run.smithi060.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:08:41.654 INFO:teuthology.orchestra.run.smithi060.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T05:08:41.680 INFO:teuthology.orchestra.run.smithi060.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.3 MB/s | 151 kB 00:00 2024-09-19T05:08:41.686 INFO:teuthology.orchestra.run.smithi082.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.5 MB/s | 127 kB 00:00 2024-09-19T05:08:41.721 INFO:teuthology.orchestra.run.smithi060.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T05:08:41.749 INFO:teuthology.orchestra.run.smithi001.stdout:(4/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 566 kB/s | 896 kB 00:01 2024-09-19T05:08:41.763 INFO:teuthology.orchestra.run.smithi060.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T05:08:41.788 INFO:teuthology.orchestra.run.smithi060.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:08:41.795 INFO:teuthology.orchestra.run.smithi082.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.6 MB/s | 506 kB 00:00 2024-09-19T05:08:41.814 INFO:teuthology.orchestra.run.smithi060.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:08:41.839 INFO:teuthology.orchestra.run.smithi060.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T05:08:41.865 INFO:teuthology.orchestra.run.smithi060.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-19T05:08:41.898 INFO:teuthology.orchestra.run.smithi060.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T05:08:41.931 INFO:teuthology.orchestra.run.smithi060.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T05:08:41.953 INFO:teuthology.orchestra.run.smithi082.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 17 MB 00:01 2024-09-19T05:08:41.957 INFO:teuthology.orchestra.run.smithi060.stdout:(120/156): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-09-19T05:08:41.990 INFO:teuthology.orchestra.run.smithi060.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T05:08:42.012 INFO:teuthology.orchestra.run.smithi082.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 775 kB/s | 45 kB 00:00 2024-09-19T05:08:42.024 INFO:teuthology.orchestra.run.smithi060.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.5 MB/s | 144 kB 00:00 2024-09-19T05:08:42.049 INFO:teuthology.orchestra.run.smithi060.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-19T05:08:42.075 INFO:teuthology.orchestra.run.smithi060.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T05:08:42.100 INFO:teuthology.orchestra.run.smithi060.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 921 kB/s | 23 kB 00:00 2024-09-19T05:08:42.126 INFO:teuthology.orchestra.run.smithi060.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T05:08:42.133 INFO:teuthology.orchestra.run.smithi001.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.5 MB/s | 2.4 MB 00:00 2024-09-19T05:08:42.146 INFO:teuthology.orchestra.run.smithi082.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-19T05:08:42.151 INFO:teuthology.orchestra.run.smithi060.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-09-19T05:08:42.171 INFO:teuthology.orchestra.run.smithi082.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 860 kB/s | 136 kB 00:00 2024-09-19T05:08:42.204 INFO:teuthology.orchestra.run.smithi082.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T05:08:42.209 INFO:teuthology.orchestra.run.smithi060.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-19T05:08:42.226 INFO:teuthology.orchestra.run.smithi060.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T05:08:42.230 INFO:teuthology.orchestra.run.smithi082.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.3 MB/s | 320 kB 00:00 2024-09-19T05:08:42.260 INFO:teuthology.orchestra.run.smithi060.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T05:08:42.280 INFO:teuthology.orchestra.run.smithi082.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T05:08:42.293 INFO:teuthology.orchestra.run.smithi060.stdout:(131/156): protobuf-compiler-3.14.0-13.el9.x86_ 856 kB/s | 863 kB 00:01 2024-09-19T05:08:42.305 INFO:teuthology.orchestra.run.smithi082.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.3 MB/s | 99 kB 00:00 2024-09-19T05:08:42.311 INFO:teuthology.orchestra.run.smithi060.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T05:08:42.336 INFO:teuthology.orchestra.run.smithi060.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 987 kB/s | 16 kB 00:00 2024-09-19T05:08:42.361 INFO:teuthology.orchestra.run.smithi060.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.8 MB/s | 90 kB 00:00 2024-09-19T05:08:42.364 INFO:teuthology.orchestra.run.smithi082.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T05:08:42.386 INFO:teuthology.orchestra.run.smithi060.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T05:08:42.437 INFO:teuthology.orchestra.run.smithi060.stdout:(136/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-19T05:08:42.462 INFO:teuthology.orchestra.run.smithi060.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-09-19T05:08:42.464 INFO:teuthology.orchestra.run.smithi082.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T05:08:42.487 INFO:teuthology.orchestra.run.smithi060.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-19T05:08:42.513 INFO:teuthology.orchestra.run.smithi060.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T05:08:42.538 INFO:teuthology.orchestra.run.smithi060.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T05:08:42.563 INFO:teuthology.orchestra.run.smithi060.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:08:42.564 INFO:teuthology.orchestra.run.smithi082.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 318 kB/s | 32 kB 00:00 2024-09-19T05:08:42.588 INFO:teuthology.orchestra.run.smithi060.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-19T05:08:42.614 INFO:teuthology.orchestra.run.smithi060.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T05:08:42.639 INFO:teuthology.orchestra.run.smithi060.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-19T05:08:42.672 INFO:teuthology.orchestra.run.smithi060.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-19T05:08:42.698 INFO:teuthology.orchestra.run.smithi060.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T05:08:42.725 INFO:teuthology.orchestra.run.smithi001.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 8.0 MB/s | 4.7 MB 00:00 2024-09-19T05:08:42.731 INFO:teuthology.orchestra.run.smithi060.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-19T05:08:42.782 INFO:teuthology.orchestra.run.smithi060.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:08:42.942 INFO:teuthology.orchestra.run.smithi001.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 7.1 MB/s | 21 MB 00:02 2024-09-19T05:08:42.990 INFO:teuthology.orchestra.run.smithi082.stdout:(29/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T05:08:42.991 INFO:teuthology.orchestra.run.smithi060.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-19T05:08:43.018 INFO:teuthology.orchestra.run.smithi082.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 323 kB/s | 146 kB 00:00 2024-09-19T05:08:43.066 INFO:teuthology.orchestra.run.smithi060.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-19T05:08:43.077 INFO:teuthology.orchestra.run.smithi082.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 4.0 MB/s | 3.1 MB 00:00 2024-09-19T05:08:43.141 INFO:teuthology.orchestra.run.smithi060.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 547 kB/s | 41 kB 00:00 2024-09-19T05:08:43.216 INFO:teuthology.orchestra.run.smithi060.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.3 MB/s | 249 kB 00:00 2024-09-19T05:08:43.352 INFO:teuthology.orchestra.run.smithi082.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.9 MB/s | 3.6 MB 00:00 2024-09-19T05:08:43.367 INFO:teuthology.orchestra.run.smithi001.stdout:(8/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 963 kB/s | 1.5 MB 00:01 2024-09-19T05:08:43.394 INFO:teuthology.orchestra.run.smithi082.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T05:08:43.425 INFO:teuthology.orchestra.run.smithi001.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 433 kB/s | 25 kB 00:00 2024-09-19T05:08:43.433 INFO:teuthology.orchestra.run.smithi060.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-09-19T05:08:43.452 INFO:teuthology.orchestra.run.smithi082.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 283 kB/s | 16 kB 00:00 2024-09-19T05:08:43.475 INFO:teuthology.orchestra.run.smithi060.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-09-19T05:08:43.542 INFO:teuthology.orchestra.run.smithi060.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 1.4 MB 00:00 2024-09-19T05:08:43.544 INFO:teuthology.orchestra.run.smithi082.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-19T05:08:43.578 INFO:teuthology.orchestra.run.smithi082.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 285 kB 00:00 2024-09-19T05:08:43.612 INFO:teuthology.orchestra.run.smithi082.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T05:08:43.617 INFO:teuthology.orchestra.run.smithi001.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 16 MB/s | 11 MB 00:00 2024-09-19T05:08:43.628 INFO:teuthology.orchestra.run.smithi082.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 363 kB/s | 18 kB 00:00 2024-09-19T05:08:43.654 INFO:teuthology.orchestra.run.smithi082.stdout:(39/156): ceph-mgr-modules-core-19.1.1-361.g2f5 432 kB/s | 249 kB 00:00 2024-09-19T05:08:43.668 INFO:teuthology.orchestra.run.smithi001.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T05:08:43.718 INFO:teuthology.orchestra.run.smithi001.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T05:08:43.737 INFO:teuthology.orchestra.run.smithi082.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 636 kB/s | 80 kB 00:00 2024-09-19T05:08:43.769 INFO:teuthology.orchestra.run.smithi001.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 636 kB/s | 32 kB 00:00 2024-09-19T05:08:43.779 INFO:teuthology.orchestra.run.smithi082.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-19T05:08:43.821 INFO:teuthology.orchestra.run.smithi082.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-19T05:08:43.847 INFO:teuthology.orchestra.run.smithi082.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T05:08:43.872 INFO:teuthology.orchestra.run.smithi082.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T05:08:43.897 INFO:teuthology.orchestra.run.smithi082.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:08:43.923 INFO:teuthology.orchestra.run.smithi082.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:08:43.936 INFO:teuthology.orchestra.run.smithi001.stdout:(14/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T05:08:43.948 INFO:teuthology.orchestra.run.smithi082.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:08:43.977 INFO:teuthology.orchestra.run.smithi001.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 3.5 MB/s | 751 kB 00:00 2024-09-19T05:08:43.990 INFO:teuthology.orchestra.run.smithi082.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-19T05:08:44.003 INFO:teuthology.orchestra.run.smithi001.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T05:08:44.015 INFO:teuthology.orchestra.run.smithi082.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-19T05:08:44.028 INFO:teuthology.orchestra.run.smithi001.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:08:44.040 INFO:teuthology.orchestra.run.smithi082.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T05:08:44.053 INFO:teuthology.orchestra.run.smithi001.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.8 MB/s | 506 kB 00:00 2024-09-19T05:08:44.066 INFO:teuthology.orchestra.run.smithi082.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-19T05:08:44.091 INFO:teuthology.orchestra.run.smithi082.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T05:08:44.103 INFO:teuthology.orchestra.run.smithi001.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 907 kB/s | 45 kB 00:00 2024-09-19T05:08:44.116 INFO:teuthology.orchestra.run.smithi082.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-19T05:08:44.125 INFO:teuthology.orchestra.run.smithi060.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-19T05:08:44.133 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:08:44.133 INFO:teuthology.orchestra.run.smithi060.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-19T05:08:44.154 INFO:teuthology.orchestra.run.smithi001.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T05:08:44.158 INFO:teuthology.orchestra.run.smithi082.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-19T05:08:44.184 INFO:teuthology.orchestra.run.smithi082.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T05:08:44.204 INFO:teuthology.orchestra.run.smithi001.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T05:08:44.209 INFO:teuthology.orchestra.run.smithi082.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T05:08:44.243 INFO:teuthology.orchestra.run.smithi082.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T05:08:44.268 INFO:teuthology.orchestra.run.smithi082.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-19T05:08:44.296 INFO:teuthology.orchestra.run.smithi001.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-19T05:08:44.302 INFO:teuthology.orchestra.run.smithi082.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T05:08:44.321 INFO:teuthology.orchestra.run.smithi001.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.7 MB/s | 320 kB 00:00 2024-09-19T05:08:44.343 INFO:teuthology.orchestra.run.smithi082.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-19T05:08:44.347 INFO:teuthology.orchestra.run.smithi001.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T05:08:44.360 INFO:teuthology.orchestra.run.smithi082.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T05:08:44.386 INFO:teuthology.orchestra.run.smithi082.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T05:08:44.387 INFO:teuthology.orchestra.run.smithi001.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 99 kB 00:00 2024-09-19T05:08:44.411 INFO:teuthology.orchestra.run.smithi082.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T05:08:44.414 INFO:teuthology.orchestra.run.smithi001.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T05:08:44.436 INFO:teuthology.orchestra.run.smithi082.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T05:08:44.453 INFO:teuthology.orchestra.run.smithi082.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 919 kB/s | 38 kB 00:00 2024-09-19T05:08:44.473 INFO:teuthology.orchestra.run.smithi001.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T05:08:44.504 INFO:teuthology.orchestra.run.smithi082.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-19T05:08:44.514 INFO:teuthology.orchestra.run.smithi001.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 766 kB/s | 32 kB 00:00 2024-09-19T05:08:44.573 INFO:teuthology.orchestra.run.smithi001.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-19T05:08:44.596 INFO:teuthology.orchestra.run.smithi082.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T05:08:44.598 INFO:teuthology.orchestra.run.smithi001.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T05:08:44.663 INFO:teuthology.orchestra.run.smithi082.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-19T05:08:44.721 INFO:teuthology.orchestra.run.smithi082.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-19T05:08:44.755 INFO:teuthology.orchestra.run.smithi082.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-19T05:08:44.774 INFO:teuthology.orchestra.run.smithi001.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 18 MB/s | 3.6 MB 00:00 2024-09-19T05:08:44.780 INFO:teuthology.orchestra.run.smithi082.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T05:08:44.822 INFO:teuthology.orchestra.run.smithi082.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-19T05:08:44.832 INFO:teuthology.orchestra.run.smithi001.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T05:08:44.847 INFO:teuthology.orchestra.run.smithi082.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T05:08:44.883 INFO:teuthology.orchestra.run.smithi001.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 987 kB/s | 49 kB 00:00 2024-09-19T05:08:44.889 INFO:teuthology.orchestra.run.smithi082.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T05:08:44.925 INFO:teuthology.orchestra.run.smithi001.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 397 kB/s | 16 kB 00:00 2024-09-19T05:08:44.981 INFO:teuthology.orchestra.run.smithi082.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-19T05:08:45.006 INFO:teuthology.orchestra.run.smithi082.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-19T05:08:45.008 INFO:teuthology.orchestra.run.smithi001.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T05:08:45.032 INFO:teuthology.orchestra.run.smithi082.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T05:08:45.033 INFO:teuthology.orchestra.run.smithi001.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.6 MB/s | 285 kB 00:00 2024-09-19T05:08:45.057 INFO:teuthology.orchestra.run.smithi082.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-19T05:08:45.067 INFO:teuthology.orchestra.run.smithi001.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T05:08:45.082 INFO:teuthology.orchestra.run.smithi082.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T05:08:45.093 INFO:teuthology.orchestra.run.smithi001.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T05:08:45.107 INFO:teuthology.orchestra.run.smithi082.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T05:08:45.133 INFO:teuthology.orchestra.run.smithi082.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T05:08:45.217 INFO:teuthology.orchestra.run.smithi082.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T05:08:45.218 INFO:teuthology.orchestra.run.smithi001.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-19T05:08:45.242 INFO:teuthology.orchestra.run.smithi082.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T05:08:45.267 INFO:teuthology.orchestra.run.smithi082.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T05:08:45.292 INFO:teuthology.orchestra.run.smithi082.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T05:08:45.301 INFO:teuthology.orchestra.run.smithi001.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-19T05:08:45.318 INFO:teuthology.orchestra.run.smithi082.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-19T05:08:45.327 INFO:teuthology.orchestra.run.smithi001.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-19T05:08:45.343 INFO:teuthology.orchestra.run.smithi082.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T05:08:45.360 INFO:teuthology.orchestra.run.smithi001.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T05:08:45.367 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-19T05:08:45.368 INFO:teuthology.orchestra.run.smithi082.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T05:08:45.394 INFO:teuthology.orchestra.run.smithi082.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T05:08:45.402 INFO:teuthology.orchestra.run.smithi001.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T05:08:45.419 INFO:teuthology.orchestra.run.smithi082.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T05:08:45.436 INFO:teuthology.orchestra.run.smithi001.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-19T05:08:45.444 INFO:teuthology.orchestra.run.smithi082.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T05:08:45.462 INFO:teuthology.orchestra.run.smithi001.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T05:08:45.495 INFO:teuthology.orchestra.run.smithi001.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T05:08:45.520 INFO:teuthology.orchestra.run.smithi082.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T05:08:45.520 INFO:teuthology.orchestra.run.smithi001.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-19T05:08:45.530 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-19T05:08:45.530 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-19T05:08:45.545 INFO:teuthology.orchestra.run.smithi082.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-19T05:08:45.570 INFO:teuthology.orchestra.run.smithi082.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-19T05:08:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T05:08:45.621 INFO:teuthology.orchestra.run.smithi082.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-19T05:08:45.646 INFO:teuthology.orchestra.run.smithi082.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-19T05:08:45.671 INFO:teuthology.orchestra.run.smithi082.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T05:08:45.697 INFO:teuthology.orchestra.run.smithi082.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T05:08:45.722 INFO:teuthology.orchestra.run.smithi082.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T05:08:45.747 INFO:teuthology.orchestra.run.smithi082.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T05:08:45.773 INFO:teuthology.orchestra.run.smithi082.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-19T05:08:46.031 INFO:teuthology.orchestra.run.smithi082.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T05:08:46.048 INFO:teuthology.orchestra.run.smithi082.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-09-19T05:08:46.098 INFO:teuthology.orchestra.run.smithi082.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-19T05:08:46.123 INFO:teuthology.orchestra.run.smithi082.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-19T05:08:46.157 INFO:teuthology.orchestra.run.smithi082.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T05:08:46.182 INFO:teuthology.orchestra.run.smithi082.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:08:46.216 INFO:teuthology.orchestra.run.smithi082.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-19T05:08:46.241 INFO:teuthology.orchestra.run.smithi082.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 827 kB/s | 49 kB 00:00 2024-09-19T05:08:46.283 INFO:teuthology.orchestra.run.smithi082.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2024-09-19T05:08:46.309 INFO:teuthology.orchestra.run.smithi082.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-09-19T05:08:46.312 INFO:teuthology.orchestra.run.smithi001.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 843 kB/s | 689 kB 00:00 2024-09-19T05:08:46.359 INFO:teuthology.orchestra.run.smithi082.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T05:08:46.363 INFO:teuthology.orchestra.run.smithi001.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-19T05:08:46.384 INFO:teuthology.orchestra.run.smithi082.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:08:46.421 INFO:teuthology.orchestra.run.smithi001.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 984 kB/s | 107 kB 00:00 2024-09-19T05:08:46.426 INFO:teuthology.orchestra.run.smithi082.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-19T05:08:46.452 INFO:teuthology.orchestra.run.smithi082.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 479 kB/s | 32 kB 00:00 2024-09-19T05:08:46.472 INFO:teuthology.orchestra.run.smithi001.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-19T05:08:46.477 INFO:teuthology.orchestra.run.smithi082.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-19T05:08:46.502 INFO:teuthology.orchestra.run.smithi082.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T05:08:46.527 INFO:teuthology.orchestra.run.smithi082.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T05:08:46.538 INFO:teuthology.orchestra.run.smithi001.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T05:08:46.561 INFO:teuthology.orchestra.run.smithi082.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-19T05:08:46.581 INFO:teuthology.orchestra.run.smithi001.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-19T05:08:46.637 INFO:teuthology.orchestra.run.smithi082.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-19T05:08:46.670 INFO:teuthology.orchestra.run.smithi082.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T05:08:46.689 INFO:teuthology.orchestra.run.smithi001.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-19T05:08:46.695 INFO:teuthology.orchestra.run.smithi082.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T05:08:46.721 INFO:teuthology.orchestra.run.smithi082.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 702 kB/s | 18 kB 00:00 2024-09-19T05:08:46.746 INFO:teuthology.orchestra.run.smithi082.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-19T05:08:46.804 INFO:teuthology.orchestra.run.smithi082.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-19T05:08:46.814 INFO:teuthology.orchestra.run.smithi001.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-09-19T05:08:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 744 kB/s | 20 kB 00:00 2024-09-19T05:08:46.863 INFO:teuthology.orchestra.run.smithi082.stdout:(128/156): python3-google-auth-2.34.0-1.el9.noa 656 kB/s | 220 kB 00:00 2024-09-19T05:08:46.889 INFO:teuthology.orchestra.run.smithi082.stdout:(129/156): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-09-19T05:08:46.914 INFO:teuthology.orchestra.run.smithi082.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 922 kB/s | 46 kB 00:00 2024-09-19T05:08:46.923 INFO:teuthology.orchestra.run.smithi001.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-19T05:08:46.939 INFO:teuthology.orchestra.run.smithi082.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-19T05:08:46.965 INFO:teuthology.orchestra.run.smithi082.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T05:08:46.984 INFO:teuthology.orchestra.run.smithi001.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-09-19T05:08:46.990 INFO:teuthology.orchestra.run.smithi082.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-19T05:08:47.016 INFO:teuthology.orchestra.run.smithi082.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T05:08:47.023 INFO:teuthology.orchestra.run.smithi001.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-19T05:08:47.040 INFO:teuthology.orchestra.run.smithi082.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T05:08:47.057 INFO:teuthology.orchestra.run.smithi082.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 670 kB/s | 28 kB 00:00 2024-09-19T05:08:47.074 INFO:teuthology.orchestra.run.smithi082.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 916 kB/s | 31 kB 00:00 2024-09-19T05:08:47.092 INFO:teuthology.orchestra.run.smithi082.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T05:08:47.107 INFO:teuthology.orchestra.run.smithi001.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-19T05:08:47.117 INFO:teuthology.orchestra.run.smithi082.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T05:08:47.133 INFO:teuthology.orchestra.run.smithi082.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-09-19T05:08:47.141 INFO:teuthology.orchestra.run.smithi001.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-19T05:08:47.167 INFO:teuthology.orchestra.run.smithi082.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-19T05:08:47.201 INFO:teuthology.orchestra.run.smithi082.stdout:(142/156): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-19T05:08:47.207 INFO:teuthology.orchestra.run.smithi001.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-19T05:08:47.226 INFO:teuthology.orchestra.run.smithi082.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-19T05:08:47.249 INFO:teuthology.orchestra.run.smithi001.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-19T05:08:47.252 INFO:teuthology.orchestra.run.smithi082.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T05:08:47.277 INFO:teuthology.orchestra.run.smithi082.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T05:08:47.302 INFO:teuthology.orchestra.run.smithi082.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:08:47.327 INFO:teuthology.orchestra.run.smithi082.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:08:47.333 INFO:teuthology.orchestra.run.smithi001.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-19T05:08:47.367 INFO:teuthology.orchestra.run.smithi001.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T05:08:47.386 INFO:teuthology.orchestra.run.smithi082.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:08:47.428 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-19T05:08:47.430 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-19T05:08:47.493 INFO:teuthology.orchestra.run.smithi001.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 242 kB/s | 38 kB 00:00 2024-09-19T05:08:47.570 INFO:teuthology.orchestra.run.smithi082.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-19T05:08:47.629 INFO:teuthology.orchestra.run.smithi082.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T05:08:47.679 INFO:teuthology.orchestra.run.smithi082.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-09-19T05:08:47.721 INFO:teuthology.orchestra.run.smithi082.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 5.9 MB/s | 249 kB 00:00 2024-09-19T05:08:47.746 INFO:teuthology.orchestra.run.smithi082.stdout:(153/156): NetworkManager-team-1.51.0-1.el9.x86 349 kB/s | 41 kB 00:00 2024-09-19T05:08:47.788 INFO:teuthology.orchestra.run.smithi082.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-19T05:08:47.838 INFO:teuthology.orchestra.run.smithi082.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 6.4 MB/s | 3.4 MB 00:00 2024-09-19T05:08:47.946 INFO:teuthology.orchestra.run.smithi082.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-19T05:08:47.952 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:08:47.952 INFO:teuthology.orchestra.run.smithi082.stdout:Total 25 MB/s | 226 MB 00:08 2024-09-19T05:08:48.917 INFO:teuthology.orchestra.run.smithi001.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-09-19T05:08:49.148 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-19T05:08:49.299 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-19T05:08:49.299 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-19T05:08:51.112 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-19T05:08:51.112 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-19T05:08:51.476 INFO:teuthology.orchestra.run.smithi001.stdout:(67/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 6.0 MB/s | 49 MB 00:08 2024-09-19T05:08:51.510 INFO:teuthology.orchestra.run.smithi001.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 626 kB/s | 1.6 MB 00:02 2024-09-19T05:08:51.577 INFO:teuthology.orchestra.run.smithi001.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:04 2024-09-19T05:08:51.719 INFO:teuthology.orchestra.run.smithi001.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 658 kB/s | 137 kB 00:00 2024-09-19T05:08:51.852 INFO:teuthology.orchestra.run.smithi001.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-19T05:08:51.961 INFO:teuthology.orchestra.run.smithi001.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 808 kB/s | 87 kB 00:00 2024-09-19T05:08:52.303 INFO:teuthology.orchestra.run.smithi001.stdout:(73/156): postgresql-contrib-13.16-1.el9.x86_64 1.1 MB/s | 910 kB 00:00 2024-09-19T05:08:52.419 INFO:teuthology.orchestra.run.smithi001.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-19T05:08:52.545 INFO:teuthology.orchestra.run.smithi001.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-19T05:08:52.687 INFO:teuthology.orchestra.run.smithi001.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-19T05:08:52.804 INFO:teuthology.orchestra.run.smithi001.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-09-19T05:08:52.912 INFO:teuthology.orchestra.run.smithi001.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-19T05:08:53.029 INFO:teuthology.orchestra.run.smithi001.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T05:08:53.146 INFO:teuthology.orchestra.run.smithi001.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-19T05:08:53.991 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-19T05:08:54.088 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:08:54.127 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:08:54.188 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:08:54.222 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:08:54.247 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:08:54.290 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:08:54.638 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:08:54.848 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:55.192 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:55.321 INFO:teuthology.orchestra.run.smithi001.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.3 MB/s | 5.1 MB 00:02 2024-09-19T05:08:55.341 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:55.609 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:08:55.668 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:08:55.695 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:55.696 INFO:teuthology.orchestra.run.smithi001.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 669 kB/s | 250 kB 00:00 2024-09-19T05:08:55.800 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:55.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:55.892 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:55.914 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:55.939 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:56.080 INFO:teuthology.orchestra.run.smithi001.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-19T05:08:56.159 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:56.280 INFO:teuthology.orchestra.run.smithi001.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-19T05:08:56.309 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:56.397 INFO:teuthology.orchestra.run.smithi001.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-19T05:08:56.446 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:08:56.537 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:56.597 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:56.856 INFO:teuthology.orchestra.run.smithi001.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 587 kB/s | 269 kB 00:00 2024-09-19T05:08:56.931 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:08:57.034 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:08:57.069 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:08:57.104 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:08:57.148 INFO:teuthology.orchestra.run.smithi001.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-09-19T05:08:57.179 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:08:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:08:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:08:57.317 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:08:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-19T05:08:57.349 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:08:57.377 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:08:57.448 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:08:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:08:57.518 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:08:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:08:57.547 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:08:57.582 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:08:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:08:57.606 INFO:teuthology.orchestra.run.smithi001.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 608 kB/s | 279 kB 00:00 2024-09-19T05:08:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:08:57.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:08:57.661 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:08:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:08:57.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:08:57.736 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:08:57.767 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:08:57.840 INFO:teuthology.orchestra.run.smithi001.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 218 kB/s | 51 kB 00:00 2024-09-19T05:08:57.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:08:57.897 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:08:57.949 INFO:teuthology.orchestra.run.smithi001.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T05:08:57.974 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:08:58.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:08:58.118 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:08:58.174 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:08:58.277 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:58.398 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:58.428 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:58.529 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:58.549 INFO:teuthology.orchestra.run.smithi001.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 927 kB/s | 6.0 MB 00:06 2024-09-19T05:08:58.557 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:58.658 INFO:teuthology.orchestra.run.smithi001.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-19T05:08:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:08:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:08:58.766 INFO:teuthology.orchestra.run.smithi001.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-19T05:08:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:08:58.799 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:08:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:08:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:08:58.911 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:08:58.933 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:58.971 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:08:58.979 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:59.001 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:59.027 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:59.137 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:08:59.166 INFO:teuthology.orchestra.run.smithi001.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 552 kB/s | 221 kB 00:00 2024-09-19T05:08:59.207 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:08:59.219 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:08:59.283 INFO:teuthology.orchestra.run.smithi001.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-19T05:08:59.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:08:59.355 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:59.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:08:59.392 INFO:teuthology.orchestra.run.smithi001.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-19T05:08:59.420 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:08:59.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:08:59.474 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:08:59.502 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:08:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:08:59.574 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:08:59.668 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:08:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:08:59.831 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:08:59.859 INFO:teuthology.orchestra.run.smithi001.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 652 kB/s | 304 kB 00:00 2024-09-19T05:08:59.893 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:59.938 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:08:59.973 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:08:59.976 INFO:teuthology.orchestra.run.smithi001.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-19T05:09:00.001 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:09:00.013 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:09:00.046 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:09:00.071 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:09:00.077 INFO:teuthology.orchestra.run.smithi001.stdout:(99/156): postgresql-server-13.16-1.el9.x86_64. 696 kB/s | 5.8 MB 00:08 2024-09-19T05:09:00.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:09:00.140 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:09:00.149 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:09:00.178 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:09:00.193 INFO:teuthology.orchestra.run.smithi001.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 441 kB/s | 96 kB 00:00 2024-09-19T05:09:00.250 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:09:00.277 INFO:teuthology.orchestra.run.smithi001.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-19T05:09:00.285 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:09:00.295 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:09:00.302 INFO:teuthology.orchestra.run.smithi001.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-19T05:09:00.320 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:09:00.328 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:09:00.371 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:09:00.403 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:09:00.438 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:09:00.440 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:09:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:09:00.550 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:09:00.570 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:09:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:09:00.601 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:09:00.631 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:09:00.645 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:09:00.703 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:09:00.723 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:09:00.756 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:09:00.779 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:09:00.799 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:09:00.812 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:09:00.819 INFO:teuthology.orchestra.run.smithi001.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2024-09-19T05:09:00.828 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:09:00.869 INFO:teuthology.orchestra.run.smithi001.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T05:09:00.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:09:00.903 INFO:teuthology.orchestra.run.smithi001.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T05:09:00.904 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:09:00.928 INFO:teuthology.orchestra.run.smithi001.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-19T05:09:00.951 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:09:00.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:09:00.982 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:09:01.025 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:09:01.062 INFO:teuthology.orchestra.run.smithi001.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-19T05:09:01.087 INFO:teuthology.orchestra.run.smithi001.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:09:01.090 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:09:01.112 INFO:teuthology.orchestra.run.smithi001.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:09:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T05:09:01.150 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:09:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:09:01.163 INFO:teuthology.orchestra.run.smithi001.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T05:09:01.205 INFO:teuthology.orchestra.run.smithi001.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T05:09:01.211 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:09:01.247 INFO:teuthology.orchestra.run.smithi001.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T05:09:01.272 INFO:teuthology.orchestra.run.smithi001.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:09:01.298 INFO:teuthology.orchestra.run.smithi001.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:09:01.332 INFO:teuthology.orchestra.run.smithi001.stdout:(116/156): protobuf-compiler-3.14.0-13.el9.x86_ 839 kB/s | 863 kB 00:01 2024-09-19T05:09:01.357 INFO:teuthology.orchestra.run.smithi001.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 245 kB/s | 14 kB 00:00 2024-09-19T05:09:01.407 INFO:teuthology.orchestra.run.smithi001.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-19T05:09:01.441 INFO:teuthology.orchestra.run.smithi001.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.5 MB/s | 303 kB 00:00 2024-09-19T05:09:01.466 INFO:teuthology.orchestra.run.smithi001.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T05:09:01.500 INFO:teuthology.orchestra.run.smithi001.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2024-09-19T05:09:01.542 INFO:teuthology.orchestra.run.smithi001.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-19T05:09:01.567 INFO:teuthology.orchestra.run.smithi001.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T05:09:01.594 INFO:teuthology.orchestra.run.smithi001.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-19T05:09:01.618 INFO:teuthology.orchestra.run.smithi001.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-19T05:09:01.643 INFO:teuthology.orchestra.run.smithi001.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-19T05:09:01.668 INFO:teuthology.orchestra.run.smithi001.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-19T05:09:01.718 INFO:teuthology.orchestra.run.smithi001.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-19T05:09:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:09:01.744 INFO:teuthology.orchestra.run.smithi001.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:09:01.769 INFO:teuthology.orchestra.run.smithi001.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:09:01.794 INFO:teuthology.orchestra.run.smithi001.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T05:09:01.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:09:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T05:09:01.845 INFO:teuthology.orchestra.run.smithi001.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 987 kB/s | 16 kB 00:00 2024-09-19T05:09:01.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:09:01.879 INFO:teuthology.orchestra.run.smithi001.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-19T05:09:01.888 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:09:01.904 INFO:teuthology.orchestra.run.smithi001.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T05:09:01.913 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:09:01.921 INFO:teuthology.orchestra.run.smithi001.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 673 kB/s | 28 kB 00:00 2024-09-19T05:09:01.926 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:09:01.938 INFO:teuthology.orchestra.run.smithi001.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 918 kB/s | 31 kB 00:00 2024-09-19T05:09:01.955 INFO:teuthology.orchestra.run.smithi001.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T05:09:01.963 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:09:01.968 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:09:01.988 INFO:teuthology.orchestra.run.smithi001.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-19T05:09:01.997 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:09:02.005 INFO:teuthology.orchestra.run.smithi001.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T05:09:02.031 INFO:teuthology.orchestra.run.smithi001.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T05:09:02.056 INFO:teuthology.orchestra.run.smithi001.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T05:09:02.081 INFO:teuthology.orchestra.run.smithi001.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T05:09:02.100 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:09:02.106 INFO:teuthology.orchestra.run.smithi001.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-19T05:09:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:09:02.140 INFO:teuthology.orchestra.run.smithi001.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-19T05:09:02.161 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:09:02.166 INFO:teuthology.orchestra.run.smithi001.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T05:09:02.200 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:09:02.206 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:09:02.225 INFO:teuthology.orchestra.run.smithi001.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T05:09:02.254 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:09:02.295 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:09:02.340 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:09:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:09:02.370 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:09:02.412 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:09:02.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:09:02.491 INFO:teuthology.orchestra.run.smithi001.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-19T05:09:02.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:09:02.531 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:09:02.537 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:09:02.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:09:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:09:02.608 INFO:teuthology.orchestra.run.smithi001.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 7.7 MB/s | 3.4 MB 00:00 2024-09-19T05:09:02.643 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:09:02.692 INFO:teuthology.orchestra.run.smithi001.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T05:09:02.715 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:09:02.734 INFO:teuthology.orchestra.run.smithi001.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 985 kB/s | 41 kB 00:00 2024-09-19T05:09:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:09:02.784 INFO:teuthology.orchestra.run.smithi001.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T05:09:02.797 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:09:02.843 INFO:teuthology.orchestra.run.smithi001.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 7.7 MB/s | 1.8 MB 00:00 2024-09-19T05:09:02.884 INFO:teuthology.orchestra.run.smithi001.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-19T05:09:02.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:09:02.950 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:09:02.952 INFO:teuthology.orchestra.run.smithi001.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T05:09:02.998 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:09:03.024 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:09:03.048 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:09:03.122 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:09:03.292 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:09:03.320 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:09:03.331 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:09:03.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:09:03.393 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:09:03.432 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:09:03.433 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:09:03.464 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:09:03.502 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:09:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:09:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:09:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:09:03.750 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:09:03.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:09:03.833 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:09:03.936 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:09:03.992 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:09:04.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:09:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:09:04.765 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:09:04.798 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:09:04.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:09:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:09:04.870 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:09:04.898 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:09:04.979 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:09:05.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:09:05.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:09:05.160 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:09:05.197 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:09:05.241 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:05.324 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:05.344 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:09:05.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:09:05.374 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:09:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:09:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:09:05.898 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:09:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:06.038 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:09:06.098 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:09:06.206 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:09:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:09:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:09:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:09:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:09:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:09:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:09:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:09:08.351 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:08.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:09:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:09:08.955 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:08.996 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:09:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:09:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:10.979 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:11.685 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:09:11.685 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:09:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:11.717 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:21.205 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-19T05:09:21.206 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:21.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:21.384 INFO:teuthology.orchestra.run.smithi001.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 710 kB/s | 16 MB 00:23 2024-09-19T05:09:21.390 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:09:21.390 INFO:teuthology.orchestra.run.smithi001.stdout:Total 5.4 MB/s | 226 MB 00:41 2024-09-19T05:09:21.399 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:21.399 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:21.399 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:09:21.399 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:22.592 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T05:09:22.760 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T05:09:22.761 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T05:09:22.928 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:09:22.955 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:23.187 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:09:23.210 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:09:23.210 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:23.210 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:09:23.211 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:09:23.211 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:09:23.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:23.223 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:23.223 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-09-19T05:09:23.224 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:23.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:23.411 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:23.411 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:09:23.411 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:09:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:23.811 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:09:23.869 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:09:23.932 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:09:24.126 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:09:24.181 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:09:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:09:24.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:09:24.510 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:09:24.565 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:09:24.596 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:09:24.632 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:09:24.890 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:09:24.917 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:09:24.917 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:24.917 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:09:24.917 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:09:24.917 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:09:24.918 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:25.088 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:09:25.091 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T05:09:25.091 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T05:09:25.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:09:25.146 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:09:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:09:25.174 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:09:25.174 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:25.174 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:09:25.174 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:09:25.174 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:09:25.175 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:25.210 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:09:25.237 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:09:25.618 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:09:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:25.748 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:09:25.805 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:09:25.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:09:26.049 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:09:26.103 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:09:26.181 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:09:26.270 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:09:26.342 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:09:26.380 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:09:26.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:09:26.469 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:09:26.509 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:09:26.537 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:09:27.033 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:09:27.060 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:09:27.092 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:09:27.155 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:09:27.192 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:09:27.391 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:09:27.423 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:09:27.530 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:09:27.692 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:09:27.717 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:09:27.740 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:27.792 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:09:27.803 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:09:27.905 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:09:27.958 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:09:28.246 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:09:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:09:28.933 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:09:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:09:29.001 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:09:29.001 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:09:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:09:29.002 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:09:29.002 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:29.045 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:09:29.067 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:09:29.068 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:29.068 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:09:29.068 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:29.113 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:09:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:09:29.135 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:29.135 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:09:29.135 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:09:29.135 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:09:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:09:29.278 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:09:29.382 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:09:29.455 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:09:29.478 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:29.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:09:29.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:09:29.595 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:09:29.595 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:29.595 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:09:29.595 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:09:29.596 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:09:29.596 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:29.639 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:09:29.651 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:09:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:09:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:09:30.721 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:09:30.758 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:09:30.781 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:09:30.782 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:30.782 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:09:30.782 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:09:30.782 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:09:30.782 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:30.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:09:30.857 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:09:30.857 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:30.857 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:09:30.857 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:30.901 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:09:30.925 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:31.235 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:09:31.259 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:09:31.259 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:31.259 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:09:31.260 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:09:31.260 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:09:31.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:31.718 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T05:09:31.822 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:09:31.861 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:09:31.923 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:09:31.964 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:09:31.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:09:32.042 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:09:32.388 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:09:32.498 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:32.623 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:32.766 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:32.842 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:32.878 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:09:33.068 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:09:33.134 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:09:33.162 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:33.267 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:33.296 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:09:33.342 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:09:33.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:09:33.387 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:09:33.576 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:09:33.767 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:09:33.895 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:09:34.005 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:09:34.081 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:09:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:09:34.313 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:09:34.317 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:09:34.358 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:09:34.390 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:09:34.421 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:09:34.425 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:09:34.519 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:09:34.560 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:09:34.595 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:09:34.620 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:09:34.663 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:09:34.671 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:09:34.694 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:09:34.723 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:09:34.730 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:09:34.761 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:09:34.770 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:09:34.814 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:09:34.846 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:09:34.873 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:09:34.954 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:09:35.013 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:09:35.043 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:09:35.112 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:09:35.190 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:09:35.339 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:09:35.384 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:09:35.411 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:09:35.414 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:35.450 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:35.471 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:35.485 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:09:35.535 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:09:35.613 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:09:35.758 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:09:35.797 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:09:35.813 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:09:35.838 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:09:35.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:09:35.936 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:09:35.964 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:09:36.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:09:36.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:09:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:09:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:09:36.309 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:09:36.367 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:09:36.383 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:09:36.452 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:09:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:09:36.487 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:09:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:09:36.530 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:09:36.568 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:09:36.611 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:09:36.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:09:36.650 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:09:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:09:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:09:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:36.769 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:09:36.802 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:36.802 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:36.839 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:36.871 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:09:36.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:36.886 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:36.911 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:09:36.917 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:36.917 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:36.926 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:09:37.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:09:37.038 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:09:37.074 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:09:37.096 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:37.096 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:37.123 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:09:37.173 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:37.239 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:37.369 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:09:37.535 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:09:37.577 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:09:37.728 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:09:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:09:37.772 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:09:37.814 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:09:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:09:37.861 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:09:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:09:37.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:09:37.972 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:09:37.990 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:09:38.013 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:09:38.015 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:09:38.041 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:09:38.041 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:38.046 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:09:38.071 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:09:38.134 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:38.134 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:38.161 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:09:38.218 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:38.243 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:09:38.248 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:38.248 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:38.294 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:09:38.336 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:09:38.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:09:38.399 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:09:38.428 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:38.428 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:38.446 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:09:38.495 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:09:38.520 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:38.524 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:09:38.559 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:09:38.584 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:38.592 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:09:38.634 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:09:38.685 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:09:38.775 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:09:38.825 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:09:38.863 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:09:38.989 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:09:39.041 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:09:39.797 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:09:39.845 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:09:39.879 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:09:39.982 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:09:40.043 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:09:40.088 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:09:40.179 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:09:40.215 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:09:40.406 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:09:40.438 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:09:40.517 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:09:41.197 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:09:41.315 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:09:42.627 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:09:42.716 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:09:42.744 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:09:42.794 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:09:43.120 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:09:43.156 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:43.248 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:09:43.278 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:09:43.315 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:09:43.822 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:09:43.860 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:43.931 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:09:43.961 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:09:44.201 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:09:44.202 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:09:44.203 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:09:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:09:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:09:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:09:44.204 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:09:44.215 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:09:44.216 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:09:44.217 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:09:44.218 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:09:44.219 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:09:44.220 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:09:44.221 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:09:44.222 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:09:44.223 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:09:44.224 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:09:44.225 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:09:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:09:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:09:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:09:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:09:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:09:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:09:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:09:45.430 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-19T05:09:45.971 DEBUG:teuthology.parallel:result is None 2024-09-19T05:09:46.427 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:46.467 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:47.030 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:47.030 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:47.030 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-09-19T05:09:47.030 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:47.030 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.031 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.032 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:09:47.033 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:09:47.034 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:09:47.035 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.036 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:09:47.037 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:09:47.040 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:09:47.041 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:09:47.042 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:09:47.042 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:09:47.042 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:09:47.042 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-19T05:09:47.042 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:09:47.089 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:47.177 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:09:47.178 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:09:47.178 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:09:47.178 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:09:47.215 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:47.486 DEBUG:teuthology.parallel:result is None 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-19T05:09:59.204 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:09:59.375 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:09:59.392 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:09:59.392 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:09:59.392 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:00.920 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:10:00.960 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:01.196 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:10:01.221 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:10:01.221 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:01.221 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:10:01.221 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:10:01.222 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:10:01.222 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:01.680 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:10:01.704 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:01.819 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:10:01.885 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:10:01.949 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:10:02.145 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:10:02.198 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:10:02.279 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:10:02.377 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:10:02.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:10:02.572 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:10:02.613 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:10:02.640 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:10:03.054 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:10:03.081 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:10:03.113 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:10:03.178 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:10:03.212 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:10:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:10:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:10:05.375 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:10:05.406 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:10:05.515 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:10:05.687 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:10:05.716 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:10:05.741 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:10:05.742 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:05.742 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:10:05.742 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:10:05.742 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:10:05.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:05.805 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:10:05.816 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:10:05.922 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:10:05.980 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:10:06.948 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:10:06.995 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:10:07.019 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:10:07.019 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:07.019 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:10:07.019 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:10:07.019 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:10:07.020 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:07.062 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:10:07.086 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:10:07.086 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:07.086 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:10:07.086 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:07.138 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:10:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:10:07.162 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:07.162 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:10:07.162 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:10:07.162 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:10:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:07.480 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:10:07.504 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:10:07.504 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:10:07.504 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:10:07.505 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:10:07.505 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:10:07.505 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:12.328 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:10:12.368 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:10:12.409 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:10:12.446 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:10:12.476 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:10:12.679 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:10:12.723 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:10:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:10:12.783 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:10:12.829 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:10:13.472 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:10:13.509 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:10:13.530 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:10:14.431 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:10:14.531 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:10:14.579 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:10:14.674 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:10:14.709 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:10:14.734 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:10:14.760 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:10:14.760 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:10:14.853 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:10:14.853 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:10:14.937 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:10:14.962 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:10:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:10:14.967 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:10:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:10:15.155 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:10:15.248 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:10:15.316 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:10:20.831 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:10:20.832 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:10:20.833 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:10:20.834 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:10:20.835 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:10:20.836 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:10:20.837 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:10:20.838 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:10:20.839 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:10:20.840 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:10:20.841 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:10:20.842 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:10:20.843 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:10:20.844 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:10:23.447 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.448 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.449 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:10:23.450 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:10:23.451 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:10:23.452 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:10:23.453 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:10:23.454 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:10:23.455 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:10:23.456 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:10:23.457 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:10:23.458 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:10:23.459 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:10:23.460 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:10:23.460 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:10:23.460 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T05:10:23.883 DEBUG:teuthology.parallel:result is None 2024-09-19T05:10:23.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:24.038 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:10:24.063 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.063 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.063 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:10:24.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:24.202 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:10:24.229 INFO:teuthology.orchestra.run.smithi060.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.229 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.229 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:10:24.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:24.372 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:10:24.399 INFO:teuthology.orchestra.run.smithi082.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.400 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:10:24.400 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:10:24.402 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:10:24.402 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:10:24.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:10:24.434 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:10:24.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:10:24.467 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:10:24.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:10:24.513 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:10:24.513 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:10:24.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:10:24.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:10:24.611 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:10:24.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:10:24.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:10:24.709 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:10:24.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:10:24.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:10:24.805 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:10:24.806 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:10:24.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:10:24.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:10:24.907 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:10:24.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:10:24.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:10:25.007 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:10:25.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:10:25.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:10:25.096 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:10:25.096 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:10:25.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:10:25.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:10:25.197 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:10:25.197 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:10:25.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:10:25.295 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:10:25.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:10:25.321 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:10:25.387 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T05:10:25.497 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T05:10:25.498 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:25.498 INFO:tasks.cephadm:Cluster fsid is 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:25.499 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T05:10:25.499 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.60', 'mon.c': '172.21.15.82'} 2024-09-19T05:10:25.499 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-19T05:10:25.499 INFO:tasks.cephadm:First mgr is x 2024-09-19T05:10:25.499 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T05:10:25.499 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-19T05:10:25.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-09-19T05:10:25.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-09-19T05:10:25.587 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T05:10:25.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:25.728 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T05:10:25.864 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:25.866 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:10:25.866 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:10:25.866 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:26.275 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:10 /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:26.275 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:26.661 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:10 /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:26.661 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:10 /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:27.048 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:27.068 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:27.088 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:10:27.121 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T05:10:27.122 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:10:27.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:10:27.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:10:28.616 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:10:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:10:28.879 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:10:59.457 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:10:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:10:59.457 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:10:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-19T05:10:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:10:59.458 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:10:59.458 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:11:00.456 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-19T05:11:00.457 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-19T05:11:01.502 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-19T05:11:01.502 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:11:01.502 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:11:01.503 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-09-19T05:11:01.503 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:11:01.503 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-09-19T05:11:01.503 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-19T05:11:01.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-19T05:11:01.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-09-19T05:11:01.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-09-19T05:11:01.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-19T05:11:01.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-09-19T05:11:01.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-09-19T05:11:01.805 INFO:tasks.cephadm:Writing seed config... 2024-09-19T05:11:01.806 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T05:11:01.806 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T05:11:01.806 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T05:11:01.806 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T05:11:01.807 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T05:11:01.808 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T05:11:01.809 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T05:11:01.810 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:11:01.810 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T05:11:01.830 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7ab08e8a-7645-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T05:11:01.831 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T05:11:01.874 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T05:11:01.918 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T05:11:01.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:02.135 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:11:02.135 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '7ab08e8a-7645-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-19T05:11:02.136 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T05:11:02.136 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-19T05:11:02.160 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:11:02.160 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-19T05:11:02.161 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-19T05:11:02.168 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:11:02.169 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:11:02.175 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:11:02.175 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:11:02.182 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T05:11:02.190 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T05:11:02.190 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:11:02.190 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-19T05:11:02.212 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:11:02.212 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T05:11:02.212 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-19T05:11:02.212 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-19T05:11:02.219 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:11:02.219 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:11:02.225 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:11:02.225 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:11:02.232 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T05:11:02.239 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T05:11:02.239 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:11:02.239 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-19T05:11:02.240 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:02.240 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 140448586527744 on /run/cephadm/7ab08e8a-7645-11ef-bceb-c7b262605968.lock 2024-09-19T05:11:02.240 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 140448586527744 acquired on /run/cephadm/7ab08e8a-7645-11ef-bceb-c7b262605968.lock 2024-09-19T05:11:02.240 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-19T05:11:02.240 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-19T05:11:02.241 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T05:11:02.243 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-19T05:11:02.243 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-19T05:11:02.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T05:11:02.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T05:11:02.246 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T05:11:02.249 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:11:02.250 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T05:11:02.250 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T05:11:02.250 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T05:11:02.250 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T05:11:02.251 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:11:02.693 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:11:02.693 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:11:02.693 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T05:11:02.693 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T05:11:02.694 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T05:11:02.694 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:11:02.694 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T05:11:03.555 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:11:03.556 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:11:03.556 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T05:11:04.429 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-19T05:11:04.430 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-19T05:11:05.434 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBosutmswprKxAAoV59SwHI7S2R+0O8TWJr0A== 2024-09-19T05:11:07.805 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBpsutmW6UXLhAA5SuNhKW4vGx4A8o3lqZq/A== 2024-09-19T05:11:17.204 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQBusutm/dtcMxAAeli6PqE6idDPvLHnRXxuVg== 2024-09-19T05:11:17.205 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-19T05:11:18.849 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:11:18.849 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T05:11:18.849 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:18.849 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:11:18.850 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-19T05:11:19.763 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-19T05:11:19.986 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T05:11:20.135 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T05:11:20.318 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target. 2024-09-19T05:11:20.319 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target. 2024-09-19T05:11:20.563 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:11:20.563 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T05:11:20.733 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target.wants/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@.service. 2024-09-19T05:11:21.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:21 smithi001 podman[30581]: 2024-09-19 05:11:21.192172086 +0000 UTC m=+0.323258060 container start e7803c40b8633830b355c0ebc9284330b026566712d1520cd76d71a3400f3a8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:11:21.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:21 smithi001 ceph-mon[30600]: mkfs 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:21.287 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:11:21.287 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T05:11:21.294 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:11:21.294 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:11:21.294 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T05:11:21.294 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:11:21.295 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-19T05:11:21.295 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-19T05:11:21.520 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:21 smithi001 ceph-mon[30600]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:11:21.520 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:21 smithi001 bash[30581]: e7803c40b8633830b355c0ebc9284330b026566712d1520cd76d71a3400f3a8b 2024-09-19T05:11:21.520 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:21 smithi001 systemd[1]: Started Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.555762s) 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T05:11:22.332 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f7584e6e640 1 Processor -- start 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f7584e6e640 1 -- start start 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f7584e6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f7584e6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f758007c860 con 0x7f758007de30 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f757e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f757e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49186/0 (socket says 172.21.15.1:49186) 2024-09-19T05:11:22.333 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.713+0000 7f757e59c640 1 -- 172.21.15.1:0/1587609586 learned_addr learned my addr 172.21.15.1:0/1587609586 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.714+0000 7f757e59c640 1 -- 172.21.15.1:0/1587609586 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758007c9e0 con 0x7f758007de30 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f757e59c640 1 --2- 172.21.15.1:0/1587609586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7570009e80 tx=0x7f757002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d01e6801bbc1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f757d59a640 1 -- 172.21.15.1:0/1587609586 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7570036070 con 0x7f758007de30 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f757d59a640 1 -- 172.21.15.1:0/1587609586 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570031400 con 0x7f758007de30 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f757d59a640 1 -- 172.21.15.1:0/1587609586 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7570031700 con 0x7f758007de30 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f7584e6e640 1 -- 172.21.15.1:0/1587609586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 msgr2=0x7f758007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.716+0000 7f7584e6e640 1 --2- 172.21.15.1:0/1587609586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7570009e80 tx=0x7f757002a7a0 comp rx=0 tx=0).stop 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 -- 172.21.15.1:0/1587609586 shutdown_connections 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 --2- 172.21.15.1:0/1587609586 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758007c290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 -- 172.21.15.1:0/1587609586 >> 172.21.15.1:0/1587609586 conn(0x7f7580102d90 msgr2=0x7f75801051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 -- 172.21.15.1:0/1587609586 shutdown_connections 2024-09-19T05:11:22.334 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 -- 172.21.15.1:0/1587609586 wait complete. 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 Processor -- start 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.717+0000 7f7584e6e640 1 -- start start 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f7584e6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f7584e6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f758007cf10 con 0x7f758007de30 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f757e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f757e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49188/0 (socket says 172.21.15.1:49188) 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f757e59c640 1 -- 172.21.15.1:0/2579907500 learned_addr learned my addr 172.21.15.1:0/2579907500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f757e59c640 1 -- 172.21.15.1:0/2579907500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758019d7b0 con 0x7f758007de30 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f757e59c640 1 --2- 172.21.15.1:0/2579907500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7570034040 tx=0x7f7570004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7570041020 con 0x7f758007de30 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757003c660 con 0x7f758007de30 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758019da40 con 0x7f758007de30 2024-09-19T05:11:22.335 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7570036040 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.718+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75801a0730 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.719+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7570044020 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.719+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f757003d8f0 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.719+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f758007c310 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.722+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f757004b030 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.783+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f7580075f30 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.784+0000 7f75777fe640 1 -- 172.21.15.1:0/2579907500 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f7580075f30 con 0x7f758007de30 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 msgr2=0x7f758019d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 --2- 172.21.15.1:0/2579907500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7570034040 tx=0x7f7570004a40 comp rx=0 tx=0).stop 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 shutdown_connections 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 --2- 172.21.15.1:0/2579907500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f758007de30 0x7f758019d270 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 >> 172.21.15.1:0/2579907500 conn(0x7f7580102d90 msgr2=0x7f7580104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:22.336 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 shutdown_connections 2024-09-19T05:11:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:21.785+0000 7f7584e6e640 1 -- 172.21.15.1:0/2579907500 wait complete. 2024-09-19T05:11:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-19T05:11:22.337 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: monmap epoch 1 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: last_changed 2024-09-19T05:11:18.232756+0000 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: min_mon_release 19 (squid) 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: election_strategy: 1 2024-09-19T05:11:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:11:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: fsmap 2024-09-19T05:11:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:11:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: mgrmap e1: no daemons active 2024-09-19T05:11:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:22 smithi001 ceph-mon[30600]: from='client.? 172.21.15.1:0/2579907500' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T05:11:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:23 smithi001 ceph-mon[30600]: from='client.? 172.21.15.1:0/4233548727' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:11:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:23 smithi001 ceph-mon[30600]: from='client.? 172.21.15.1:0/4233548727' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:11:24.075 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0df56f6640 1 Processor -- start 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0df56f6640 1 -- start start 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0df56f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:24.076 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0df56f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0107f50 con 0x7f0df0107580 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49198/0 (socket says 172.21.15.1:49198) 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.712+0000 7f0deeffd640 1 -- 172.21.15.1:0/380698452 learned_addr learned my addr 172.21.15.1:0/380698452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.713+0000 7f0deeffd640 1 -- 172.21.15.1:0/380698452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df0108780 con 0x7f0df0107580 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.713+0000 7f0deeffd640 1 --2- 172.21.15.1:0/380698452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009820 tx=0x7f0de002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeef11a6e749b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0dedffb640 1 -- 172.21.15.1:0/380698452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0037070 con 0x7f0df0107580 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0dedffb640 1 -- 172.21.15.1:0/380698452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de0032440 con 0x7f0df0107580 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0dedffb640 1 -- 172.21.15.1:0/380698452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0032740 con 0x7f0df0107580 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 -- 172.21.15.1:0/380698452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 msgr2=0x7f0df0107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 --2- 172.21.15.1:0/380698452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009820 tx=0x7f0de002a270 comp rx=0 tx=0).stop 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 -- 172.21.15.1:0/380698452 shutdown_connections 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 --2- 172.21.15.1:0/380698452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df0107980 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:24.077 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 -- 172.21.15.1:0/380698452 >> 172.21.15.1:0/380698452 conn(0x7f0df0102d90 msgr2=0x7f0df01051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 -- 172.21.15.1:0/380698452 shutdown_connections 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.714+0000 7f0df56f6640 1 -- 172.21.15.1:0/380698452 wait complete. 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0df56f6640 1 Processor -- start 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0df56f6640 1 -- start start 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0df56f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0df56f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0108d20 con 0x7f0df0107580 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0deeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49210/0 (socket says 172.21.15.1:49210) 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.715+0000 7f0deeffd640 1 -- 172.21.15.1:0/4233548727 learned_addr learned my addr 172.21.15.1:0/4233548727 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0deeffd640 1 -- 172.21.15.1:0/4233548727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df019d7b0 con 0x7f0df0107580 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0deeffd640 1 --2- 172.21.15.1:0/4233548727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090b0 tx=0x7f0de00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0041070 con 0x7f0df0107580 2024-09-19T05:11:24.078 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de003c7a0 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df019da40 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0de0037040 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df01a0730 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0de0044070 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.716+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0de003d3f0 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.717+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df0109370 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.719+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0de0046450 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.779+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0df01a1a80 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.782+0000 7f0dd7fff640 1 -- 172.21.15.1:0/4233548727 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f0de0046630 con 0x7f0df0107580 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 msgr2=0x7f0df019d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 --2- 172.21.15.1:0/4233548727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0de00090b0 tx=0x7f0de00046c0 comp rx=0 tx=0).stop 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 shutdown_connections 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 --2- 172.21.15.1:0/4233548727 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0df0107580 0x7f0df019d270 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:24.079 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 >> 172.21.15.1:0/4233548727 conn(0x7f0df0102d90 msgr2=0x7f0df007c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:24.080 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 shutdown_connections 2024-09-19T05:11:24.080 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:22.783+0000 7f0df56f6640 1 -- 172.21.15.1:0/4233548727 wait complete. 2024-09-19T05:11:24.080 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-19T05:11:24.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:24 smithi001 ceph-mon[30600]: from='client.? 172.21.15.1:0/1435653699' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:25.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.493+0000 7f79d1150640 1 Processor -- start 2024-09-19T05:11:25.120 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.493+0000 7f79d1150640 1 -- start start 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.493+0000 7f79d1150640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.493+0000 7f79d1150640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc07be60 con 0x7f79cc107f80 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.494+0000 7f79cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.494+0000 7f79cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56724/0 (socket says 172.21.15.1:56724) 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.494+0000 7f79cad9d640 1 -- 172.21.15.1:0/1250369966 learned_addr learned my addr 172.21.15.1:0/1250369966 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.494+0000 7f79cad9d640 1 -- 172.21.15.1:0/1250369966 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc10a8b0 con 0x7f79cc107f80 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79cad9d640 1 --2- 172.21.15.1:0/1250369966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e80 tx=0x7f79bc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1622c3aa302d2725 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79c9d9b640 1 -- 172.21.15.1:0/1250369966 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc036070 con 0x7f79cc107f80 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79c9d9b640 1 -- 172.21.15.1:0/1250369966 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79bc0318c0 con 0x7f79cc107f80 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79c9d9b640 1 -- 172.21.15.1:0/1250369966 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc007ab0 con 0x7f79cc107f80 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 -- 172.21.15.1:0/1250369966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 msgr2=0x7f79cc10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:25.121 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 --2- 172.21.15.1:0/1250369966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e80 tx=0x7f79bc02a7a0 comp rx=0 tx=0).stop 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 -- 172.21.15.1:0/1250369966 shutdown_connections 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 --2- 172.21.15.1:0/1250369966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc10a370 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 -- 172.21.15.1:0/1250369966 >> 172.21.15.1:0/1250369966 conn(0x7f79cc101b80 msgr2=0x7f79cc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.495+0000 7f79d1150640 1 -- 172.21.15.1:0/1250369966 shutdown_connections 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.496+0000 7f79d1150640 1 -- 172.21.15.1:0/1250369966 wait complete. 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.496+0000 7f79d1150640 1 Processor -- start 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.496+0000 7f79d1150640 1 -- start start 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79d1150640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79d1150640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f79cc10b950 con 0x7f79cc107f80 2024-09-19T05:11:25.122 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79cad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56726/0 (socket says 172.21.15.1:56726) 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79cad9d640 1 -- 172.21.15.1:0/1435653699 learned_addr learned my addr 172.21.15.1:0/1435653699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79cad9d640 1 -- 172.21.15.1:0/1435653699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79cc19dfd0 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79cad9d640 1 --2- 172.21.15.1:0/1435653699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02acc0 tx=0x7f79bc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.497+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc036050 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79bc037040 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79cc19e260 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79bc03d850 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79cc1a0f50 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79bc044020 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.498+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f79bc042020 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.499+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79cc1083e0 con 0x7f79cc107f80 2024-09-19T05:11:25.123 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.501+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f79bc04b020 con 0x7f79cc107f80 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.561+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f79cc02d7c0 con 0x7f79cc107f80 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.561+0000 7f79c3fff640 1 -- 172.21.15.1:0/1435653699 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f79bc03bb60 con 0x7f79cc107f80 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 msgr2=0x7f79cc19da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 --2- 172.21.15.1:0/1435653699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02acc0 tx=0x7f79bc031ca0 comp rx=0 tx=0).stop 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 shutdown_connections 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 --2- 172.21.15.1:0/1435653699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f79cc107f80 0x7f79cc19da90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 >> 172.21.15.1:0/1435653699 conn(0x7f79cc101b80 msgr2=0x7f79cc1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 shutdown_connections 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:24.562+0000 7f79d1150640 1 -- 172.21.15.1:0/1435653699 wait complete. 2024-09-19T05:11:25.124 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-19T05:11:25.401 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 systemd[1]: Stopping Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:11:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a[30596]: 2024-09-19T05:11:25.398+0000 7fc105287640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:11:25.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a[30596]: 2024-09-19T05:11:25.398+0000 7fc105287640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T05:11:25.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 podman[30843]: 2024-09-19 05:11:25.614504124 +0000 UTC m=+0.322314311 container died e7803c40b8633830b355c0ebc9284330b026566712d1520cd76d71a3400f3a8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:11:26.209 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 podman[30843]: 2024-09-19 05:11:25.998827332 +0000 UTC m=+0.706637517 container cleanup e7803c40b8633830b355c0ebc9284330b026566712d1520cd76d71a3400f3a8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:11:26.210 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:25 smithi001 bash[30843]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:11:26.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 podman[30856]: 2024-09-19 05:11:26.208002855 +0000 UTC m=+0.595518844 container remove e7803c40b8633830b355c0ebc9284330b026566712d1520cd76d71a3400f3a8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:11:26.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T05:11:26.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 systemd[1]: Stopped Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:26.573 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 systemd[1]: Starting Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 podman[30949]: 2024-09-19 05:11:26.475105153 +0000 UTC m=+0.016035137 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 podman[30949]: 2024-09-19 05:11:26.58376969 +0000 UTC m=+0.124699668 container create 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 podman[30949]: 2024-09-19 05:11:26.794432592 +0000 UTC m=+0.335362581 container init 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 podman[30949]: 2024-09-19 05:11:26.797758725 +0000 UTC m=+0.338688705 container start 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: pidfile_write: ignore empty --pid-file 2024-09-19T05:11:26.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: load: jerasure load: lrc 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Git sha 0 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: DB SUMMARY 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: DB Session ID: OW6QLGY5KSU88MSWVURG 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104798 ; 2024-09-19T05:11:26.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:11:26.878 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.env: 0x5592c1eab940 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:11:27.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.info_log: 0x5592c415d6e0 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.statistics: (nil) 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.use_fsync: 0 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:11:27.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.db_log_dir: 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.wal_dir: 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:11:27.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.write_buffer_manager: 0x5592c416cdc0 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:11:27.095 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:11:27.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:11:27.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:11:27.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:11:27.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.unordered_write: 0 2024-09-19T05:11:27.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.row_cache: None 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.wal_filter: None 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:11:27.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.wal_compression: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:11:27.099 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:11:27.100 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:11:27.101 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_open_files: -1 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Compression algorithms supported: 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kZSTD supported: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:11:27.102 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.merge_operator: 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_filter: None 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5592c415d320) 2024-09-19T05:11:27.103 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x5592c41511f0 2024-09-19T05:11:27.104 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-19T05:11:27.105 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:11:27.106 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression: NoCompression 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.num_levels: 7 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:11:27.107 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:11:27.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:11:27.109 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:11:27.110 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:11:27.111 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.ttl: 2592000 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:11:27.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 810ca62e-f2dd-4545-98d1-29c8aac55365 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722686824454, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T05:11:27.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722686825469, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99902, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97788, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14179, "raw_average_key_size": 49, "raw_value_size": 90124, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726722686, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "810ca62e-f2dd-4545-98d1-29c8aac55365", "db_session_id": "OW6QLGY5KSU88MSWVURG", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722686825573, "job": 1, "event": "recovery_finished"} 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5592c417ee00 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: DB pointer 0x5592c427a000 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:27.114 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 99.42 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 99.42 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:27.115 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 159.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:27.116 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 27.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x5592c41511f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???) e1 preinit fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).mds e1 new map 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).mds e1 print_map 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-19T05:11:21:229522+0000 2024-09-19T05:11:27.117 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 bash[30949]: 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 systemd[1]: Started Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:27.118 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: monmap epoch 1 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: last_changed 2024-09-19T05:11:18.232756+0000 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: election_strategy: 1 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: fsmap 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:11:27.119 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:26 smithi001 ceph-mon[30968]: mgrmap e1: no daemons active 2024-09-19T05:11:28.711 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:28 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/704336179' entity='client.admin' 2024-09-19T05:11:28.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.314+0000 7f8fd3ba2640 1 Processor -- start 2024-09-19T05:11:28.718 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd3ba2640 1 -- start start 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd3ba2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd3ba2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc107fc0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd193e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd193e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56742/0 (socket says 172.21.15.1:56742) 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.315+0000 7f8fd193e640 1 -- 172.21.15.1:0/3780603885 learned_addr learned my addr 172.21.15.1:0/3780603885 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.316+0000 7f8fd193e640 1 -- 172.21.15.1:0/3780603885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc1087a0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.317+0000 7f8fd193e640 1 --2- 172.21.15.1:0/3780603885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009820 tx=0x7f8fc802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f4b671b41a2cff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd093c640 1 -- 172.21.15.1:0/3780603885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc8037070 con 0x7f8fcc1075f0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd093c640 1 -- 172.21.15.1:0/3780603885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fc8032900 con 0x7f8fcc1075f0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd093c640 1 -- 172.21.15.1:0/3780603885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc8030850 con 0x7f8fcc1075f0 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/3780603885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 msgr2=0x7f8fcc1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 --2- 172.21.15.1:0/3780603885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009820 tx=0x7f8fc802a270 comp rx=0 tx=0).stop 2024-09-19T05:11:28.719 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/3780603885 shutdown_connections 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 --2- 172.21.15.1:0/3780603885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc1079f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/3780603885 >> 172.21.15.1:0/3780603885 conn(0x7f8fcc102dc0 msgr2=0x7f8fcc1051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/3780603885 shutdown_connections 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.318+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/3780603885 wait complete. 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd3ba2640 1 Processor -- start 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd3ba2640 1 -- start start 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd3ba2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd3ba2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10bb50 con 0x7f8fcc1075f0 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd193e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd193e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56752/0 (socket says 172.21.15.1:56752) 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.319+0000 7f8fd193e640 1 -- 172.21.15.1:0/704336179 learned_addr learned my addr 172.21.15.1:0/704336179 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fd193e640 1 -- 172.21.15.1:0/704336179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc07e060 con 0x7f8fcc1075f0 2024-09-19T05:11:28.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fd193e640 1 --2- 172.21.15.1:0/704336179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009940 tx=0x7f8fc8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc8042070 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fc80308c0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc07c250 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc8037040 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc07c790 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fc8045070 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.320+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8fc8047bc0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.321+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc10bcd0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.324+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8fc80327b0 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.383+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f8fcc107a70 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.384+0000 7f8fc2ffd640 1 -- 172.21.15.1:0/704336179 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f8fc803c870 con 0x7f8fcc1075f0 2024-09-19T05:11:28.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 msgr2=0x7f8fcc07db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 --2- 172.21.15.1:0/704336179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009940 tx=0x7f8fc8032ce0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 shutdown_connections 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 --2- 172.21.15.1:0/704336179 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fcc1075f0 0x7f8fcc07db20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 >> 172.21.15.1:0/704336179 conn(0x7f8fcc102dc0 msgr2=0x7f8fcc103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 shutdown_connections 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:27.385+0000 7f8fd3ba2640 1 -- 172.21.15.1:0/704336179 wait complete. 2024-09-19T05:11:28.722 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T05:11:28.743 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:28.744 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-19T05:11:28.744 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T05:11:28.745 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T05:11:29.009 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:11:29.010 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T05:11:29.167 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968.target.wants/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@.service. 2024-09-19T05:11:29.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 systemd[1]: Starting Ceph mgr.x for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:11:29.661 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 podman[31178]: 2024-09-19 05:11:29.310471623 +0000 UTC m=+0.018084345 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:11:29.661 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 podman[31178]: 2024-09-19 05:11:29.411895568 +0000 UTC m=+0.119508281 container create d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T05:11:29.661 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 podman[31178]: 2024-09-19 05:11:29.656668136 +0000 UTC m=+0.364280875 container init d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T05:11:29.661 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 podman[31178]: 2024-09-19 05:11:29.659822055 +0000 UTC m=+0.367434776 container start d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T05:11:29.773 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:11:29.773 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T05:11:29.782 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:11:29.782 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:11:29.782 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T05:11:29.782 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:11:29.792 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:11:29.792 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T05:11:29.801 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:11:29.801 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:11:29.801 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T05:11:29.801 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T05:11:29.802 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-19T05:11:29.802 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-19T05:11:29.934 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 bash[31178]: d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b 2024-09-19T05:11:29.934 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 systemd[1]: Started Ceph mgr.x for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:29.934 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:29.788+0000 7f38f9cbf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:11:29.934 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:29.852+0000 7f38f9cbf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:30.202 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.014+0000 7f38f9cbf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:11:30.202 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.084+0000 7f38f9cbf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:11:30.500 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/763695108' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:11:30.500 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.245+0000 7f38f9cbf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:30.500 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.399+0000 7f38f9cbf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:11:30.801 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.735+0000 7f38f9cbf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:11:30.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:11:30.869 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:11:30.870 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:11:30.871 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:11:21:229522+0000", 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:11:30.872 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:11:21.230173+0000", 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:11:30.873 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f9eeb640 1 Processor -- start 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f9eeb640 1 -- start start 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f9eeb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f9eeb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f28f407bda0 con 0x7f28f4108040 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56766/0 (socket says 172.21.15.1:56766) 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.207+0000 7f28f37fe640 1 -- 172.21.15.1:0/1038644030 learned_addr learned my addr 172.21.15.1:0/1038644030 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.208+0000 7f28f37fe640 1 -- 172.21.15.1:0/1038644030 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f410a970 con 0x7f28f4108040 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.209+0000 7f28f37fe640 1 --2- 172.21.15.1:0/1038644030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009820 tx=0x7f28e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18013aa5919b8a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.209+0000 7f28f27fc640 1 -- 172.21.15.1:0/1038644030 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e4037070 con 0x7f28f4108040 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.209+0000 7f28f27fc640 1 -- 172.21.15.1:0/1038644030 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28e4032900 con 0x7f28f4108040 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.209+0000 7f28f27fc640 1 -- 172.21.15.1:0/1038644030 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e4030850 con 0x7f28f4108040 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 -- 172.21.15.1:0/1038644030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 msgr2=0x7f28f410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 --2- 172.21.15.1:0/1038644030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009820 tx=0x7f28e402a270 comp rx=0 tx=0).stop 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 -- 172.21.15.1:0/1038644030 shutdown_connections 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 --2- 172.21.15.1:0/1038644030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f410a430 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 -- 172.21.15.1:0/1038644030 >> 172.21.15.1:0/1038644030 conn(0x7f28f4101b80 msgr2=0x7f28f4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 -- 172.21.15.1:0/1038644030 shutdown_connections 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.210+0000 7f28f9eeb640 1 -- 172.21.15.1:0/1038644030 wait complete. 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f9eeb640 1 Processor -- start 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f9eeb640 1 -- start start 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f9eeb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f9eeb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f28f410b950 con 0x7f28f4108040 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56768/0 (socket says 172.21.15.1:56768) 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.211+0000 7f28f37fe640 1 -- 172.21.15.1:0/763695108 learned_addr learned my addr 172.21.15.1:0/763695108 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f37fe640 1 -- 172.21.15.1:0/763695108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f419df80 con 0x7f28f4108040 2024-09-19T05:11:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f37fe640 1 --2- 172.21.15.1:0/763695108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f28e40097f0 tx=0x7f28e4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e4037040 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28e4040070 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f419e210 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28e403a390 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41a0f00 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28e403a600 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.212+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f28e40459a0 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.213+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f41084a0 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.215+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f28e4045460 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.279+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f28f41977b0 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.279+0000 7f28f0ff9640 1 -- 172.21.15.1:0/763695108 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f28f41977b0 con 0x7f28f4108040 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 msgr2=0x7f28f419da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:30.876 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 --2- 172.21.15.1:0/763695108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f28e40097f0 tx=0x7f28e4030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 shutdown_connections 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 --2- 172.21.15.1:0/763695108 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f4108040 0x7f28f419da40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 >> 172.21.15.1:0/763695108 conn(0x7f28f4101b80 msgr2=0x7f28f41028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 shutdown_connections 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:30.280+0000 7f28f9eeb640 1 -- 172.21.15.1:0/763695108 wait complete. 2024-09-19T05:11:30.877 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-19T05:11:31.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.799+0000 7f38f9cbf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:11:31.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:30.994+0000 7f38f9cbf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:11:32.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:31.916+0000 7f38f9cbf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:11:32.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:31.987+0000 7f38f9cbf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:11:33.016 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:32.742+0000 7f38f9cbf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:11:33.016 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:32.862+0000 7f38f9cbf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:11:33.313 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.014+0000 7f38f9cbf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:33.313 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.079+0000 7f38f9cbf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:11:33.313 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.239+0000 7f38f9cbf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:11:33.314 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.311+0000 7f38f9cbf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:11:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3371717474' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:11:33.591 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.381+0000 7f38f9cbf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:11:33.591 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.554+0000 7f38f9cbf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:11:33.906 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.622+0000 7f38f9cbf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:11:33.906 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.693+0000 7f38f9cbf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:11:33.906 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.779+0000 7f38f9cbf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:33.906 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.842+0000 7f38f9cbf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:11:33.906 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:33.904+0000 7f38f9cbf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:11:33.966 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:11:33.967 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:11:33.968 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:11:21:229522+0000", 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:11:33.969 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:11:21.230173+0000", 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1be0572640 1 Processor -- start 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1be0572640 1 -- start start 2024-09-19T05:11:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1be0572640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1be0572640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd807bdd0 con 0x7f1bd8108080 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1bde30e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1bde30e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56776/0 (socket says 172.21.15.1:56776) 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.253+0000 7f1bde30e640 1 -- 172.21.15.1:0/331840618 learned_addr learned my addr 172.21.15.1:0/331840618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.254+0000 7f1bde30e640 1 -- 172.21.15.1:0/331840618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd810a9b0 con 0x7f1bd8108080 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.254+0000 7f1bde30e640 1 --2- 172.21.15.1:0/331840618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009820 tx=0x7f1bd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d61c04843a770b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1bdd30c640 1 -- 172.21.15.1:0/331840618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd4037070 con 0x7f1bd8108080 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1bdd30c640 1 -- 172.21.15.1:0/331840618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bd4032900 con 0x7f1bd8108080 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1bdd30c640 1 -- 172.21.15.1:0/331840618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd4030850 con 0x7f1bd8108080 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 -- 172.21.15.1:0/331840618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 msgr2=0x7f1bd810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 --2- 172.21.15.1:0/331840618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009820 tx=0x7f1bd402a270 comp rx=0 tx=0).stop 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 -- 172.21.15.1:0/331840618 shutdown_connections 2024-09-19T05:11:33.971 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 --2- 172.21.15.1:0/331840618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd810a470 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 -- 172.21.15.1:0/331840618 >> 172.21.15.1:0/331840618 conn(0x7f1bd8101cc0 msgr2=0x7f1bd81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 -- 172.21.15.1:0/331840618 shutdown_connections 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.255+0000 7f1be0572640 1 -- 172.21.15.1:0/331840618 wait complete. 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1be0572640 1 Processor -- start 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1be0572640 1 -- start start 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1be0572640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1be0572640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd810b990 con 0x7f1bd8108080 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1bde30e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1bde30e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56790/0 (socket says 172.21.15.1:56790) 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.256+0000 7f1bde30e640 1 -- 172.21.15.1:0/3371717474 learned_addr learned my addr 172.21.15.1:0/3371717474 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bde30e640 1 -- 172.21.15.1:0/3371717474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd8107e40 con 0x7f1bd8108080 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bde30e640 1 --2- 172.21.15.1:0/3371717474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4032ce0 tx=0x7f1bd4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:33.972 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd4042070 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bd40308c0 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bd4037040 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd8106030 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd8106570 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bd4045070 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.257+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bd40463b0 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.258+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd81084e0 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.260+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1bd4047440 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.322+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1bd8194f20 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.323+0000 7f1bcf7fe640 1 -- 172.21.15.1:0/3371717474 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f1bd4047620 con 0x7f1bd8108080 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 msgr2=0x7f1bd8107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 --2- 172.21.15.1:0/3371717474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4032ce0 tx=0x7f1bd4032d10 comp rx=0 tx=0).stop 2024-09-19T05:11:33.973 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 shutdown_connections 2024-09-19T05:11:33.974 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 --2- 172.21.15.1:0/3371717474 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bd8108080 0x7f1bd8107900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:33.974 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 >> 172.21.15.1:0/3371717474 conn(0x7f1bd8101cc0 msgr2=0x7f1bd8102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:33.974 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 shutdown_connections 2024-09-19T05:11:33.974 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:33.324+0000 7f1be0572640 1 -- 172.21.15.1:0/3371717474 wait complete. 2024-09-19T05:11:33.974 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-09-19T05:11:35.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:34.735+0000 7f38f9cbf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: Activating manager daemon x 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: mgrmap e2: x(active, starting, since 0.00309056s) 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: Manager daemon x is now available 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:11:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' 2024-09-19T05:11:35.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' 2024-09-19T05:11:35.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:34 smithi001 ceph-mon[30968]: from='mgr.14100 172.21.15.1:0/3302423758' entity='mgr.x' 2024-09-19T05:11:36.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:36 smithi001 ceph-mon[30968]: mgrmap e3: x(active, since 1.00732s) 2024-09-19T05:11:36.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:36 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3209916136' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:11:37.248 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:37.248 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:11:37.249 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:11:37.250 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:11:37.259 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:11:21:229522+0000", 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:11:37.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:11:37.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:11:21.230173+0000", 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.361+0000 7f9773684640 1 Processor -- start 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.361+0000 7f9773684640 1 -- start start 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.361+0000 7f9773684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.361+0000 7f9773684640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f976c10a240 con 0x7f976c109870 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.362+0000 7f9771420640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:37.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.362+0000 7f9771420640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43590/0 (socket says 172.21.15.1:43590) 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.362+0000 7f9771420640 1 -- 172.21.15.1:0/356197236 learned_addr learned my addr 172.21.15.1:0/356197236 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.362+0000 7f9771420640 1 -- 172.21.15.1:0/356197236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c10a980 con 0x7f976c109870 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9771420640 1 --2- 172.21.15.1:0/356197236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9768009820 tx=0x7f976802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377716b4f90beb83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9763fff640 1 -- 172.21.15.1:0/356197236 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9768037070 con 0x7f976c109870 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9763fff640 1 -- 172.21.15.1:0/356197236 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9768032900 con 0x7f976c109870 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9763fff640 1 -- 172.21.15.1:0/356197236 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9768030850 con 0x7f976c109870 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9773684640 1 -- 172.21.15.1:0/356197236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 msgr2=0x7f976c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.363+0000 7f9773684640 1 --2- 172.21.15.1:0/356197236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9768009820 tx=0x7f976802a270 comp rx=0 tx=0).stop 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 -- 172.21.15.1:0/356197236 shutdown_connections 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 --2- 172.21.15.1:0/356197236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c109c70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 -- 172.21.15.1:0/356197236 >> 172.21.15.1:0/356197236 conn(0x7f976c07cdc0 msgr2=0x7f976c07d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:37.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 -- 172.21.15.1:0/356197236 shutdown_connections 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 -- 172.21.15.1:0/356197236 wait complete. 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 Processor -- start 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.364+0000 7f9773684640 1 -- start start 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9773684640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9773684640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f976c10dd30 con 0x7f976c109870 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9771420640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9771420640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43604/0 (socket says 172.21.15.1:43604) 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9771420640 1 -- 172.21.15.1:0/3209916136 learned_addr learned my addr 172.21.15.1:0/3209916136 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9771420640 1 -- 172.21.15.1:0/3209916136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c19dfe0 con 0x7f976c109870 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9771420640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97680097f0 tx=0x7f9768030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9768037040 con 0x7f976c109870 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9768040070 con 0x7f976c109870 2024-09-19T05:11:37.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976c19e270 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.365+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f976803a390 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.366+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f976c1a0f60 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.366+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f976803a5e0 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.367+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976c109cf0 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.367+0000 7f97627fc640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 0x7f975803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.367+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f976806c160 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.367+0000 7f9770c1f640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 0x7f975803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.367+0000 7f9770c1f640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 0x7f975803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f975c0098c0 tx=0x7f975c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.372+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9768042310 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.616+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f976c02d7c0 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.616+0000 7f97627fc640 1 -- 172.21.15.1:0/3209916136 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f97680371e0 con 0x7f976c109870 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 msgr2=0x7f975803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 0x7f975803b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f975c0098c0 tx=0x7f975c006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:37.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 msgr2=0x7f976c19daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97680097f0 tx=0x7f9768030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 shutdown_connections 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7f97580390a0 0x7f975803b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 --2- 172.21.15.1:0/3209916136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f976c109870 0x7f976c19daa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.618+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 >> 172.21.15.1:0/3209916136 conn(0x7f976c07cdc0 msgr2=0x7f976c1076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.619+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 shutdown_connections 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:36.619+0000 7f9773684640 1 -- 172.21.15.1:0/3209916136 wait complete. 2024-09-19T05:11:37.266 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-19T05:11:37.820 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:37 smithi001 ceph-mon[30968]: mgrmap e4: x(active, since 2s) 2024-09-19T05:11:38.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:38.310 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:11:38.311 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab9410640 1 Processor -- start 2024-09-19T05:11:38.312 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab9410640 1 -- start start 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab9410640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab9410640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffab407bd90 con 0x7ffab41080c0 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43618/0 (socket says 172.21.15.1:43618) 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.634+0000 7ffab2ffd640 1 -- 172.21.15.1:0/4047335173 learned_addr learned my addr 172.21.15.1:0/4047335173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.635+0000 7ffab2ffd640 1 -- 172.21.15.1:0/4047335173 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab410a9f0 con 0x7ffab41080c0 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.635+0000 7ffab2ffd640 1 --2- 172.21.15.1:0/4047335173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009e80 tx=0x7ffaa402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f42f4084c3d52dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:38.313 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab1ffb640 1 -- 172.21.15.1:0/4047335173 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4036070 con 0x7ffab41080c0 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab1ffb640 1 -- 172.21.15.1:0/4047335173 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaa40318c0 con 0x7ffab41080c0 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab1ffb640 1 -- 172.21.15.1:0/4047335173 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4007ab0 con 0x7ffab41080c0 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 -- 172.21.15.1:0/4047335173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 msgr2=0x7ffab410a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 --2- 172.21.15.1:0/4047335173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009e80 tx=0x7ffaa402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 -- 172.21.15.1:0/4047335173 shutdown_connections 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 --2- 172.21.15.1:0/4047335173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab410a4b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 -- 172.21.15.1:0/4047335173 >> 172.21.15.1:0/4047335173 conn(0x7ffab4101cc0 msgr2=0x7ffab41040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 -- 172.21.15.1:0/4047335173 shutdown_connections 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.636+0000 7ffab9410640 1 -- 172.21.15.1:0/4047335173 wait complete. 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab9410640 1 Processor -- start 2024-09-19T05:11:38.314 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab9410640 1 -- start start 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab9410640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab9410640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410b970 con 0x7ffab41080c0 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43634/0 (socket says 172.21.15.1:43634) 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.637+0000 7ffab2ffd640 1 -- 172.21.15.1:0/2007423713 learned_addr learned my addr 172.21.15.1:0/2007423713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffab2ffd640 1 -- 172.21.15.1:0/2007423713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab419bdb0 con 0x7ffab41080c0 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffab2ffd640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffaa402acc0 tx=0x7ffaa4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:38.315 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa4036050 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffaa4037040 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab419c040 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffaa403d850 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.638+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab419ed30 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.639+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ffaa4044020 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.639+0000 7ffaabfff640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 0x7ffaa003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.639+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffaa4042020 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.639+0000 7ffab27fc640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 0x7ffaa003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.639+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab4108520 con 0x7ffab41080c0 2024-09-19T05:11:38.316 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.640+0000 7ffab27fc640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 0x7ffaa003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098c0 tx=0x7ffa9c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.644+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffaa404b020 con 0x7ffab41080c0 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.819+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ffab41944d0 con 0x7ffab41080c0 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.820+0000 7ffaabfff640 1 -- 172.21.15.1:0/2007423713 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7ffaa406c690 con 0x7ffab41080c0 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 msgr2=0x7ffaa003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 0x7ffaa003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098c0 tx=0x7ffa9c006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 msgr2=0x7ffab419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffaa402acc0 tx=0x7ffaa4031ca0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 shutdown_connections 2024-09-19T05:11:38.317 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7ffaa00391b0 0x7ffaa003b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 --2- 172.21.15.1:0/2007423713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffab41080c0 0x7ffab419b870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 >> 172.21.15.1:0/2007423713 conn(0x7ffab4101cc0 msgr2=0x7ffab4102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 shutdown_connections 2024-09-19T05:11:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:37.822+0000 7ffab9410640 1 -- 172.21.15.1:0/2007423713 wait complete. 2024-09-19T05:11:38.318 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-19T05:11:39.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:38 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2007423713' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:11:40.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:39 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1388998220' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T05:11:40.056 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ignoring --setuser ceph since I am not root 2024-09-19T05:11:40.056 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ignoring --setgroup ceph since I am not root 2024-09-19T05:11:40.056 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:39.895+0000 7f164cd3f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:11:40.056 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:39.956+0000 7f164cd3f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:40.339 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.114+0000 7f164cd3f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:11:40.339 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.183+0000 7f164cd3f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.915+0000 7fd7e6cdd640 1 Processor -- start 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.915+0000 7fd7e6cdd640 1 -- start start 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.915+0000 7fd7e6cdd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.916+0000 7fd7e6cdd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e007be00 con 0x7fd7e0107fe0 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.916+0000 7fd7e4a79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.916+0000 7fd7e4a79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43640/0 (socket says 172.21.15.1:43640) 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.916+0000 7fd7e4a79640 1 -- 172.21.15.1:0/2215828015 learned_addr learned my addr 172.21.15.1:0/2215828015 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.916+0000 7fd7e4a79640 1 -- 172.21.15.1:0/2215828015 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e010a910 con 0x7fd7e0107fe0 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.917+0000 7fd7e4a79640 1 --2- 172.21.15.1:0/2215828015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e80 tx=0x7fd7d802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44360f40616f7510 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.917+0000 7fd7df7fe640 1 -- 172.21.15.1:0/2215828015 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d8036070 con 0x7fd7e0107fe0 2024-09-19T05:11:40.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.917+0000 7fd7df7fe640 1 -- 172.21.15.1:0/2215828015 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7d80318c0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.917+0000 7fd7df7fe640 1 -- 172.21.15.1:0/2215828015 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d8007ab0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/2215828015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 msgr2=0x7fd7e010a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/2215828015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e80 tx=0x7fd7d802a7a0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/2215828015 shutdown_connections 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/2215828015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e010a3d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/2215828015 >> 172.21.15.1:0/2215828015 conn(0x7fd7e0101b80 msgr2=0x7fd7e0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/2215828015 shutdown_connections 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/2215828015 wait complete. 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.918+0000 7fd7e6cdd640 1 Processor -- start 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e6cdd640 1 -- start start 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e6cdd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e6cdd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e010b950 con 0x7fd7e0107fe0 2024-09-19T05:11:40.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e4a79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e4a79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43644/0 (socket says 172.21.15.1:43644) 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e4a79640 1 -- 172.21.15.1:0/1388998220 learned_addr learned my addr 172.21.15.1:0/1388998220 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e4a79640 1 -- 172.21.15.1:0/1388998220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e019bd60 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.919+0000 7fd7e4a79640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8031ca0 tx=0x7fd7d8031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.920+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d8036050 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.920+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7d8042070 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.920+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e019bff0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.920+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d803d820 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.920+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e019ece0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.921+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd7d803dad0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.921+0000 7fd7ddffb640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 0x7fd7cc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:40.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.921+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd7d8007e00 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.921+0000 7fd7dffff640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 0x7fd7cc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.921+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e0108440 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.922+0000 7fd7dffff640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 0x7fd7cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80098c0 tx=0x7fd7c8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:38.926+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7d8039de0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.154+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd7e002d7c0 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.746+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd7d806cf40 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.748+0000 7fd7ddffb640 1 -- 172.21.15.1:0/1388998220 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd7d8047980 con 0x7fd7e0107fe0 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 msgr2=0x7fd7cc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 0x7fd7cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80098c0 tx=0x7fd7c8006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 msgr2=0x7fd7e019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8031ca0 tx=0x7fd7d8031cd0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 shutdown_connections 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fd7cc0391b0 0x7fd7cc03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 --2- 172.21.15.1:0/1388998220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7e0107fe0 0x7fd7e019b820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:40.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 >> 172.21.15.1:0/1388998220 conn(0x7fd7e0101b80 msgr2=0x7fd7e0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:40.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 shutdown_connections 2024-09-19T05:11:40.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:39.750+0000 7fd7e6cdd640 1 -- 172.21.15.1:0/1388998220 wait complete. 2024-09-19T05:11:40.591 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.336+0000 7f164cd3f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:40.591 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.488+0000 7f164cd3f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:11:40.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1388998220' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T05:11:40.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-mon[30968]: mgrmap e5: x(active, since 5s) 2024-09-19T05:11:40.946 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.825+0000 7f164cd3f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:11:40.946 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:40.889+0000 7f164cd3f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:11:41.219 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:41.085+0000 7f164cd3f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:11:41.504 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.736+0000 7fa4552d7640 1 Processor -- start 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.736+0000 7fa4552d7640 1 -- start start 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa4552d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa4552d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa45007bdd0 con 0x7fa450108080 2024-09-19T05:11:41.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43684/0 (socket says 172.21.15.1:43684) 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa44effd640 1 -- 172.21.15.1:0/4198772978 learned_addr learned my addr 172.21.15.1:0/4198772978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.737+0000 7fa44effd640 1 -- 172.21.15.1:0/4198772978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45010a9b0 con 0x7fa450108080 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.738+0000 7fa44effd640 1 --2- 172.21.15.1:0/4198772978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa440009820 tx=0x7fa44002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b2157ea6a05ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.738+0000 7fa44dffb640 1 -- 172.21.15.1:0/4198772978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa440037070 con 0x7fa450108080 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.738+0000 7fa44dffb640 1 -- 172.21.15.1:0/4198772978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa440032900 con 0x7fa450108080 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.738+0000 7fa44dffb640 1 -- 172.21.15.1:0/4198772978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa440030850 con 0x7fa450108080 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- 172.21.15.1:0/4198772978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 msgr2=0x7fa45010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 --2- 172.21.15.1:0/4198772978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa440009820 tx=0x7fa44002a270 comp rx=0 tx=0).stop 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- 172.21.15.1:0/4198772978 shutdown_connections 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 --2- 172.21.15.1:0/4198772978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45010a470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:41.588 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- 172.21.15.1:0/4198772978 >> 172.21.15.1:0/4198772978 conn(0x7fa450101cc0 msgr2=0x7fa4501040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- 172.21.15.1:0/4198772978 shutdown_connections 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- 172.21.15.1:0/4198772978 wait complete. 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 Processor -- start 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.739+0000 7fa4552d7640 1 -- start start 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa4552d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa4552d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa45010b990 con 0x7fa450108080 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43686/0 (socket says 172.21.15.1:43686) 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa44effd640 1 -- 172.21.15.1:0/3813510072 learned_addr learned my addr 172.21.15.1:0/3813510072 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:41.589 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa44effd640 1 -- 172.21.15.1:0/3813510072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45019bd80 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa44effd640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa440032ce0 tx=0x7fa440032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa440042070 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4400308c0 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45019c010 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa440037040 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.740+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45019ed00 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa440045070 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4501084e0 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa437fff640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 0x7fa43803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa44006c460 con 0x7fa450108080 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa44e7fc640 1 -- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 msgr2=0x7fa43803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.742+0000 7fa44e7fc640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 0x7fa43803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:41.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.747+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa44006be80 con 0x7fa450108080 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.943+0000 7fa44e7fc640 1 -- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 msgr2=0x7fa43803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.943+0000 7fa44e7fc640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 0x7fa43803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.972+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fa45002d7c0 con 0x7fa450108080 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.973+0000 7fa437fff640 1 -- 172.21.15.1:0/3813510072 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fa44003d430 con 0x7fa450108080 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 msgr2=0x7fa43803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 0x7fa43803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 msgr2=0x7fa45019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa440032ce0 tx=0x7fa440032d10 comp rx=0 tx=0).stop 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 shutdown_connections 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa438039200 0x7fa43803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 --2- 172.21.15.1:0/3813510072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa450108080 0x7fa45019b840 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 >> 172.21.15.1:0/3813510072 conn(0x7fa450101cc0 msgr2=0x7fa450102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:41.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 shutdown_connections 2024-09-19T05:11:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:40.975+0000 7fa4552d7640 1 -- 172.21.15.1:0/3813510072 wait complete. 2024-09-19T05:11:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T05:11:41.592 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-19T05:11:42.024 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:41 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3813510072' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:11:42.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:42.022+0000 7f164cd3f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:11:42.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:42.093+0000 7f164cd3f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:11:43.092 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:42.835+0000 7f164cd3f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:11:43.357 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:42.955+0000 7f164cd3f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:11:43.395 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.103+0000 7f164cd3f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:43.396 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.167+0000 7f164cd3f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:11:43.396 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.322+0000 7f164cd3f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:11:43.396 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.393+0000 7f164cd3f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:11:43.690 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.455+0000 7f164cd3f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:11:43.690 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.620+0000 7f164cd3f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:11:43.690 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.688+0000 7f164cd3f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:11:43.968 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.757+0000 7f164cd3f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:11:43.968 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.843+0000 7f164cd3f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:43.969 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.904+0000 7f164cd3f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:11:43.969 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:43.965+0000 7f164cd3f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:11:45.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:44.790+0000 7f164cd3f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: Active manager daemon x restarted 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: Activating manager daemon x 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: mgrmap e6: x(active, starting, since 0.0034843s) 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: Manager daemon x is now available 2024-09-19T05:11:45.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:45.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:45.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:45.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:45.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:11:45.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:44 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:11:46.346 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:11:46.346 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T05:11:46.346 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.926+0000 7fa3c745f640 1 Processor -- start 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c745f640 1 -- start start 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c745f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c745f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c007be60 con 0x7fa3c0107fb0 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c51fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:46.347 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c51fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43702/0 (socket says 172.21.15.1:43702) 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c51fb640 1 -- 172.21.15.1:0/333079100 learned_addr learned my addr 172.21.15.1:0/333079100 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.927+0000 7fa3c51fb640 1 -- 172.21.15.1:0/333079100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c010a8e0 con 0x7fa3c0107fb0 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.928+0000 7fa3c51fb640 1 --2- 172.21.15.1:0/333079100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009820 tx=0x7fa3bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1aeff4269596dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.928+0000 7fa3b7fff640 1 -- 172.21.15.1:0/333079100 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc037070 con 0x7fa3c0107fb0 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.928+0000 7fa3b7fff640 1 -- 172.21.15.1:0/333079100 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3bc032900 con 0x7fa3c0107fb0 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.928+0000 7fa3b7fff640 1 -- 172.21.15.1:0/333079100 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc030850 con 0x7fa3c0107fb0 2024-09-19T05:11:46.348 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 -- 172.21.15.1:0/333079100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 msgr2=0x7fa3c010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 --2- 172.21.15.1:0/333079100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009820 tx=0x7fa3bc02a270 comp rx=0 tx=0).stop 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 -- 172.21.15.1:0/333079100 shutdown_connections 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 --2- 172.21.15.1:0/333079100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c010a3a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 -- 172.21.15.1:0/333079100 >> 172.21.15.1:0/333079100 conn(0x7fa3c0101b90 msgr2=0x7fa3c0104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 -- 172.21.15.1:0/333079100 shutdown_connections 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.929+0000 7fa3c745f640 1 -- 172.21.15.1:0/333079100 wait complete. 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c745f640 1 Processor -- start 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c745f640 1 -- start start 2024-09-19T05:11:46.349 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c745f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c745f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c010b980 con 0x7fa3c0107fb0 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c51fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c51fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43708/0 (socket says 172.21.15.1:43708) 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c51fb640 1 -- 172.21.15.1:0/2444480120 learned_addr learned my addr 172.21.15.1:0/2444480120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c51fb640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c019bd70 con 0x7fa3c0107fb0 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.930+0000 7fa3c51fb640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc032ce0 tx=0x7fa3bc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.931+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc042070 con 0x7fa3c0107fb0 2024-09-19T05:11:46.350 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.931+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3bc0308c0 con 0x7fa3c0107fb0 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.931+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c019c000 con 0x7fa3c0107fb0 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.931+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc037040 con 0x7fa3c0107fb0 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.931+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c019ecf0 con 0x7fa3c0107fb0 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa3bc045070 con 0x7fa3c0107fb0 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3b67fc640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa3ac03bdd0 con 0x7fa3ac039200 2024-09-19T05:11:46.351 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa3bc06c1f0 con 0x7fa3c0107fb0 2024-09-19T05:11:46.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3c49fa640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 msgr2=0x7fa3ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:46.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:41.932+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:46.352 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:42.133+0000 7fa3c49fa640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 msgr2=0x7fa3ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:46.353 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:42.133+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:11:46.353 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:42.534+0000 7fa3c49fa640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 msgr2=0x7fa3ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:42.534+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:43.335+0000 7fa3c49fa640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 msgr2=0x7fa3ac03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/3800466162 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:43.335+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:44.793+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fa3bc06ad70 con 0x7fa3c0107fb0 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:44.794+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 msgr2=0x7fa3ac03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:44.794+0000 7fa3b67fc640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.795+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fa3bc03c840 con 0x7fa3c0107fb0 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.795+0000 7fa3b67fc640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 0x7fa3ac03ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.795+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa3bc02bba0 con 0x7fa3ac03cb30 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.795+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 0x7fa3ac03ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.796+0000 7fa3c49fa640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 0x7fa3ac03ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0003980 tx=0x7fa3b00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.797+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa3bc02bba0 con 0x7fa3ac03cb30 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa3c0108410 con 0x7fa3ac03cb30 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3b67fc640 1 -- 172.21.15.1:0/2444480120 <== mgr.14118 v2:172.21.15.1:6800/2966742919 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa3c0108410 con 0x7fa3ac03cb30 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 msgr2=0x7fa3ac03ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 0x7fa3ac03ef20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0003980 tx=0x7fa3b00092b0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.355 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 msgr2=0x7fa3c019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc032ce0 tx=0x7fa3bc032d10 comp rx=0 tx=0).stop 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 shutdown_connections 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa3ac03cb30 0x7fa3ac03ef20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:6800/3800466162,v1:172.21.15.1:6801/3800466162] conn(0x7fa3ac039200 0x7fa3ac03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 --2- 172.21.15.1:0/2444480120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3c0107fb0 0x7fa3c019b830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 >> 172.21.15.1:0/2444480120 conn(0x7fa3c0101b90 msgr2=0x7fa3c0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 shutdown_connections 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:45.804+0000 7fa3c745f640 1 -- 172.21.15.1:0/2444480120 wait complete. 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-19T05:11:46.356 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-19T05:11:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:46 smithi001 ceph-mon[30968]: Found migration_current of "None". Setting to last migration. 2024-09-19T05:11:47.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:46 smithi001 ceph-mon[30968]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:11:47.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:46 smithi001 ceph-mon[30968]: mgrmap e7: x(active, since 1.00549s) 2024-09-19T05:11:47.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:46 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:47.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:46 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:47.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4bfff640 1 Processor -- start 2024-09-19T05:11:47.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4bfff640 1 -- start start 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4bfff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c07bde0 con 0x7f3c4c105c10 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54110/0 (socket says 172.21.15.1:54110) 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.749+0000 7f3c4affd640 1 -- 172.21.15.1:0/2607736975 learned_addr learned my addr 172.21.15.1:0/2607736975 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.750+0000 7f3c4affd640 1 -- 172.21.15.1:0/2607736975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c106550 con 0x7f3c4c105c10 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4affd640 1 --2- 172.21.15.1:0/2607736975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009820 tx=0x7f3c3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4e4b2aa91a3226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4a7fc640 1 -- 172.21.15.1:0/2607736975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3c037070 con 0x7f3c4c105c10 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4a7fc640 1 -- 172.21.15.1:0/2607736975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c3c032900 con 0x7f3c4c105c10 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4a7fc640 1 -- 172.21.15.1:0/2607736975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3c030850 con 0x7f3c4c105c10 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4bfff640 1 -- 172.21.15.1:0/2607736975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 msgr2=0x7f3c4c106010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:47.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.751+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/2607736975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009820 tx=0x7f3c3c02a270 comp rx=0 tx=0).stop 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 -- 172.21.15.1:0/2607736975 shutdown_connections 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/2607736975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c106010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 -- 172.21.15.1:0/2607736975 >> 172.21.15.1:0/2607736975 conn(0x7f3c4c1019c0 msgr2=0x7f3c4c103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 -- 172.21.15.1:0/2607736975 shutdown_connections 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 -- 172.21.15.1:0/2607736975 wait complete. 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.752+0000 7f3c4bfff640 1 Processor -- start 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4bfff640 1 -- start start 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4bfff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c107650 con 0x7f3c4c105c10 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54114/0 (socket says 172.21.15.1:54114) 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4affd640 1 -- 172.21.15.1:0/4092113957 learned_addr learned my addr 172.21.15.1:0/4092113957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:47.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4affd640 1 -- 172.21.15.1:0/4092113957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c19dd60 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c4affd640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097f0 tx=0x7f3c3c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.753+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3c037040 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.754+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c19dff0 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.754+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c3c040070 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.754+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c3c03a390 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.754+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c1a0ce0 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.755+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f3c3c03a5e0 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.755+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c106010 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.755+0000 7f3c48ff9640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 0x7f3c3803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.755+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3c3c06c590 con 0x7f3c4c105c10 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.755+0000 7f3c43fff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 0x7f3c3803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.756+0000 7f3c43fff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 0x7f3c3803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c340098c0 tx=0x7f3c34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:47.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.764+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3c3c03a9d0 con 0x7f3c4c105c10 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.956+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f3c4c062630 con 0x7f3c380390f0 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.961+0000 7f3c48ff9640 1 -- 172.21.15.1:0/4092113957 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3c4c062630 con 0x7f3c380390f0 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 msgr2=0x7f3c3803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 0x7f3c3803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c340098c0 tx=0x7f3c34006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 msgr2=0x7f3c4c19d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0097f0 tx=0x7f3c3c030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 shutdown_connections 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f3c380390f0 0x7f3c3803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 --2- 172.21.15.1:0/4092113957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c4c105c10 0x7f3c4c19d820 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.963+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 >> 172.21.15.1:0/4092113957 conn(0x7f3c4c1019c0 msgr2=0x7f3c4c194210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.964+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 shutdown_connections 2024-09-19T05:11:47.587 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:46.964+0000 7f3c4bfff640 1 -- 172.21.15.1:0/4092113957 wait complete. 2024-09-19T05:11:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:47 smithi001 ceph-mon[30968]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:11:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:47 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:47 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:47 smithi001 ceph-mon[30968]: mgrmap e8: x(active, since 2s) 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:48.478+0000 7f15b9864640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:11:48] ENGINE Error in HTTPServer.serve 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: Traceback (most recent call last): 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._connections.run(self.expiration_interval) 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._run(expiration_interval) 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:11:48.711 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: s = self.context.wrap_socket( 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: return self.sslsocket_class._create( 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self.do_handshake() 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._sslobj.do_handshake() 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:11:48.712 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.962+0000 7f6bb877e640 1 Processor -- start 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.962+0000 7f6bb877e640 1 -- start start 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.962+0000 7f6bb877e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.962+0000 7f6bb877e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb007be20 con 0x7f6bb0107ff0 2024-09-19T05:11:48.714 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.963+0000 7f6bb651a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:48.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.963+0000 7f6bb651a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54124/0 (socket says 172.21.15.1:54124) 2024-09-19T05:11:48.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.963+0000 7f6bb651a640 1 -- 172.21.15.1:0/3361969085 learned_addr learned my addr 172.21.15.1:0/3361969085 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:48.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.963+0000 7f6bb651a640 1 -- 172.21.15.1:0/3361969085 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb010a920 con 0x7f6bb0107ff0 2024-09-19T05:11:48.715 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb651a640 1 --2- 172.21.15.1:0/3361969085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009820 tx=0x7f6bac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68949199c1755663 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb5518640 1 -- 172.21.15.1:0/3361969085 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac037070 con 0x7f6bb0107ff0 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb5518640 1 -- 172.21.15.1:0/3361969085 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bac032900 con 0x7f6bb0107ff0 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb5518640 1 -- 172.21.15.1:0/3361969085 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac030850 con 0x7f6bb0107ff0 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb877e640 1 -- 172.21.15.1:0/3361969085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 msgr2=0x7f6bb010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.964+0000 7f6bb877e640 1 --2- 172.21.15.1:0/3361969085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009820 tx=0x7f6bac02a270 comp rx=0 tx=0).stop 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- 172.21.15.1:0/3361969085 shutdown_connections 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 --2- 172.21.15.1:0/3361969085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb010a3e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- 172.21.15.1:0/3361969085 >> 172.21.15.1:0/3361969085 conn(0x7f6bb0101b90 msgr2=0x7f6bb0104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- 172.21.15.1:0/3361969085 shutdown_connections 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- 172.21.15.1:0/3361969085 wait complete. 2024-09-19T05:11:48.720 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 Processor -- start 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- start start 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.965+0000 7f6bb877e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb010b960 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb651a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb651a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54136/0 (socket says 172.21.15.1:54136) 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb651a640 1 -- 172.21.15.1:0/2905321937 learned_addr learned my addr 172.21.15.1:0/2905321937 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb651a640 1 -- 172.21.15.1:0/2905321937 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb0107db0 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb651a640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097f0 tx=0x7f6bac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac037040 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bac040070 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb0105fa0 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac03a390 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.966+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01063c0 con 0x7f6bb0107ff0 2024-09-19T05:11:48.721 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.967+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6bac03a690 con 0x7f6bb0107ff0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.967+0000 7f6ba77fe640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.967+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6bac06cce0 con 0x7f6bb0107ff0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.967+0000 7f6bb5d19640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.968+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb0108450 con 0x7f6bb0107ff0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.968+0000 7f6bb5d19640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 0x7f6b9c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098c0 tx=0x7f6ba0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:47.972+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bac043bb0 con 0x7f6bb0107ff0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.154+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f6bb0194ec0 con 0x7f6b9c0391b0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.154+0000 7f6ba77fe640 1 -- 172.21.15.1:0/2905321937 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f6bb0194ec0 con 0x7f6b9c0391b0 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 msgr2=0x7f6b9c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 0x7f6b9c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098c0 tx=0x7f6ba0006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 msgr2=0x7f6bb0107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097f0 tx=0x7f6bac030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:48.722 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 shutdown_connections 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 --2- 172.21.15.1:0/2905321937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bb0107ff0 0x7f6bb0107870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 >> 172.21.15.1:0/2905321937 conn(0x7f6bb0101b90 msgr2=0x7f6bb01029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 shutdown_connections 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:48.157+0000 7f6bb877e640 1 -- 172.21.15.1:0/2905321937 wait complete. 2024-09-19T05:11:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-19T05:11:49.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-mon[30968]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:49.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:48 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:50.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:50.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: [19/Sep/2024:05:11:48] ENGINE Bus STARTING 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: [19/Sep/2024:05:11:48] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: [19/Sep/2024:05:11:48] ENGINE Error in HTTPServer.serve 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T05:11:50.056 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T05:11:50.057 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:11:50.058 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T05:11:50.058 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:11:50.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: [19/Sep/2024:05:11:48] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T05:11:50.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:49 smithi001 ceph-mon[30968]: [19/Sep/2024:05:11:48] ENGINE Bus STARTED 2024-09-19T05:11:50.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: Generating public/private rsa key pair. 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: Your identification has been saved in /tmp/tmp25sajogk/key 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: Your public key has been saved in /tmp/tmp25sajogk/key.pub 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: The key fingerprint is: 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: SHA256:T0r2lQrGlKuuhDC8NVUsMqtHlW/CKeNNJhuggCvcEgQ ceph-7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: The key's randomart image is: 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: +---[RSA 3072]----+ 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: |E. o. | 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: |oo o +.. . | 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: |+.+ *.+ o | 2024-09-19T05:11:50.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: |=o O.* = . . | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: |+.=oX o S . o | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: | +o=.. = * o | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: | .o . . . + | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: | . . | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: | ... | 2024-09-19T05:11:50.343 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: +----[SHA256]-----+ 2024-09-19T05:11:50.612 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.112+0000 7f7b8fb9b640 1 Processor -- start 2024-09-19T05:11:50.612 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.112+0000 7f7b8fb9b640 1 -- start start 2024-09-19T05:11:50.612 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.112+0000 7f7b8fb9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:50.612 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.112+0000 7f7b8fb9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8807bd90 con 0x7f7b881080c0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.113+0000 7f7b8d937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.113+0000 7f7b8d937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54142/0 (socket says 172.21.15.1:54142) 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.113+0000 7f7b8d937640 1 -- 172.21.15.1:0/3029392905 learned_addr learned my addr 172.21.15.1:0/3029392905 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.113+0000 7f7b8d937640 1 -- 172.21.15.1:0/3029392905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8810a9f0 con 0x7f7b881080c0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8d937640 1 --2- 172.21.15.1:0/3029392905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009820 tx=0x7f7b8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab85f1729f481fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8c935640 1 -- 172.21.15.1:0/3029392905 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84037070 con 0x7f7b881080c0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8c935640 1 -- 172.21.15.1:0/3029392905 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b84032900 con 0x7f7b881080c0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8c935640 1 -- 172.21.15.1:0/3029392905 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84030850 con 0x7f7b881080c0 2024-09-19T05:11:50.613 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3029392905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 msgr2=0x7f7b8810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3029392905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009820 tx=0x7f7b8402a270 comp rx=0 tx=0).stop 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3029392905 shutdown_connections 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3029392905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8810a4b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.114+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3029392905 >> 172.21.15.1:0/3029392905 conn(0x7f7b88101cc0 msgr2=0x7f7b881040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3029392905 shutdown_connections 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3029392905 wait complete. 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 Processor -- start 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 -- start start 2024-09-19T05:11:50.614 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8fb9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8810b970 con 0x7f7b881080c0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8d937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8d937640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54148/0 (socket says 172.21.15.1:54148) 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.115+0000 7f7b8d937640 1 -- 172.21.15.1:0/3239694268 learned_addr learned my addr 172.21.15.1:0/3239694268 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b8d937640 1 -- 172.21.15.1:0/3239694268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8819dfd0 con 0x7f7b881080c0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b8d937640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b84032ce0 tx=0x7f7b84032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84042070 con 0x7f7b881080c0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b840308c0 con 0x7f7b881080c0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8819e260 con 0x7f7b881080c0 2024-09-19T05:11:50.615 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b84037040 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.116+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b881a0f50 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.117+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7b84045070 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.117+0000 7f7b7effd640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 0x7f7b7403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.117+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b88108520 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.117+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b8406c2d0 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.117+0000 7f7b8d136640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 0x7f7b7403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.118+0000 7f7b8d136640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 0x7f7b7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b780098c0 tx=0x7f7b78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.122+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b8403c760 con 0x7f7b881080c0 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:49.297+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7b88062630 con 0x7f7b74039200 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.058+0000 7f7b7effd640 1 -- 172.21.15.1:0/3239694268 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b88062630 con 0x7f7b74039200 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 msgr2=0x7f7b7403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:50.616 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 0x7f7b7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7b780098c0 tx=0x7f7b78006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 msgr2=0x7f7b8819da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b84032ce0 tx=0x7f7b84032d10 comp rx=0 tx=0).stop 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 shutdown_connections 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f7b74039200 0x7f7b7403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 --2- 172.21.15.1:0/3239694268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7b881080c0 0x7f7b8819da90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 >> 172.21.15.1:0/3239694268 conn(0x7f7b88101cc0 msgr2=0x7f7b881029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 shutdown_connections 2024-09-19T05:11:50.617 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:50.060+0000 7f7b8fb9b640 1 -- 172.21.15.1:0/3239694268 wait complete. 2024-09-19T05:11:50.989 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-mon[30968]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:50.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-mon[30968]: Generating ssh key... 2024-09-19T05:11:50.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:50.990 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:50 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:51.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:51.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.011+0000 7f941699e640 1 Processor -- start 2024-09-19T05:11:51.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.011+0000 7f941699e640 1 -- start start 2024-09-19T05:11:51.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.011+0000 7f941699e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:51.743 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.011+0000 7f941699e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9410107fc0 con 0x7f94101075f0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.011+0000 7f940ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.012+0000 7f940ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54160/0 (socket says 172.21.15.1:54160) 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.012+0000 7f940ffff640 1 -- 172.21.15.1:0/2365138709 learned_addr learned my addr 172.21.15.1:0/2365138709 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.012+0000 7f940ffff640 1 -- 172.21.15.1:0/2365138709 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101087a0 con 0x7f94101075f0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.012+0000 7f940ffff640 1 --2- 172.21.15.1:0/2365138709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9400009820 tx=0x7f940002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb90435f8a312c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f940effd640 1 -- 172.21.15.1:0/2365138709 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9400037070 con 0x7f94101075f0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f940effd640 1 -- 172.21.15.1:0/2365138709 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9400032900 con 0x7f94101075f0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f940effd640 1 -- 172.21.15.1:0/2365138709 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9400030850 con 0x7f94101075f0 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 -- 172.21.15.1:0/2365138709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 msgr2=0x7f94101079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 --2- 172.21.15.1:0/2365138709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9400009820 tx=0x7f940002a270 comp rx=0 tx=0).stop 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 -- 172.21.15.1:0/2365138709 shutdown_connections 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 --2- 172.21.15.1:0/2365138709 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f94101079f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:51.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 -- 172.21.15.1:0/2365138709 >> 172.21.15.1:0/2365138709 conn(0x7f9410102dc0 msgr2=0x7f94101051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 -- 172.21.15.1:0/2365138709 shutdown_connections 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.013+0000 7f941699e640 1 -- 172.21.15.1:0/2365138709 wait complete. 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f941699e640 1 Processor -- start 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f941699e640 1 -- start start 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f941699e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f941699e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f941010bb50 con 0x7f94101075f0 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f940ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f940ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54176/0 (socket says 172.21.15.1:54176) 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.014+0000 7f940ffff640 1 -- 172.21.15.1:0/834263096 learned_addr learned my addr 172.21.15.1:0/834263096 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f940ffff640 1 -- 172.21.15.1:0/834263096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941007e060 con 0x7f94101075f0 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f940ffff640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9400009940 tx=0x7f9400032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9400042070 con 0x7f94101075f0 2024-09-19T05:11:51.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94000308c0 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9400037040 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941007c250 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.015+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941007c790 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.016+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9400045070 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.016+0000 7f940d7fa640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 0x7f93f803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.016+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941010bcd0 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.016+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f940006c440 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.016+0000 7f940f7fe640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 0x7f93f803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.017+0000 7f940f7fe640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 0x7f93f803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94040098c0 tx=0x7f9404006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.021+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f940003add0 con 0x7f94101075f0 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.197+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f94101950d0 con 0x7f93f8039200 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.198+0000 7f940d7fa640 1 -- 172.21.15.1:0/834263096 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f94101950d0 con 0x7f93f8039200 2024-09-19T05:11:51.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.199+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 msgr2=0x7f93f803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.199+0000 7f941699e640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 0x7f93f803b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f94040098c0 tx=0x7f9404006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 msgr2=0x7f941007db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9400009940 tx=0x7f9400032ce0 comp rx=0 tx=0).stop 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 shutdown_connections 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f93f8039200 0x7f93f803b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 --2- 172.21.15.1:0/834263096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94101075f0 0x7f941007db20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 >> 172.21.15.1:0/834263096 conn(0x7f9410102dc0 msgr2=0x7f9410103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 shutdown_connections 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:51.200+0000 7f941699e640 1 -- 172.21.15.1:0/834263096 wait complete. 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:11:51.747 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T05:11:51.748 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-19T05:11:52.145 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:51 smithi001 ceph-mon[30968]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:53.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:52 smithi001 ceph-mon[30968]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:53.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:53 smithi001 ceph-mon[30968]: Deploying cephadm binary to smithi001 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05c4c47640 1 Processor -- start 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05c4c47640 1 -- start start 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05c4c47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05c4c47640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05c007bdd0 con 0x7f05c0108080 2024-09-19T05:11:56.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05be59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.150+0000 7f05be59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54182/0 (socket says 172.21.15.1:54182) 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.151+0000 7f05be59c640 1 -- 172.21.15.1:0/2445343467 learned_addr learned my addr 172.21.15.1:0/2445343467 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.151+0000 7f05be59c640 1 -- 172.21.15.1:0/2445343467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c010a9b0 con 0x7f05c0108080 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.151+0000 7f05be59c640 1 --2- 172.21.15.1:0/2445343467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009820 tx=0x7f05b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6193701126f8c43f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05bd59a640 1 -- 172.21.15.1:0/2445343467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0037070 con 0x7f05c0108080 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05bd59a640 1 -- 172.21.15.1:0/2445343467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05b0032900 con 0x7f05c0108080 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05bd59a640 1 -- 172.21.15.1:0/2445343467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0030850 con 0x7f05c0108080 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 -- 172.21.15.1:0/2445343467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 msgr2=0x7f05c010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 --2- 172.21.15.1:0/2445343467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009820 tx=0x7f05b002a270 comp rx=0 tx=0).stop 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 -- 172.21.15.1:0/2445343467 shutdown_connections 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 --2- 172.21.15.1:0/2445343467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c010a470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 -- 172.21.15.1:0/2445343467 >> 172.21.15.1:0/2445343467 conn(0x7f05c0101cc0 msgr2=0x7f05c01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 -- 172.21.15.1:0/2445343467 shutdown_connections 2024-09-19T05:11:56.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.152+0000 7f05c4c47640 1 -- 172.21.15.1:0/2445343467 wait complete. 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05c4c47640 1 Processor -- start 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05c4c47640 1 -- start start 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05c4c47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05c4c47640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05c010b990 con 0x7f05c0108080 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05be59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05be59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54184/0 (socket says 172.21.15.1:54184) 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.153+0000 7f05be59c640 1 -- 172.21.15.1:0/414014957 learned_addr learned my addr 172.21.15.1:0/414014957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05be59c640 1 -- 172.21.15.1:0/414014957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c0107e40 con 0x7f05c0108080 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05be59c640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05b00097f0 tx=0x7f05b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0037040 con 0x7f05c0108080 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c0106030 con 0x7f05c0108080 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c0106510 con 0x7f05c0108080 2024-09-19T05:11:56.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05b0040070 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.154+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0045ad0 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.155+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f05b0045c70 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.155+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a00052c0 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.156+0000 7f05af7fe640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 0x7f05a803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.156+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f05b006c610 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.156+0000 7f05bdd9b640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 0x7f05a803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.156+0000 7f05bdd9b640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 0x7f05a803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098c0 tx=0x7f05b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.161+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05b0042b30 con 0x7f05c0108080 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:52.342+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}) -- 0x7f05a0000bf0 con 0x7f05a80391b0 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.233+0000 7f05af7fe640 1 -- 172.21.15.1:0/414014957 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f05a0000bf0 con 0x7f05a80391b0 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.235+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 msgr2=0x7f05a803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:56.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.235+0000 7f05c4c47640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 0x7f05a803b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098c0 tx=0x7f05b4006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.235+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 msgr2=0x7f05c0107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.235+0000 7f05c4c47640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05b00097f0 tx=0x7f05b0030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.235+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 shutdown_connections 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.236+0000 7f05c4c47640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f05a80391b0 0x7f05a803b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.236+0000 7f05c4c47640 1 --2- 172.21.15.1:0/414014957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05c0108080 0x7f05c0107900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.236+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 >> 172.21.15.1:0/414014957 conn(0x7f05c0101cc0 msgr2=0x7f05c0102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.236+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 shutdown_connections 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:56.236+0000 7f05c4c47640 1 -- 172.21.15.1:0/414014957 wait complete. 2024-09-19T05:11:56.813 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-19T05:11:57.407 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:57 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:57.408 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:57 smithi001 ceph-mon[30968]: Added host smithi001 2024-09-19T05:11:57.408 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:57 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:58.220 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T05:11:58.220 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.194+0000 7fcb27ebe640 1 Processor -- start 2024-09-19T05:11:58.220 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.194+0000 7fcb27ebe640 1 -- start start 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb27ebe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb27ebe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2007be20 con 0x7fcb20107fc0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb25c5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb25c5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55146/0 (socket says 172.21.15.1:55146) 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb25c5a640 1 -- 172.21.15.1:0/3752571887 learned_addr learned my addr 172.21.15.1:0/3752571887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.195+0000 7fcb25c5a640 1 -- 172.21.15.1:0/3752571887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2010a8f0 con 0x7fcb20107fc0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.196+0000 7fcb25c5a640 1 --2- 172.21.15.1:0/3752571887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d371a17647daa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.196+0000 7fcb24c58640 1 -- 172.21.15.1:0/3752571887 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037070 con 0x7fcb20107fc0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.196+0000 7fcb24c58640 1 -- 172.21.15.1:0/3752571887 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb1c032900 con 0x7fcb20107fc0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.196+0000 7fcb24c58640 1 -- 172.21.15.1:0/3752571887 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c030850 con 0x7fcb20107fc0 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- 172.21.15.1:0/3752571887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 msgr2=0x7fcb2010a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:58.221 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/3752571887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009820 tx=0x7fcb1c02a270 comp rx=0 tx=0).stop 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- 172.21.15.1:0/3752571887 shutdown_connections 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/3752571887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2010a3b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- 172.21.15.1:0/3752571887 >> 172.21.15.1:0/3752571887 conn(0x7fcb20101b80 msgr2=0x7fcb20103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- 172.21.15.1:0/3752571887 shutdown_connections 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- 172.21.15.1:0/3752571887 wait complete. 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 Processor -- start 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.197+0000 7fcb27ebe640 1 -- start start 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb27ebe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb27ebe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2010b930 con 0x7fcb20107fc0 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb25c5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb25c5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55154/0 (socket says 172.21.15.1:55154) 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb25c5a640 1 -- 172.21.15.1:0/912681143 learned_addr learned my addr 172.21.15.1:0/912681143 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb25c5a640 1 -- 172.21.15.1:0/912681143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2019bd40 con 0x7fcb20107fc0 2024-09-19T05:11:58.222 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb25c5a640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097f0 tx=0x7fcb1c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c037040 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb1c040070 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2019bfd0 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb1c03a390 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.198+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2019ecc0 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.199+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcb1c03b430 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.199+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb20108420 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.200+0000 7fcb16ffd640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 0x7fcb0c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.200+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb1c06c730 con 0x7fcb20107fc0 2024-09-19T05:11:58.223 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.200+0000 7fcb25459640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 0x7fcb0c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.200+0000 7fcb25459640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 0x7fcb0c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb100098c0 tx=0x7fcb10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.205+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb1c0371e0 con 0x7fcb20107fc0 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.405+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fcb20062630 con 0x7fcb0c039200 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.410+0000 7fcb16ffd640 1 -- 172.21.15.1:0/912681143 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fcb20062630 con 0x7fcb0c039200 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 msgr2=0x7fcb0c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 0x7fcb0c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcb100098c0 tx=0x7fcb10006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 msgr2=0x7fcb2019b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:58.224 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097f0 tx=0x7fcb1c030d80 comp rx=0 tx=0).stop 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 shutdown_connections 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fcb0c039200 0x7fcb0c03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 --2- 172.21.15.1:0/912681143 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb20107fc0 0x7fcb2019b800 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 >> 172.21.15.1:0/912681143 conn(0x7fcb20101b80 msgr2=0x7fcb20102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 shutdown_connections 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:57.412+0000 7fcb27ebe640 1 -- 172.21.15.1:0/912681143 wait complete. 2024-09-19T05:11:58.225 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-19T05:11:58.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:58 smithi001 ceph-mon[30968]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:58.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:58 smithi001 ceph-mon[30968]: Saving service mon spec with placement count:5 2024-09-19T05:11:58.615 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:58 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:11:59.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T05:11:59.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.615+0000 7fe0d311f640 1 Processor -- start 2024-09-19T05:11:59.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.615+0000 7fe0d311f640 1 -- start start 2024-09-19T05:11:59.403 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.615+0000 7fe0d311f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.615+0000 7fe0d311f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc07be00 con 0x7fe0cc107fe0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.616+0000 7fe0d0ebb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.616+0000 7fe0d0ebb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55164/0 (socket says 172.21.15.1:55164) 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.616+0000 7fe0d0ebb640 1 -- 172.21.15.1:0/1035000598 learned_addr learned my addr 172.21.15.1:0/1035000598 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.616+0000 7fe0d0ebb640 1 -- 172.21.15.1:0/1035000598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc10a910 con 0x7fe0cc107fe0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d0ebb640 1 --2- 172.21.15.1:0/1035000598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009820 tx=0x7fe0bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c7230cd0839a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0cb7fe640 1 -- 172.21.15.1:0/1035000598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0bc037070 con 0x7fe0cc107fe0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0cb7fe640 1 -- 172.21.15.1:0/1035000598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0bc032900 con 0x7fe0cc107fe0 2024-09-19T05:11:59.404 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0cb7fe640 1 -- 172.21.15.1:0/1035000598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0bc030850 con 0x7fe0cc107fe0 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 -- 172.21.15.1:0/1035000598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 msgr2=0x7fe0cc10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 --2- 172.21.15.1:0/1035000598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009820 tx=0x7fe0bc02a270 comp rx=0 tx=0).stop 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 -- 172.21.15.1:0/1035000598 shutdown_connections 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 --2- 172.21.15.1:0/1035000598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc10a3d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 -- 172.21.15.1:0/1035000598 >> 172.21.15.1:0/1035000598 conn(0x7fe0cc101b80 msgr2=0x7fe0cc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.617+0000 7fe0d311f640 1 -- 172.21.15.1:0/1035000598 shutdown_connections 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d311f640 1 -- 172.21.15.1:0/1035000598 wait complete. 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d311f640 1 Processor -- start 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d311f640 1 -- start start 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d311f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d311f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc10b950 con 0x7fe0cc107fe0 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.618+0000 7fe0d0ebb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:59.405 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d0ebb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55174/0 (socket says 172.21.15.1:55174) 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d0ebb640 1 -- 172.21.15.1:0/4272981861 learned_addr learned my addr 172.21.15.1:0/4272981861 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d0ebb640 1 -- 172.21.15.1:0/4272981861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc19bd60 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d0ebb640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc032ce0 tx=0x7fe0bc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0bc042070 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0bc0308c0 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc19bff0 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0bc037040 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.619+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc19ece0 con 0x7fe0cc107fe0 2024-09-19T05:11:59.406 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.620+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe0bc045070 con 0x7fe0cc107fe0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.620+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc108440 con 0x7fe0cc107fe0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.621+0000 7fe0c9ffb640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 0x7fe0b403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.621+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe0bc06c350 con 0x7fe0cc107fe0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.621+0000 7fe0cbfff640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 0x7fe0b403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.621+0000 7fe0cbfff640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 0x7fe0b403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00098c0 tx=0x7fe0c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.625+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0bc03cd00 con 0x7fe0cc107fe0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.818+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe0cc062630 con 0x7fe0b40391b0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.823+0000 7fe0c9ffb640 1 -- 172.21.15.1:0/4272981861 <== mgr.14118 v2:172.21.15.1:6800/2966742919 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe0cc062630 con 0x7fe0b40391b0 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 msgr2=0x7fe0b403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 0x7fe0b403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00098c0 tx=0x7fe0c0006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 msgr2=0x7fe0cc19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc032ce0 tx=0x7fe0bc032d10 comp rx=0 tx=0).stop 2024-09-19T05:11:59.407 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 shutdown_connections 2024-09-19T05:11:59.408 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fe0b40391b0 0x7fe0b403b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:59.408 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 --2- 172.21.15.1:0/4272981861 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe0cc107fe0 0x7fe0cc19b820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:59.408 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 >> 172.21.15.1:0/4272981861 conn(0x7fe0cc101b80 msgr2=0x7fe0cc102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:59.408 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 shutdown_connections 2024-09-19T05:11:59.408 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:58.825+0000 7fe0d311f640 1 -- 172.21.15.1:0/4272981861 wait complete. 2024-09-19T05:11:59.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:59 smithi001 ceph-mon[30968]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:59.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:59 smithi001 ceph-mon[30968]: Saving service mgr spec with placement count:2 2024-09-19T05:11:59.987 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:11:59 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:12:01.130 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4149936781' entity='client.admin' 2024-09-19T05:12:01.130 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:00 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:12:01.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.797+0000 7fd18c84f640 1 Processor -- start 2024-09-19T05:12:01.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.797+0000 7fd18c84f640 1 -- start start 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.797+0000 7fd18c84f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.797+0000 7fd18c84f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd188106de0 con 0x7fd188106410 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.798+0000 7fd18659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.798+0000 7fd18659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55186/0 (socket says 172.21.15.1:55186) 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.798+0000 7fd18659c640 1 -- 172.21.15.1:0/1723892424 learned_addr learned my addr 172.21.15.1:0/1723892424 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.798+0000 7fd18659c640 1 -- 172.21.15.1:0/1723892424 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd188107610 con 0x7fd188106410 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.799+0000 7fd18659c640 1 --2- 172.21.15.1:0/1723892424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd178009820 tx=0x7fd17802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578acf2e56260f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.799+0000 7fd18559a640 1 -- 172.21.15.1:0/1723892424 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178037070 con 0x7fd188106410 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.799+0000 7fd18559a640 1 -- 172.21.15.1:0/1723892424 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd178032900 con 0x7fd188106410 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.799+0000 7fd18559a640 1 -- 172.21.15.1:0/1723892424 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178030850 con 0x7fd188106410 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 -- 172.21.15.1:0/1723892424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 msgr2=0x7fd188106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:01.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 --2- 172.21.15.1:0/1723892424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd178009820 tx=0x7fd17802a270 comp rx=0 tx=0).stop 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 -- 172.21.15.1:0/1723892424 shutdown_connections 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 --2- 172.21.15.1:0/1723892424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd188106810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 -- 172.21.15.1:0/1723892424 >> 172.21.15.1:0/1723892424 conn(0x7fd188101b80 msgr2=0x7fd188103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 -- 172.21.15.1:0/1723892424 shutdown_connections 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.800+0000 7fd18c84f640 1 -- 172.21.15.1:0/1723892424 wait complete. 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18c84f640 1 Processor -- start 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18c84f640 1 -- start start 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18c84f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18c84f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd18810a9c0 con 0x7fd188106410 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55202/0 (socket says 172.21.15.1:55202) 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18659c640 1 -- 172.21.15.1:0/4149936781 learned_addr learned my addr 172.21.15.1:0/4149936781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.801+0000 7fd18659c640 1 -- 172.21.15.1:0/4149936781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18819bdc0 con 0x7fd188106410 2024-09-19T05:12:01.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd18659c640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd178009940 tx=0x7fd178032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178042070 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1780308c0 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd178037040 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18819c050 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.802+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18819ed40 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.803+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd178045070 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.803+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18810ab40 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.803+0000 7fd1777fe640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 0x7fd17003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.803+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd17806c540 con 0x7fd188106410 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.803+0000 7fd185d9b640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 0x7fd17003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.804+0000 7fd185d9b640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 0x7fd17003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098c0 tx=0x7fd17c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:01.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.808+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd178045360 con 0x7fd188106410 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.984+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd188106890 con 0x7fd188106410 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.986+0000 7fd1777fe640 1 -- 172.21.15.1:0/4149936781 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fd17803c760 con 0x7fd188106410 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 msgr2=0x7fd17003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 0x7fd17003b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd17c0098c0 tx=0x7fd17c006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 msgr2=0x7fd18819b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd178009940 tx=0x7fd178032ce0 comp rx=0 tx=0).stop 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 shutdown_connections 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fd170039200 0x7fd17003b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 --2- 172.21.15.1:0/4149936781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd188106410 0x7fd18819b880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 >> 172.21.15.1:0/4149936781 conn(0x7fd188101b80 msgr2=0x7fd188102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 shutdown_connections 2024-09-19T05:12:01.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:11:59.989+0000 7fd18c84f640 1 -- 172.21.15.1:0/4149936781 wait complete. 2024-09-19T05:12:02.447 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:02 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:12:02.447 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:02 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1100619376' entity='client.admin' 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.598+0000 7f668a826640 1 Processor -- start 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.598+0000 7f668a826640 1 -- start start 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f668a826640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f668a826640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f668407c7f0 con 0x7f668407de00 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f6683fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f6683fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55204/0 (socket says 172.21.15.1:55204) 2024-09-19T05:12:03.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f6683fff640 1 -- 172.21.15.1:0/320649911 learned_addr learned my addr 172.21.15.1:0/320649911 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.599+0000 7f6683fff640 1 -- 172.21.15.1:0/320649911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668407c970 con 0x7f668407de00 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.600+0000 7f6683fff640 1 --2- 172.21.15.1:0/320649911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6674009820 tx=0x7f667402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409236dcfc57fa11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.600+0000 7f66837fe640 1 -- 172.21.15.1:0/320649911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6674037070 con 0x7f668407de00 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.600+0000 7f66837fe640 1 -- 172.21.15.1:0/320649911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6674032920 con 0x7f668407de00 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.600+0000 7f66837fe640 1 -- 172.21.15.1:0/320649911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6674030890 con 0x7f668407de00 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- 172.21.15.1:0/320649911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 msgr2=0x7f668407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 --2- 172.21.15.1:0/320649911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6674009820 tx=0x7f667402a300 comp rx=0 tx=0).stop 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- 172.21.15.1:0/320649911 shutdown_connections 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 --2- 172.21.15.1:0/320649911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668407c2b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- 172.21.15.1:0/320649911 >> 172.21.15.1:0/320649911 conn(0x7f6684102dc0 msgr2=0x7f66841051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- 172.21.15.1:0/320649911 shutdown_connections 2024-09-19T05:12:03.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- 172.21.15.1:0/320649911 wait complete. 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 Processor -- start 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.601+0000 7f668a826640 1 -- start start 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f668a826640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f668a826640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f668410dc00 con 0x7f668407de00 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6683fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6683fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55220/0 (socket says 172.21.15.1:55220) 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6683fff640 1 -- 172.21.15.1:0/1100619376 learned_addr learned my addr 172.21.15.1:0/1100619376 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6683fff640 1 -- 172.21.15.1:0/1100619376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668419dfe0 con 0x7f668407de00 2024-09-19T05:12:03.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6683fff640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f667402a820 tx=0x7f66740308b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6674037040 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6674040070 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668419e270 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f667403a390 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.602+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66841a0f60 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.603+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6674030b70 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.603+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668407c330 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.604+0000 7f6681ffb640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 0x7f667003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.604+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f667406c4d0 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.604+0000 7f667bfff640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 0x7f667003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.604+0000 7f667bfff640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 0x7f667003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098c0 tx=0x7f666c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.608+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f667403b4e0 con 0x7f668407de00 2024-09-19T05:12:03.051 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.801+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f668402d7c0 con 0x7f668407de00 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.804+0000 7f6681ffb640 1 -- 172.21.15.1:0/1100619376 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f667403b7b0 con 0x7f668407de00 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 msgr2=0x7f667003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 0x7f667003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098c0 tx=0x7f666c006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 msgr2=0x7f668419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f667402a820 tx=0x7f66740308b0 comp rx=0 tx=0).stop 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 shutdown_connections 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f6670039200 0x7f667003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 --2- 172.21.15.1:0/1100619376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f668407de00 0x7f668419daa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 >> 172.21.15.1:0/1100619376 conn(0x7f6684102dc0 msgr2=0x7f6684103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 shutdown_connections 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:01.806+0000 7f668a826640 1 -- 172.21.15.1:0/1100619376 wait complete. 2024-09-19T05:12:03.052 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-19T05:12:03.685 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:03 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:12:05.041 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-mon[30968]: from='mgr.14118 172.21.15.1:0/2120883329' entity='mgr.x' 2024-09-19T05:12:05.041 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2360729011' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T05:12:05.041 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ignoring --setuser ceph since I am not root 2024-09-19T05:12:05.042 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ignoring --setgroup ceph since I am not root 2024-09-19T05:12:05.042 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:04.822+0000 7fec2d430040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:12:05.042 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:04.882+0000 7fec2d430040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:12:05.042 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.039+0000 7fec2d430040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:12:05.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.110+0000 7fec2d430040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:12:05.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.266+0000 7fec2d430040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:12:05.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.445+0000 7f60ce679640 1 Processor -- start 2024-09-19T05:12:05.443 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.445+0000 7f60ce679640 1 -- start start 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.445+0000 7f60ce679640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.445+0000 7f60ce679640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60c807be20 con 0x7f60c8108010 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.446+0000 7f60c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.446+0000 7f60c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55222/0 (socket says 172.21.15.1:55222) 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.446+0000 7f60c7fff640 1 -- 172.21.15.1:0/831644642 learned_addr learned my addr 172.21.15.1:0/831644642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.446+0000 7f60c7fff640 1 -- 172.21.15.1:0/831644642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c810a940 con 0x7f60c8108010 2024-09-19T05:12:05.444 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.447+0000 7f60c7fff640 1 --2- 172.21.15.1:0/831644642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009820 tx=0x7f60b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1978c5cd2a21b1af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.447+0000 7f60c6ffd640 1 -- 172.21.15.1:0/831644642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8037070 con 0x7f60c8108010 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.447+0000 7f60c6ffd640 1 -- 172.21.15.1:0/831644642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b8032920 con 0x7f60c8108010 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.447+0000 7f60c6ffd640 1 -- 172.21.15.1:0/831644642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8030810 con 0x7f60c8108010 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 -- 172.21.15.1:0/831644642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 msgr2=0x7f60c810a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 --2- 172.21.15.1:0/831644642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009820 tx=0x7f60b802a270 comp rx=0 tx=0).stop 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 -- 172.21.15.1:0/831644642 shutdown_connections 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 --2- 172.21.15.1:0/831644642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c810a400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 -- 172.21.15.1:0/831644642 >> 172.21.15.1:0/831644642 conn(0x7f60c8101c30 msgr2=0x7f60c8104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 -- 172.21.15.1:0/831644642 shutdown_connections 2024-09-19T05:12:05.445 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.448+0000 7f60ce679640 1 -- 172.21.15.1:0/831644642 wait complete. 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60ce679640 1 Processor -- start 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60ce679640 1 -- start start 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60ce679640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60ce679640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60c810b9c0 con 0x7f60c8108010 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60c7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55224/0 (socket says 172.21.15.1:55224) 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60c7fff640 1 -- 172.21.15.1:0/2360729011 learned_addr learned my addr 172.21.15.1:0/2360729011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.449+0000 7f60c7fff640 1 -- 172.21.15.1:0/2360729011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c819dd50 con 0x7f60c8108010 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60c7fff640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097f0 tx=0x7f60b80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:05.446 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b8037040 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b8030cc0 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c819dfe0 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b803a6b0 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.450+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a0cd0 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.451+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f60b803a8a0 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.451+0000 7f60c57fa640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 0x7f60b003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.451+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f60b806c810 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.451+0000 7f60c77fe640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 0x7f60b003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.451+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c8108470 con 0x7f60c8108010 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.452+0000 7f60c77fe640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 0x7f60b003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0098c0 tx=0x7f60bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:05.447 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.456+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60b8044920 con 0x7f60c8108010 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:03.683+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f60c81a1080 con 0x7f60c8108010 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.667+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f60b8044400 con 0x7f60c8108010 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.669+0000 7f60c57fa640 1 -- 172.21.15.1:0/2360729011 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f60b802fd00 con 0x7f60c8108010 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 msgr2=0x7f60b003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 0x7f60b003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0098c0 tx=0x7f60bc006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 msgr2=0x7f60c819d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097f0 tx=0x7f60b80327b0 comp rx=0 tx=0).stop 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 shutdown_connections 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f60b00391b0 0x7f60b003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 --2- 172.21.15.1:0/2360729011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60c8108010 0x7f60c819d810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:05.448 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 >> 172.21.15.1:0/2360729011 conn(0x7f60c8101c30 msgr2=0x7f60c8102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:05.449 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 shutdown_connections 2024-09-19T05:12:05.449 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:04.671+0000 7f60ce679640 1 -- 172.21.15.1:0/2360729011 wait complete. 2024-09-19T05:12:05.669 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.414+0000 7fec2d430040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:12:06.030 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2360729011' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T05:12:06.030 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-mon[30968]: mgrmap e9: x(active, since 19s) 2024-09-19T05:12:06.030 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.755+0000 7fec2d430040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:12:06.031 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:05.821+0000 7fec2d430040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:12:06.031 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:06 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:06.028+0000 7fec2d430040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:12:06.590 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:12:06.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T05:12:06.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:12:06.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:12:06.591 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:12:06.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:12:06.592 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.835+0000 7f2f55e90640 1 Processor -- start 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f55e90640 1 -- start start 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f55e90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f55e90640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5007be60 con 0x7f2f50107f80 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54396/0 (socket says 172.21.15.1:54396) 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f4f7fe640 1 -- 172.21.15.1:0/4038349813 learned_addr learned my addr 172.21.15.1:0/4038349813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.836+0000 7f2f4f7fe640 1 -- 172.21.15.1:0/4038349813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5010a8b0 con 0x7f2f50107f80 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.837+0000 7f2f4f7fe640 1 --2- 172.21.15.1:0/4038349813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009820 tx=0x7f2f4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb72734ca0193d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.837+0000 7f2f4e7fc640 1 -- 172.21.15.1:0/4038349813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40037070 con 0x7f2f50107f80 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.837+0000 7f2f4e7fc640 1 -- 172.21.15.1:0/4038349813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40032920 con 0x7f2f50107f80 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.837+0000 7f2f4e7fc640 1 -- 172.21.15.1:0/4038349813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40030810 con 0x7f2f50107f80 2024-09-19T05:12:06.593 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 -- 172.21.15.1:0/4038349813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 msgr2=0x7f2f5010a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 --2- 172.21.15.1:0/4038349813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009820 tx=0x7f2f4002a270 comp rx=0 tx=0).stop 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 -- 172.21.15.1:0/4038349813 shutdown_connections 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 --2- 172.21.15.1:0/4038349813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5010a370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 -- 172.21.15.1:0/4038349813 >> 172.21.15.1:0/4038349813 conn(0x7f2f50101b80 msgr2=0x7f2f50103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 -- 172.21.15.1:0/4038349813 shutdown_connections 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.838+0000 7f2f55e90640 1 -- 172.21.15.1:0/4038349813 wait complete. 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f55e90640 1 Processor -- start 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f55e90640 1 -- start start 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f55e90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f55e90640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5010b990 con 0x7f2f50107f80 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54398/0 (socket says 172.21.15.1:54398) 2024-09-19T05:12:06.594 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.839+0000 7f2f4f7fe640 1 -- 172.21.15.1:0/2741174063 learned_addr learned my addr 172.21.15.1:0/2741174063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f4f7fe640 1 -- 172.21.15.1:0/2741174063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5019dff0 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f4f7fe640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f400097f0 tx=0x7f2f400327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f40037040 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5019e280 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40030cc0 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4003a6b0 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.840+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f501a0f70 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.841+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f2f4003a850 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.841+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f501083e0 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.842+0000 7f2f4cff9640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 0x7f2f3c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.842+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2f4006c8b0 con 0x7f2f50107f80 2024-09-19T05:12:06.595 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.842+0000 7f2f4effd640 1 -- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 msgr2=0x7f2f3c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.842+0000 7f2f4effd640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 0x7f2f3c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:05.846+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f4006c200 con 0x7f2f50107f80 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.043+0000 7f2f4effd640 1 -- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 msgr2=0x7f2f3c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.043+0000 7f2f4effd640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 0x7f2f3c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.082+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2f5002d7c0 con 0x7f2f50107f80 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.082+0000 7f2f4cff9640 1 -- 172.21.15.1:0/2741174063 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f2f4006ecf0 con 0x7f2f50107f80 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 msgr2=0x7f2f3c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 0x7f2f3c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 msgr2=0x7f2f5019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f400097f0 tx=0x7f2f400327b0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 shutdown_connections 2024-09-19T05:12:06.596 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7f2f3c039260 0x7f2f3c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 --2- 172.21.15.1:0/2741174063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f50107f80 0x7f2f5019dab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 >> 172.21.15.1:0/2741174063 conn(0x7f2f50101b80 msgr2=0x7f2f501028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 shutdown_connections 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:06.085+0000 7f2f55e90640 1 -- 172.21.15.1:0/2741174063 wait complete. 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T05:12:06.597 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-19T05:12:06.835 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:06 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2741174063' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:12:07.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:06 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:06.968+0000 7fec2d430040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:12:07.091 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:07.040+0000 7fec2d430040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:12:07.908 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:07.786+0000 7fec2d430040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:12:07.908 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:07.907+0000 7fec2d430040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:12:08.276 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.055+0000 7fec2d430040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:12:08.276 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.119+0000 7fec2d430040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:12:08.276 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.274+0000 7fec2d430040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:12:08.574 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.345+0000 7fec2d430040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:12:08.574 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.408+0000 7fec2d430040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:12:08.574 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.573+0000 7fec2d430040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:12:08.841 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.640+0000 7fec2d430040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:12:08.841 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.709+0000 7fec2d430040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:12:08.841 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.795+0000 7fec2d430040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:12:09.341 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.857+0000 7fec2d430040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:12:09.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:08.919+0000 7fec2d430040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:12:10.006 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:09.744+0000 7fec2d430040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: Active manager daemon x restarted 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: Activating manager daemon x 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: mgrmap e10: x(active, starting, since 0.00324668s) 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: Manager daemon x is now available 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:10.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:12:10.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:12:11.648 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:12:11.648 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T05:12:11.648 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa78ac7c640 1 Processor -- start 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa78ac7c640 1 -- start start 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa78ac7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa78ac7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa78407be60 con 0x7fa784107fb0 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa788a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa788a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54402/0 (socket says 172.21.15.1:54402) 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa788a18640 1 -- 172.21.15.1:0/665174876 learned_addr learned my addr 172.21.15.1:0/665174876 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.042+0000 7fa788a18640 1 -- 172.21.15.1:0/665174876 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78410a8e0 con 0x7fa784107fb0 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.043+0000 7fa788a18640 1 --2- 172.21.15.1:0/665174876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009820 tx=0x7fa76c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8aa0bea05438df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.043+0000 7fa7837fe640 1 -- 172.21.15.1:0/665174876 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76c037070 con 0x7fa784107fb0 2024-09-19T05:12:11.649 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.043+0000 7fa7837fe640 1 -- 172.21.15.1:0/665174876 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa76c032920 con 0x7fa784107fb0 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.043+0000 7fa7837fe640 1 -- 172.21.15.1:0/665174876 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76c030810 con 0x7fa784107fb0 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 -- 172.21.15.1:0/665174876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 msgr2=0x7fa78410a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/665174876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009820 tx=0x7fa76c02a270 comp rx=0 tx=0).stop 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 -- 172.21.15.1:0/665174876 shutdown_connections 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/665174876 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78410a3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 -- 172.21.15.1:0/665174876 >> 172.21.15.1:0/665174876 conn(0x7fa784101b90 msgr2=0x7fa784104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 -- 172.21.15.1:0/665174876 shutdown_connections 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.044+0000 7fa78ac7c640 1 -- 172.21.15.1:0/665174876 wait complete. 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa78ac7c640 1 Processor -- start 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa78ac7c640 1 -- start start 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa78ac7c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa78ac7c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa78410b9c0 con 0x7fa784107fb0 2024-09-19T05:12:11.650 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa788a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa788a18640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54416/0 (socket says 172.21.15.1:54416) 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.045+0000 7fa788a18640 1 -- 172.21.15.1:0/2018566033 learned_addr learned my addr 172.21.15.1:0/2018566033 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa788a18640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78419bd90 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa788a18640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097f0 tx=0x7fa76c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76c037040 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78419c020 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa76c030cc0 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76c03a6b0 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.046+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78419ed10 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fa76c03a8a0 con 0x7fa784107fb0 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa781ffb640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa784108410 con 0x7fa770039200 2024-09-19T05:12:11.651 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa76c06d880 con 0x7fa784107fb0 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa783fff640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 msgr2=0x7fa77003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.047+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.248+0000 7fa783fff640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 msgr2=0x7fa77003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.248+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.649+0000 7fa783fff640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 msgr2=0x7fa77003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:07.649+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:08.450+0000 7fa783fff640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 msgr2=0x7fa77003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/2966742919 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:08.450+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:09.747+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fa76c06c330 con 0x7fa784107fb0 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:09.747+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 msgr2=0x7fa77003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:11.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:09.747+0000 7fa781ffb640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.748+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fa76c044400 con 0x7fa784107fb0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.749+0000 7fa781ffb640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 0x7fa77003eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.749+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa784108410 con 0x7fa77003cad0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.749+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 0x7fa77003eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.750+0000 7fa783fff640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 0x7fa77003eec0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa774003d00 tx=0x7fa774009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.750+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa784108410 con 0x7fa77003cad0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa784075df0 con 0x7fa77003cad0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa781ffb640 1 -- 172.21.15.1:0/2018566033 <== mgr.14150 v2:172.21.15.1:6800/427915191 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fa784075df0 con 0x7fa77003cad0 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 msgr2=0x7fa77003eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:11.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 0x7fa77003eec0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa774003d00 tx=0x7fa774009290 comp rx=0 tx=0).stop 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 msgr2=0x7fa78419b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.758+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0097f0 tx=0x7fa76c0327b0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 shutdown_connections 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa77003cad0 0x7fa77003eec0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:6800/2966742919,v1:172.21.15.1:6801/2966742919] conn(0x7fa770039200 0x7fa77003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 --2- 172.21.15.1:0/2018566033 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa784107fb0 0x7fa78419b850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:11.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 >> 172.21.15.1:0/2018566033 conn(0x7fa784101b90 msgr2=0x7fa784102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:11.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 shutdown_connections 2024-09-19T05:12:11.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:10.759+0000 7fa78ac7c640 1 -- 172.21.15.1:0/2018566033 wait complete. 2024-09-19T05:12:11.655 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-19T05:12:11.655 INFO:teuthology.orchestra.run.smithi001.stdout:Generating a dashboard self-signed certificate... 2024-09-19T05:12:11.912 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:11 smithi001 ceph-mon[30968]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:12:11.912 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:11 smithi001 ceph-mon[30968]: mgrmap e11: x(active, since 1.00593s) 2024-09-19T05:12:11.912 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:11 smithi001 ceph-mon[30968]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:12:11.912 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:12.841 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:12.660+0000 7feb92d39640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:12:12] ENGINE Error in HTTPServer.serve 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: Traceback (most recent call last): 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._connections.run(self.expiration_interval) 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._run(expiration_interval) 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: s = self.context.wrap_socket( 2024-09-19T05:12:12.842 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: return self.sslsocket_class._create( 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self.do_handshake() 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: self._sslobj.do_handshake() 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:12:12.843 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:12:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:12:13.042 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.203+0000 7fadb55b6640 1 Processor -- start 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.203+0000 7fadb55b6640 1 -- start start 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.203+0000 7fadb55b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.203+0000 7fadb55b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadb007bda0 con 0x7fadb0108040 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.204+0000 7fadaeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.204+0000 7fadaeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54478/0 (socket says 172.21.15.1:54478) 2024-09-19T05:12:13.043 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.204+0000 7fadaeffd640 1 -- 172.21.15.1:0/2884879738 learned_addr learned my addr 172.21.15.1:0/2884879738 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.204+0000 7fadaeffd640 1 -- 172.21.15.1:0/2884879738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb010a970 con 0x7fadb0108040 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.205+0000 7fadaeffd640 1 --2- 172.21.15.1:0/2884879738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fada0009820 tx=0x7fada002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f936f39528957a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.205+0000 7fadadffb640 1 -- 172.21.15.1:0/2884879738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fada0037070 con 0x7fadb0108040 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.205+0000 7fadadffb640 1 -- 172.21.15.1:0/2884879738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada0032920 con 0x7fadb0108040 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.205+0000 7fadadffb640 1 -- 172.21.15.1:0/2884879738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fada0030810 con 0x7fadb0108040 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 -- 172.21.15.1:0/2884879738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 msgr2=0x7fadb010a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 --2- 172.21.15.1:0/2884879738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fada0009820 tx=0x7fada002a270 comp rx=0 tx=0).stop 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 -- 172.21.15.1:0/2884879738 shutdown_connections 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 --2- 172.21.15.1:0/2884879738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb010a430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:13.044 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 -- 172.21.15.1:0/2884879738 >> 172.21.15.1:0/2884879738 conn(0x7fadb0101b80 msgr2=0x7fadb0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 -- 172.21.15.1:0/2884879738 shutdown_connections 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.206+0000 7fadb55b6640 1 -- 172.21.15.1:0/2884879738 wait complete. 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadb55b6640 1 Processor -- start 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadb55b6640 1 -- start start 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadb55b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:13.045 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadb55b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadb010b990 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadaeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadaeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54488/0 (socket says 172.21.15.1:54488) 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadaeffd640 1 -- 172.21.15.1:0/3942195628 learned_addr learned my addr 172.21.15.1:0/3942195628 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.207+0000 7fadaeffd640 1 -- 172.21.15.1:0/3942195628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb019bd80 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fadaeffd640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fada0030380 tx=0x7fada0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fada0037040 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada0040070 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb019c010 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fada003a7b0 con 0x7fadb0108040 2024-09-19T05:12:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.208+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb019ed00 con 0x7fadb0108040 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.209+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fada003a9e0 con 0x7fadb0108040 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.209+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb01084a0 con 0x7fadb0108040 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.209+0000 7fad97fff640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 0x7fad9803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.209+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fada006ca10 con 0x7fadb0108040 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.209+0000 7fadae7fc640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 0x7fad9803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.210+0000 7fadae7fc640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 0x7fad9803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fada40098c0 tx=0x7fada4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.214+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fada0044c70 con 0x7fadb0108040 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.396+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fadb0062630 con 0x7fad98039260 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.484+0000 7fad97fff640 1 -- 172.21.15.1:0/3942195628 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fadb0062630 con 0x7fad98039260 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 msgr2=0x7fad9803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 0x7fad9803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fada40098c0 tx=0x7fada4006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 msgr2=0x7fadb019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:13.049 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fada0030380 tx=0x7fada0032670 comp rx=0 tx=0).stop 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 shutdown_connections 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad98039260 0x7fad9803b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 --2- 172.21.15.1:0/3942195628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0108040 0x7fadb019b840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.487+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 >> 172.21.15.1:0/3942195628 conn(0x7fadb0101b80 msgr2=0x7fadb0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.488+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 shutdown_connections 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:12.488+0000 7fadb55b6640 1 -- 172.21.15.1:0/3942195628 wait complete. 2024-09-19T05:12:13.050 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: mgrmap e12: x(active, since 2s) 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: [19/Sep/2024:05:12:12] ENGINE Bus STARTING 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: [19/Sep/2024:05:12:12] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: [19/Sep/2024:05:12:12] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: [19/Sep/2024:05:12:12] ENGINE Bus STARTED 2024-09-19T05:12:13.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:13 smithi001 ceph-mon[30968]: [19/Sep/2024:05:12:12] ENGINE Error in HTTPServer.serve 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:12:13.167 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T05:12:13.168 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:12:13.168 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T05:12:13.168 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:12:13.168 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T05:12:13.168 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$n4qmnyQTtBVGeLxf8bd2G.GC4ymrntxcurExtn62T97os1bo.cA9u", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726722734, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.087+0000 7ff401ae0640 1 Processor -- start 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.087+0000 7ff401ae0640 1 -- start start 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.087+0000 7ff401ae0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.087+0000 7ff401ae0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc07be60 con 0x7ff3fc107f80 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.088+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:15.158 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.088+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59168/0 (socket says 172.21.15.1:59168) 2024-09-19T05:12:15.159 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.088+0000 7ff3fb7fe640 1 -- 172.21.15.1:0/3157223999 learned_addr learned my addr 172.21.15.1:0/3157223999 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:15.159 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.088+0000 7ff3fb7fe640 1 -- 172.21.15.1:0/3157223999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc10a8b0 con 0x7ff3fc107f80 2024-09-19T05:12:15.159 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff3fb7fe640 1 --2- 172.21.15.1:0/3157223999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009820 tx=0x7ff3ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9817eda2388477 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:15.165 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff3fa7fc640 1 -- 172.21.15.1:0/3157223999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec037070 con 0x7ff3fc107f80 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff3fa7fc640 1 -- 172.21.15.1:0/3157223999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3ec032920 con 0x7ff3fc107f80 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff3fa7fc640 1 -- 172.21.15.1:0/3157223999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec030810 con 0x7ff3fc107f80 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff401ae0640 1 -- 172.21.15.1:0/3157223999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 msgr2=0x7ff3fc10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.089+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3157223999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009820 tx=0x7ff3ec02a270 comp rx=0 tx=0).stop 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 -- 172.21.15.1:0/3157223999 shutdown_connections 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3157223999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc10a370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 -- 172.21.15.1:0/3157223999 >> 172.21.15.1:0/3157223999 conn(0x7ff3fc101b80 msgr2=0x7ff3fc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 -- 172.21.15.1:0/3157223999 shutdown_connections 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 -- 172.21.15.1:0/3157223999 wait complete. 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 Processor -- start 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.090+0000 7ff401ae0640 1 -- start start 2024-09-19T05:12:15.166 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff401ae0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff401ae0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc10b990 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59176/0 (socket says 172.21.15.1:59176) 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3fb7fe640 1 -- 172.21.15.1:0/3162501104 learned_addr learned my addr 172.21.15.1:0/3162501104 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3fb7fe640 1 -- 172.21.15.1:0/3162501104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc19bd40 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3fb7fe640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097f0 tx=0x7ff3ec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec037040 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc19bfd0 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3ec030cc0 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.091+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec03a6b0 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.092+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc19ecc0 con 0x7ff3fc107f80 2024-09-19T05:12:15.167 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.092+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff3ec03a8a0 con 0x7ff3fc107f80 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.093+0000 7ff3f8ff9640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 0x7ff3e403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.093+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff3ec06ca90 con 0x7ff3fc107f80 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.093+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc1083e0 con 0x7ff3fc107f80 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.093+0000 7ff3faffd640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 0x7ff3e403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.093+0000 7ff3faffd640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 0x7ff3e403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098c0 tx=0x7ff3f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.098+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3ec02fd40 con 0x7ff3fc107f80 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.293+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff3fc075ef0 con 0x7ff3e4039200 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.542+0000 7ff3f8ff9640 1 -- 172.21.15.1:0/3162501104 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff3fc075ef0 con 0x7ff3e4039200 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 msgr2=0x7ff3e403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 0x7ff3e403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098c0 tx=0x7ff3f0006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 msgr2=0x7ff3fc19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097f0 tx=0x7ff3ec0327b0 comp rx=0 tx=0).stop 2024-09-19T05:12:15.168 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 shutdown_connections 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3e4039200 0x7ff3e403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.544+0000 7ff401ae0640 1 --2- 172.21.15.1:0/3162501104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3fc107f80 0x7ff3fc19b800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.545+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 >> 172.21.15.1:0/3162501104 conn(0x7ff3fc101b80 msgr2=0x7ff3fc102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.545+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 shutdown_connections 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:14.545+0000 7ff401ae0640 1 -- 172.21.15.1:0/3162501104 wait complete. 2024-09-19T05:12:15.169 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-19T05:12:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:15 smithi001 ceph-mon[30968]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:16.260 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.503+0000 7f1219dac640 1 Processor -- start 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.503+0000 7f1219dac640 1 -- start start 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.503+0000 7f1219dac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.503+0000 7f1219dac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f121407c880 con 0x7f121407de50 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.504+0000 7f12137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.504+0000 7f12137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59180/0 (socket says 172.21.15.1:59180) 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.504+0000 7f12137fe640 1 -- 172.21.15.1:0/888776009 learned_addr learned my addr 172.21.15.1:0/888776009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.504+0000 7f12137fe640 1 -- 172.21.15.1:0/888776009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121407ca00 con 0x7f121407de50 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f12137fe640 1 --2- 172.21.15.1:0/888776009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1204009820 tx=0x7f120402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52255ad0dc468e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f12127fc640 1 -- 172.21.15.1:0/888776009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1204037070 con 0x7f121407de50 2024-09-19T05:12:16.261 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f12127fc640 1 -- 172.21.15.1:0/888776009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1204032920 con 0x7f121407de50 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f12127fc640 1 -- 172.21.15.1:0/888776009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1204030810 con 0x7f121407de50 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f1219dac640 1 -- 172.21.15.1:0/888776009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 msgr2=0x7f121407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.505+0000 7f1219dac640 1 --2- 172.21.15.1:0/888776009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1204009820 tx=0x7f120402a270 comp rx=0 tx=0).stop 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 -- 172.21.15.1:0/888776009 shutdown_connections 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 --2- 172.21.15.1:0/888776009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121407c2b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 -- 172.21.15.1:0/888776009 >> 172.21.15.1:0/888776009 conn(0x7f1214102d10 msgr2=0x7f1214105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 -- 172.21.15.1:0/888776009 shutdown_connections 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 -- 172.21.15.1:0/888776009 wait complete. 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 Processor -- start 2024-09-19T05:12:16.262 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.506+0000 7f1219dac640 1 -- start start 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1219dac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1219dac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f121410dc50 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f12137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f12137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59192/0 (socket says 172.21.15.1:59192) 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f12137fe640 1 -- 172.21.15.1:0/3997828888 learned_addr learned my addr 172.21.15.1:0/3997828888 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f12137fe640 1 -- 172.21.15.1:0/3997828888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121419e010 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f12137fe640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1204030420 tx=0x7f1204032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1204037040 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1204040070 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121419e2a0 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120403a6e0 con 0x7f121407de50 2024-09-19T05:12:16.263 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.507+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12141a0f90 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.508+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f120403a9e0 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.508+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121407c330 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.508+0000 7f1210ff9640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 0x7f11fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.509+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f120406ca20 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.509+0000 7f1212ffd640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 0x7f11fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.509+0000 7f1212ffd640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 0x7f11fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12080098c0 tx=0x7f1208006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.513+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1204041270 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.690+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f121402d7c0 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.690+0000 7f1210ff9640 1 -- 172.21.15.1:0/3997828888 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f1204043bf0 con 0x7f121407de50 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 msgr2=0x7f11fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 0x7f11fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f12080098c0 tx=0x7f1208006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 msgr2=0x7f121419dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:16.264 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1204030420 tx=0x7f1204032670 comp rx=0 tx=0).stop 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 shutdown_connections 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11fc039200 0x7f11fc03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 --2- 172.21.15.1:0/3997828888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f121407de50 0x7f121419dad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.692+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 >> 172.21.15.1:0/3997828888 conn(0x7f1214102d10 msgr2=0x7f1214103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.693+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 shutdown_connections 2024-09-19T05:12:16.265 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:15.693+0000 7f1219dac640 1 -- 172.21.15.1:0/3997828888 wait complete. 2024-09-19T05:12:16.269 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:12:16.269 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T05:12:16.276 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:12:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T05:12:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T05:12:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T05:12:16.278 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-19T05:12:16.278 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-19T05:12:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-19T05:12:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: Password: 8b2o32usfc 2024-09-19T05:12:16.279 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:16.279 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config directory 2024-09-19T05:12:16.822 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:16 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3997828888' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T05:12:17.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:17 smithi001 ceph-mon[30968]: mgrmap e13: x(active, since 6s) 2024-09-19T05:12:17.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:17 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1608065730' entity='client.admin' 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.831+0000 7fc70c2bc640 1 Processor -- start 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70c2bc640 1 -- start start 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70c2bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70c2bc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc70407c7d0 con 0x7fc70407dde0 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70a058640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70a058640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59204/0 (socket says 172.21.15.1:59204) 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70a058640 1 -- 172.21.15.1:0/2988440889 learned_addr learned my addr 172.21.15.1:0/2988440889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:17.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.832+0000 7fc70a058640 1 -- 172.21.15.1:0/2988440889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70407c950 con 0x7fc70407dde0 2024-09-19T05:12:17.680 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.833+0000 7fc70a058640 1 --2- 172.21.15.1:0/2988440889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc700009820 tx=0x7fc70002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f284175032207805 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:17.680 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.833+0000 7fc709056640 1 -- 172.21.15.1:0/2988440889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700037070 con 0x7fc70407dde0 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.833+0000 7fc709056640 1 -- 172.21.15.1:0/2988440889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc700032920 con 0x7fc70407dde0 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.833+0000 7fc709056640 1 -- 172.21.15.1:0/2988440889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700030810 con 0x7fc70407dde0 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 -- 172.21.15.1:0/2988440889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 msgr2=0x7fc70407c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/2988440889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc700009820 tx=0x7fc70002a270 comp rx=0 tx=0).stop 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 -- 172.21.15.1:0/2988440889 shutdown_connections 2024-09-19T05:12:17.684 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/2988440889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70407c290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 -- 172.21.15.1:0/2988440889 >> 172.21.15.1:0/2988440889 conn(0x7fc704102dc0 msgr2=0x7fc7041051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 -- 172.21.15.1:0/2988440889 shutdown_connections 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.834+0000 7fc70c2bc640 1 -- 172.21.15.1:0/2988440889 wait complete. 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70c2bc640 1 Processor -- start 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70c2bc640 1 -- start start 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70c2bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70c2bc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc70410dc20 con 0x7fc70407dde0 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70a058640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70a058640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59210/0 (socket says 172.21.15.1:59210) 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70a058640 1 -- 172.21.15.1:0/1608065730 learned_addr learned my addr 172.21.15.1:0/1608065730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.835+0000 7fc70a058640 1 -- 172.21.15.1:0/1608065730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70419e000 con 0x7fc70407dde0 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc70a058640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc700030380 tx=0x7fc700032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:17.685 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700037040 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc700040070 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70419e290 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc70003a7b0 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.836+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7041a0f80 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.837+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc70003aa30 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.837+0000 7fc6fb7fe640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 0x7fc6f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.837+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70407c310 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.837+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc70006cb40 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.837+0000 7fc709857640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 0x7fc6f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.838+0000 7fc709857640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 0x7fc6f003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40098c0 tx=0x7fc6f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:16.842+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc7000313a0 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.112+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc70402d7c0 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.114+0000 7fc6fb7fe640 1 -- 172.21.15.1:0/1608065730 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fc70004a200 con 0x7fc70407dde0 2024-09-19T05:12:17.686 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 msgr2=0x7fc6f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 0x7fc6f003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40098c0 tx=0x7fc6f4006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 msgr2=0x7fc70419dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc700030380 tx=0x7fc700032670 comp rx=0 tx=0).stop 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 shutdown_connections 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6f00392a0 0x7fc6f003b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 --2- 172.21.15.1:0/1608065730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc70407dde0 0x7fc70419dac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.116+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 >> 172.21.15.1:0/1608065730 conn(0x7fc704102dc0 msgr2=0x7fc704103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.117+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 shutdown_connections 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T05:12:17.117+0000 7fc70c2bc640 1 -- 172.21.15.1:0/1608065730 wait complete. 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.687 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T05:12:17.688 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:17.689 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-19T05:12:17.725 INFO:tasks.cephadm:Fetching config... 2024-09-19T05:12:17.726 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:12:17.726 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T05:12:17.744 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T05:12:17.744 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:12:17.744 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T05:12:17.800 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T05:12:17.800 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:12:17.800 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T05:12:17.866 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T05:12:17.866 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:12:17.866 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T05:12:17.925 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T05:12:17.925 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:12:18.022 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:18.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:12:18.073 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:18.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:12:18.129 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDxNaZxWTrMljaSbVw+f7Do49KVgo0MQF7imQqpQqDz0yVF3nprK/rO8iPFYgjmo+iIwSNreyF6KQ17AFEsljdD+oChgcp6KOYuEJuLEpu1e21W99qu/2l23VYUWQjUHR6VlAdAsr2uOMIWA52sc+1YbCTnq7B9t6UpYriBeTGOx5Y32qZYsTp/DYu7wNJX1fWao5gddvYe59xI3hptlQjDyjqZ9WuENGgcW+VKj9fPLhnVenUoF8anFxOhUEJJRsIlPZMSFQmbugs/u1erxGrRsjeWiRBR2WLhWU6lJ5VPX7wnoGkhAlYs5KPpXjOrV3avSM8Vi8phOR4AAV1TMGL01fD0nSDnYM+l+yp2Jc5hbPeEa8nxydQHJIozgkiAS4LsWWiqSU50CGqvzW8n4/j/ucpAq0/Gi/zMyQdJTZHMF9VcYFzOoOFwEswbDRRKkbMvhEUNfDP0AXE5tcpZxPJ0ukiq3vc0DIwBZHnDcgslV2TkZ3rcmAgeeELBORKoV50= ceph-7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:18.142 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T05:12:18.400 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 -- 172.21.15.1:0/4019669700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 msgr2=0x7fa760100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 --2- 172.21.15.1:0/4019669700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa760100900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009880 tx=0x7fa75c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 -- 172.21.15.1:0/4019669700 shutdown_connections 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 --2- 172.21.15.1:0/4019669700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa760100900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 -- 172.21.15.1:0/4019669700 >> 172.21.15.1:0/4019669700 conn(0x7fa7600fbc90 msgr2=0x7fa7600fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 -- 172.21.15.1:0/4019669700 shutdown_connections 2024-09-19T05:12:18.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.901+0000 7fa7687d6640 1 -- 172.21.15.1:0/4019669700 wait complete. 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa7687d6640 1 Processor -- start 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa7687d6640 1 -- start start 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa7687d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa7687d6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa760106610 con 0x7fa760100500 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa766572640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa766572640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59236/0 (socket says 172.21.15.1:59236) 2024-09-19T05:12:18.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa766572640 1 -- 172.21.15.1:0/3262664591 learned_addr learned my addr 172.21.15.1:0/3262664591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa766572640 1 -- 172.21.15.1:0/3262664591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa760199ad0 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.902+0000 7fa766572640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa75c004f60 tx=0x7fa75c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75c03f070 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa75c004d40 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa760199ca0 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa75c035030 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76019a040 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.903+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa75c042070 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.904+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa760106d90 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.904+0000 7fa7577fe640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 0x7fa74c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.904+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa75c06cfa0 con 0x7fa760100500 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.904+0000 7fa765d71640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 0x7fa74c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:18.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.904+0000 7fa765d71640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 0x7fa74c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7500098c0 tx=0x7fa750006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:18.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:18.908+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa75c04a260 con 0x7fa760100500 2024-09-19T05:12:19.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.084+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa76018f3d0 con 0x7fa760100500 2024-09-19T05:12:19.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.087+0000 7fa7577fe640 1 -- 172.21.15.1:0/3262664591 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fa75c003e10 con 0x7fa760100500 2024-09-19T05:12:19.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 msgr2=0x7fa74c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 0x7fa74c03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa7500098c0 tx=0x7fa750006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 msgr2=0x7fa76006a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa75c004f60 tx=0x7fa75c0048f0 comp rx=0 tx=0).stop 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 shutdown_connections 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa74c039300 0x7fa74c03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:19.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 --2- 172.21.15.1:0/3262664591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa760100500 0x7fa76006a950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:19.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.090+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 >> 172.21.15.1:0/3262664591 conn(0x7fa7600fbc90 msgr2=0x7fa7600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:19.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.091+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 shutdown_connections 2024-09-19T05:12:19.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:19.091+0000 7fa7687d6640 1 -- 172.21.15.1:0/3262664591 wait complete. 2024-09-19T05:12:20.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:20 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3262664591' entity='client.admin' 2024-09-19T05:12:20.152 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T05:12:20.153 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T05:12:20.625 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.149+0000 7ff89efb4640 1 -- 172.21.15.1:0/3980732543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 msgr2=0x7ff898100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.149+0000 7ff89efb4640 1 --2- 172.21.15.1:0/3980732543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898100940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009880 tx=0x7ff88c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 -- 172.21.15.1:0/3980732543 shutdown_connections 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 --2- 172.21.15.1:0/3980732543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898100940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 -- 172.21.15.1:0/3980732543 >> 172.21.15.1:0/3980732543 conn(0x7ff8980fbcd0 msgr2=0x7ff8980fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:21.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 -- 172.21.15.1:0/3980732543 shutdown_connections 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 -- 172.21.15.1:0/3980732543 wait complete. 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 Processor -- start 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.150+0000 7ff89efb4640 1 -- start start 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89efb4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89efb4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8981065f0 con 0x7ff898100540 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89cd50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89cd50640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59254/0 (socket says 172.21.15.1:59254) 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89cd50640 1 -- 172.21.15.1:0/889295362 learned_addr learned my addr 172.21.15.1:0/889295362 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89cd50640 1 -- 172.21.15.1:0/889295362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981972f0 con 0x7ff898100540 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89cd50640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff88c004f60 tx=0x7ff88c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88c03f070 con 0x7ff898100540 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff88c004d40 con 0x7ff898100540 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff898197580 con 0x7ff898100540 2024-09-19T05:12:21.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.151+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88c035030 con 0x7ff898100540 2024-09-19T05:12:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.152+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89819a230 con 0x7ff898100540 2024-09-19T05:12:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.153+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff88c042070 con 0x7ff898100540 2024-09-19T05:12:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.153+0000 7ff895ffb640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 0x7ff88803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:21.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.153+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898106d70 con 0x7ff898100540 2024-09-19T05:12:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.153+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff88c003ae0 con 0x7ff898100540 2024-09-19T05:12:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.153+0000 7ff897fff640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 0x7ff88803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:21.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.154+0000 7ff897fff640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 0x7ff88803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098c0 tx=0x7ff884006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:21.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.158+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff88c039350 con 0x7ff898100540 2024-09-19T05:12:21.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.342+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7ff89802d940 con 0x7ff888039300 2024-09-19T05:12:21.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.345+0000 7ff895ffb640 1 -- 172.21.15.1:0/889295362 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff89802d940 con 0x7ff888039300 2024-09-19T05:12:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 msgr2=0x7ff88803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:21.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 0x7ff88803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098c0 tx=0x7ff884006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 msgr2=0x7ff898196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff88c004f60 tx=0x7ff88c0048f0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 shutdown_connections 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff888039300 0x7ff88803b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 --2- 172.21.15.1:0/889295362 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff898100540 0x7ff898196db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 >> 172.21.15.1:0/889295362 conn(0x7ff8980fbcd0 msgr2=0x7ff898069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 shutdown_connections 2024-09-19T05:12:21.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:21.347+0000 7ff89efb4640 1 -- 172.21.15.1:0/889295362 wait complete. 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:22.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:22.554 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2024-09-19T05:12:22.554 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:12:22.554 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:12:22.574 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:12:22.574 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:22.633 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2024-09-19T05:12:22.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch host add smithi060 2024-09-19T05:12:22.888 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:23.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.300+0000 7fa5b06b7640 1 -- 172.21.15.1:0/1054753035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 msgr2=0x7fa5a8102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:23.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.300+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/1054753035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8102bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009880 tx=0x7fa5a402a670 comp rx=0 tx=0).stop 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.300+0000 7fa5b06b7640 1 -- 172.21.15.1:0/1054753035 shutdown_connections 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.300+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/1054753035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8102bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.300+0000 7fa5b06b7640 1 -- 172.21.15.1:0/1054753035 >> 172.21.15.1:0/1054753035 conn(0x7fa5a80fc1b0 msgr2=0x7fa5a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 -- 172.21.15.1:0/1054753035 shutdown_connections 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 -- 172.21.15.1:0/1054753035 wait complete. 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 Processor -- start 2024-09-19T05:12:23.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 -- start start 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.301+0000 7fa5b06b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a810bcb0 con 0x7fa5a8102810 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5ae453640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5ae453640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59268/0 (socket says 172.21.15.1:59268) 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5ae453640 1 -- 172.21.15.1:0/2724919779 learned_addr learned my addr 172.21.15.1:0/2724919779 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:23.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5ae453640 1 -- 172.21.15.1:0/2724919779 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a8102360 con 0x7fa5a8102810 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5ae453640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009230 tx=0x7fa5a4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5a403f070 con 0x7fa5a8102810 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a81009b0 con 0x7fa5a8102810 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5a403bc80 con 0x7fa5a8102810 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5a4035030 con 0x7fa5a8102810 2024-09-19T05:12:23.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.302+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a8100e70 con 0x7fa5a8102810 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.303+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa5a4042070 con 0x7fa5a8102810 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.303+0000 7fa59f7fe640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 0x7fa59403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.303+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a806a6f0 con 0x7fa5a8102810 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.304+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa5a406ccf0 con 0x7fa5a8102810 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.304+0000 7fa5adc52640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 0x7fa59403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:23.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.304+0000 7fa5adc52640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 0x7fa59403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098c0 tx=0x7fa598006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:23.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.308+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5a40314c0 con 0x7fa5a8102810 2024-09-19T05:12:23.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:23.486+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}) -- 0x7fa5a81019a0 con 0x7fa5940392a0 2024-09-19T05:12:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T05:12:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: Updating smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:12:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: Updating smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:25.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:24 smithi001 ceph-mon[30968]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:25 smithi001 ceph-mon[30968]: Deploying cephadm binary to smithi060 2024-09-19T05:12:27.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.491+0000 7fa59f7fe640 1 -- 172.21.15.1:0/2724919779 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa5a81019a0 con 0x7fa5940392a0 2024-09-19T05:12:27.493 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi060' with addr '172.21.15.60' 2024-09-19T05:12:27.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 msgr2=0x7fa59403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:27.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 0x7fa59403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098c0 tx=0x7fa598006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 msgr2=0x7fa5a8100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009230 tx=0x7fa5a4003d40 comp rx=0 tx=0).stop 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 shutdown_connections 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5940392a0 0x7fa59403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 --2- 172.21.15.1:0/2724919779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a8102810 0x7fa5a8100470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.493+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 >> 172.21.15.1:0/2724919779 conn(0x7fa5a80fc1b0 msgr2=0x7fa5a81055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.494+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 shutdown_connections 2024-09-19T05:12:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:27.494+0000 7fa5b06b7640 1 -- 172.21.15.1:0/2724919779 wait complete. 2024-09-19T05:12:28.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:12:28.354 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:28 smithi001 ceph-mon[30968]: Added host smithi060 2024-09-19T05:12:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:28.594 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 -- 172.21.15.1:0/3843036452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 msgr2=0x7f6f9c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/3843036452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009880 tx=0x7f6f9802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 -- 172.21.15.1:0/3843036452 shutdown_connections 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/3843036452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 -- 172.21.15.1:0/3843036452 >> 172.21.15.1:0/3843036452 conn(0x7f6f9c0fc1b0 msgr2=0x7f6f9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 -- 172.21.15.1:0/3843036452 shutdown_connections 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.790+0000 7f6fa44a1640 1 -- 172.21.15.1:0/3843036452 wait complete. 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa44a1640 1 Processor -- start 2024-09-19T05:12:28.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa44a1640 1 -- start start 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa44a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa44a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c10ab90 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa223d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa223d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32780/0 (socket says 172.21.15.1:32780) 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa223d640 1 -- 172.21.15.1:0/973783942 learned_addr learned my addr 172.21.15.1:0/973783942 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa223d640 1 -- 172.21.15.1:0/973783942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c199830 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.791+0000 7f6fa223d640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009230 tx=0x7f6f98003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.792+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f9803f070 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.792+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9803bd40 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.792+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c199ac0 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.792+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f98035030 con 0x7f6f9c106560 2024-09-19T05:12:28.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.792+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c19dbc0 con 0x7f6f9c106560 2024-09-19T05:12:28.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6f98042070 con 0x7f6f9c106560 2024-09-19T05:12:28.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6f937fe640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 0x7f6f8803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:28.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6f9806cef0 con 0x7f6f9c106560 2024-09-19T05:12:28.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c101bd0 con 0x7f6f9c106560 2024-09-19T05:12:28.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6fa1a3c640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 0x7f6f8803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:28.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.793+0000 7f6fa1a3c640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 0x7f6f8803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0098c0 tx=0x7f6f8c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:28.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.798+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f98031d90 con 0x7f6f9c106560 2024-09-19T05:12:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.994+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f9c1069c0 con 0x7f6f88039300 2024-09-19T05:12:28.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.995+0000 7f6f937fe640 1 -- 172.21.15.1:0/973783942 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f6f9c1069c0 con 0x7f6f88039300 2024-09-19T05:12:28.998 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:28.998 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}] 2024-09-19T05:12:28.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 msgr2=0x7f6f8803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:28.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 0x7f6f8803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0098c0 tx=0x7f6f8c006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:28.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 msgr2=0x7f6f9c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:28.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009230 tx=0x7f6f98003d80 comp rx=0 tx=0).stop 2024-09-19T05:12:28.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 shutdown_connections 2024-09-19T05:12:29.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6f88039300 0x7f6f8803b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:29.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 --2- 172.21.15.1:0/973783942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f9c106560 0x7f6f9c1992f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:29.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 >> 172.21.15.1:0/973783942 conn(0x7f6f9c0fc1b0 msgr2=0x7f6f9c1908b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:29.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 shutdown_connections 2024-09-19T05:12:29.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:28.998+0000 7f6fa44a1640 1 -- 172.21.15.1:0/973783942 wait complete. 2024-09-19T05:12:29.567 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2024-09-19T05:12:29.568 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:12:29.568 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:12:29.584 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:12:29.585 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:29.639 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2024-09-19T05:12:29.639 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch host add smithi082 2024-09-19T05:12:29.898 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:30.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:30.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:29 smithi001 ceph-mon[30968]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 -- 172.21.15.1:0/323522238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 msgr2=0x7f631c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 --2- 172.21.15.1:0/323522238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6318009880 tx=0x7f631802a670 comp rx=0 tx=0).stop 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 -- 172.21.15.1:0/323522238 shutdown_connections 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 --2- 172.21.15.1:0/323522238 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 -- 172.21.15.1:0/323522238 >> 172.21.15.1:0/323522238 conn(0x7f631c0fc1b0 msgr2=0x7f631c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 -- 172.21.15.1:0/323522238 shutdown_connections 2024-09-19T05:12:30.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.364+0000 7f63239eb640 1 -- 172.21.15.1:0/323522238 wait complete. 2024-09-19T05:12:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f63239eb640 1 Processor -- start 2024-09-19T05:12:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f63239eb640 1 -- start start 2024-09-19T05:12:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f63239eb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:30.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f63239eb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f631c10bcc0 con 0x7f631c102750 2024-09-19T05:12:30.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f6321787640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:30.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f6321787640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32796/0 (socket says 172.21.15.1:32796) 2024-09-19T05:12:30.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f6321787640 1 -- 172.21.15.1:0/2797685247 learned_addr learned my addr 172.21.15.1:0/2797685247 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.365+0000 7f6321787640 1 -- 172.21.15.1:0/2797685247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c197710 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f6321787640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6318009230 tx=0x7f6318003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631803f070 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631c1979a0 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f631803bc80 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6318035030 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.366+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631c197e00 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6318042070 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631c06a7b0 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f63127fc640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 0x7f630803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f631806cfd0 con 0x7f631c102750 2024-09-19T05:12:30.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f6320f86640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 0x7f630803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:30.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.367+0000 7f6320f86640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 0x7f630803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f630c0098c0 tx=0x7f630c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:30.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.372+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63180372d0 con 0x7f631c102750 2024-09-19T05:12:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:30.553+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) -- 0x7f631c198530 con 0x7f63080392a0 2024-09-19T05:12:31.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:30 smithi001 ceph-mon[30968]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:31.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:30 smithi001 ceph-mon[30968]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:33.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:33.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:33.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-19T05:12:33.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:33.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:33 smithi001 ceph-mon[30968]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:33 smithi001 ceph-mon[30968]: Updating smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:12:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:33 smithi001 ceph-mon[30968]: Deploying cephadm binary to smithi082 2024-09-19T05:12:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:33 smithi001 ceph-mon[30968]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:34.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:33 smithi001 ceph-mon[30968]: Updating smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:12:34.633 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi082' with addr '172.21.15.82' 2024-09-19T05:12:34.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.631+0000 7f63127fc640 1 -- 172.21.15.1:0/2797685247 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f631c198530 con 0x7f63080392a0 2024-09-19T05:12:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 msgr2=0x7f630803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 0x7f630803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f630c0098c0 tx=0x7f630c006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 msgr2=0x7f631c1971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6318009230 tx=0x7f6318003d40 comp rx=0 tx=0).stop 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 shutdown_connections 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f63080392a0 0x7f630803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 --2- 172.21.15.1:0/2797685247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f631c102750 0x7f631c1971d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 >> 172.21.15.1:0/2797685247 conn(0x7f631c0fc1b0 msgr2=0x7f631c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 shutdown_connections 2024-09-19T05:12:34.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:34.634+0000 7f63239eb640 1 -- 172.21.15.1:0/2797685247 wait complete. 2024-09-19T05:12:35.281 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:12:35.532 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:35.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:35.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:35.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: Added host smithi082 2024-09-19T05:12:35.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:35.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:35.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- 172.21.15.1:0/1465618085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 msgr2=0x7faee0100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 --2- 172.21.15.1:0/1465618085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee0100250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faedc00a990 tx=0x7faedc02b910 comp rx=0 tx=0).stop 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- 172.21.15.1:0/1465618085 shutdown_connections 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 --2- 172.21.15.1:0/1465618085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee0100250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- 172.21.15.1:0/1465618085 >> 172.21.15.1:0/1465618085 conn(0x7faee00fb930 msgr2=0x7faee00fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:35.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- 172.21.15.1:0/1465618085 shutdown_connections 2024-09-19T05:12:35.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- 172.21.15.1:0/1465618085 wait complete. 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 Processor -- start 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.961+0000 7faee8258640 1 -- start start 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee8258640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee8258640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faee0109a40 con 0x7faee00ffe70 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee5ff4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee5ff4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49202/0 (socket says 172.21.15.1:49202) 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee5ff4640 1 -- 172.21.15.1:0/1236279011 learned_addr learned my addr 172.21.15.1:0/1236279011 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:35.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee5ff4640 1 -- 172.21.15.1:0/1236279011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01976e0 con 0x7faee00ffe70 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee5ff4640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faedc00a340 tx=0x7faedc031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faedc004d10 con 0x7faee00ffe70 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee0197970 con 0x7faee00ffe70 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faedc005000 con 0x7faee00ffe70 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faedc0038a0 con 0x7faee00ffe70 2024-09-19T05:12:35.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.962+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee019ba70 con 0x7faee00ffe70 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.963+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7faedc039040 con 0x7faee00ffe70 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.963+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee0101350 con 0x7faee00ffe70 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.964+0000 7faed6ffd640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 0x7faecc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.964+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faedc037020 con 0x7faee00ffe70 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.964+0000 7faee57f3640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 0x7faecc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:35.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.964+0000 7faee57f3640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 0x7faecc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faed00098c0 tx=0x7faed0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:35.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:35.968+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faedc040030 con 0x7faee00ffe70 2024-09-19T05:12:36.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.161+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faee0100250 con 0x7faecc039300 2024-09-19T05:12:36.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.162+0000 7faed6ffd640 1 -- 172.21.15.1:0/1236279011 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7faee0100250 con 0x7faecc039300 2024-09-19T05:12:36.163 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:12:36.163 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2024-09-19T05:12:36.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 msgr2=0x7faecc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:36.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 0x7faecc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faed00098c0 tx=0x7faed0006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:36.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 msgr2=0x7faee01971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faedc00a340 tx=0x7faedc031ec0 comp rx=0 tx=0).stop 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 shutdown_connections 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faecc039300 0x7faecc03b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 --2- 172.21.15.1:0/1236279011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faee00ffe70 0x7faee01971a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 >> 172.21.15.1:0/1236279011 conn(0x7faee00fb930 msgr2=0x7faee018eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 shutdown_connections 2024-09-19T05:12:36.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:36.164+0000 7faee8258640 1 -- 172.21.15.1:0/1236279011 wait complete. 2024-09-19T05:12:36.686 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T05:12:36.686 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T05:12:36.937 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:37.284 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:36 smithi001 ceph-mon[30968]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:37.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:37.285 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:36 smithi001 ceph-mon[30968]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:12:37.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 -- 172.21.15.1:0/878019783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 msgr2=0x7f94501006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:37.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 --2- 172.21.15.1:0/878019783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f94501006c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f944c009880 tx=0x7f944c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:37.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 -- 172.21.15.1:0/878019783 shutdown_connections 2024-09-19T05:12:37.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 --2- 172.21.15.1:0/878019783 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f94501006c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:37.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 -- 172.21.15.1:0/878019783 >> 172.21.15.1:0/878019783 conn(0x7f94500fc1b0 msgr2=0x7f94500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 -- 172.21.15.1:0/878019783 shutdown_connections 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.366+0000 7f9458385640 1 -- 172.21.15.1:0/878019783 wait complete. 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9458385640 1 Processor -- start 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9458385640 1 -- start start 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9458385640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9458385640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f945010dea0 con 0x7f94501002e0 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9456121640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9456121640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49214/0 (socket says 172.21.15.1:49214) 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9456121640 1 -- 172.21.15.1:0/3111389517 learned_addr learned my addr 172.21.15.1:0/3111389517 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.367+0000 7f9456121640 1 -- 172.21.15.1:0/3111389517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94501998b0 con 0x7f94501002e0 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f9456121640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f944c009230 tx=0x7f944c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f944c03f070 con 0x7f94501002e0 2024-09-19T05:12:37.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c03bc80 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9450199b40 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f944c035030 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.368+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9450199fa0 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.369+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f944c042070 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.369+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945006a7b0 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.369+0000 7f94477fe640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 0x7f943c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.369+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f944c06cc70 con 0x7f94501002e0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.369+0000 7f9455920640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 0x7f943c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.370+0000 7f9455920640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 0x7f943c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94400098c0 tx=0x7f9440006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:37.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.374+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f944c042360 con 0x7f94501002e0 2024-09-19T05:12:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.556+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f945019a730 con 0x7f94501002e0 2024-09-19T05:12:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.977+0000 7f94477fe640 1 -- 172.21.15.1:0/3111389517 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f944c031e20 con 0x7f94501002e0 2024-09-19T05:12:37.979 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 msgr2=0x7f943c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 0x7f943c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94400098c0 tx=0x7f9440006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 msgr2=0x7f9450199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f944c009230 tx=0x7f944c003d40 comp rx=0 tx=0).stop 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 shutdown_connections 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f943c0392a0 0x7f943c03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 --2- 172.21.15.1:0/3111389517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94501002e0 0x7f9450199370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 >> 172.21.15.1:0/3111389517 conn(0x7f94500fc1b0 msgr2=0x7f94500fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:37.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 shutdown_connections 2024-09-19T05:12:37.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:12:37.980+0000 7f9458385640 1 -- 172.21.15.1:0/3111389517 wait complete. 2024-09-19T05:12:38.279 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:37 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3111389517' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:12:38.530 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-19T05:12:38.530 INFO:tasks.cephadm:Adding mon.b on smithi060 2024-09-19T05:12:38.530 INFO:tasks.cephadm:Adding mon.c on smithi082 2024-09-19T05:12:38.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c' 2024-09-19T05:12:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:12:38.866 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:12:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3111389517' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:12:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:39.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:39.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:39.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:39.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:39.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.325+0000 7f2641b9b640 1 -- 172.21.15.82:0/1187686763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 msgr2=0x7f263c1044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.325+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1187686763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c1044f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f262c009880 tx=0x7f262c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 -- 172.21.15.82:0/1187686763 shutdown_connections 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1187686763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c1044f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 -- 172.21.15.82:0/1187686763 >> 172.21.15.82:0/1187686763 conn(0x7f263c0fbc80 msgr2=0x7f263c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 -- 172.21.15.82:0/1187686763 shutdown_connections 2024-09-19T05:12:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 -- 172.21.15.82:0/1187686763 wait complete. 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.326+0000 7f2641b9b640 1 Processor -- start 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f2641b9b640 1 -- start start 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f2641b9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f2641b9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f263c107710 con 0x7f263c102100 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.82:51764/0 (socket says 172.21.15.82:51764) 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f263b7fe640 1 -- 172.21.15.82:0/1433097122 learned_addr learned my addr 172.21.15.82:0/1433097122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.327+0000 7f263b7fe640 1 -- 172.21.15.82:0/1433097122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c101ec0 con 0x7f263c102100 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f263b7fe640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f262c004f60 tx=0x7f262c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c03f070 con 0x7f263c102100 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c003ad0 con 0x7f263c102100 2024-09-19T05:12:39.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f262c035030 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c1000b0 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.328+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1005f0 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.329+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f262c042070 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.329+0000 7f2638ff9640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 0x7f262403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.329+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f262c06d170 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.329+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c107e90 con 0x7f263c102100 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.329+0000 7f263affd640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 0x7f262403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.330+0000 7f263affd640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 0x7f262403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26300098c0 tx=0x7f2630006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.334+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f262c039350 con 0x7f263c102100 2024-09-19T05:12:39.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.522+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c", "target": ["mon-mgr", ""]}) -- 0x7f263c190090 con 0x7f2624039300 2024-09-19T05:12:39.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.527+0000 7f2638ff9640 1 -- 172.21.15.82:0/1433097122 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f263c190090 con 0x7f2624039300 2024-09-19T05:12:39.530 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mon update... 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 msgr2=0x7f262403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 0x7f262403b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f26300098c0 tx=0x7f2630006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 msgr2=0x7f263c101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f262c004f60 tx=0x7f262c0048f0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 shutdown_connections 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2624039300 0x7f262403b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 --2- 172.21.15.82:0/1433097122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f263c102100 0x7f263c101980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 >> 172.21.15.82:0/1433097122 conn(0x7f263c0fbc80 msgr2=0x7f263c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:39.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 shutdown_connections 2024-09-19T05:12:39.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:39.529+0000 7f2641b9b640 1 -- 172.21.15.82:0/1433097122 wait complete. 2024-09-19T05:12:40.118 DEBUG:teuthology.orchestra.run.smithi060:mon.b> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T05:12:40.121 DEBUG:teuthology.orchestra.run.smithi082:mon.c> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T05:12:40.124 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:12:40.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:12:40.836 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c;count:3 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:40.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:40.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:12:40.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:40.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:40 smithi001 ceph-mon[30968]: Deploying daemon mon.c on smithi082 2024-09-19T05:12:41.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 -- 172.21.15.82:0/2668732894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 msgr2=0x7f4418106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 --2- 172.21.15.82:0/2668732894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4408009880 tx=0x7f440802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 -- 172.21.15.82:0/2668732894 shutdown_connections 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 --2- 172.21.15.82:0/2668732894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 -- 172.21.15.82:0/2668732894 >> 172.21.15.82:0/2668732894 conn(0x7f44180fc1b0 msgr2=0x7f44180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 -- 172.21.15.82:0/2668732894 shutdown_connections 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.223+0000 7f441dc49640 1 -- 172.21.15.82:0/2668732894 wait complete. 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.224+0000 7f441dc49640 1 Processor -- start 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.224+0000 7f441dc49640 1 -- start start 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f441dc49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:41.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f441dc49640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f441810ab90 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f44177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f44177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.82:51788/0 (socket says 172.21.15.82:51788) 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f44177fe640 1 -- 172.21.15.82:0/4057184219 learned_addr learned my addr 172.21.15.82:0/4057184219 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.225+0000 7f44177fe640 1 -- 172.21.15.82:0/4057184219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4418198500 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f44177fe640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4408009230 tx=0x7f4408003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f440803f070 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4418198790 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f440803bc80 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4408035030 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.226+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4418198bf0 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.227+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f4408042070 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.227+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4418101bd0 con 0x7f4418106560 2024-09-19T05:12:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.227+0000 7f44157fa640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 0x7f440403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:41.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.227+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f440806d0b0 con 0x7f4418106560 2024-09-19T05:12:41.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.227+0000 7f440effd640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 0x7f440403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:41.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.228+0000 7f440effd640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 0x7f440403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f44000098c0 tx=0x7f4400006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:41.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.232+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4408031e20 con 0x7f4418106560 2024-09-19T05:12:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.468+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f44181069c0 con 0x7f4418106560 2024-09-19T05:12:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.469+0000 7f44157fa640 1 -- 172.21.15.82:0/4057184219 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f4408031570 con 0x7f4418106560 2024-09-19T05:12:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:12:41.471 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:11:18.232756Z","created":"2024-09-19T05:11:18.232756Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T05:12:41.471 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 msgr2=0x7f440403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 0x7f440403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f44000098c0 tx=0x7f4400006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 msgr2=0x7f4418197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4408009230 tx=0x7f4408003d40 comp rx=0 tx=0).stop 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 shutdown_connections 2024-09-19T05:12:41.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44040392a0 0x7f440403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 --2- 172.21.15.82:0/4057184219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4418106560 0x7f4418197fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 >> 172.21.15.82:0/4057184219 conn(0x7f44180fc1b0 msgr2=0x7f44180fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 shutdown_connections 2024-09-19T05:12:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:41.471+0000 7f441dc49640 1 -- 172.21.15.82:0/4057184219 wait complete. 2024-09-19T05:12:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:41 smithi001 ceph-mon[30968]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:41 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/4057184219' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:43.081 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:12:43.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:12:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 -- 172.21.15.82:0/3663414394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 msgr2=0x7fb9dc107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 --2- 172.21.15.82:0/3663414394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc107a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009880 tx=0x7fb9d802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 -- 172.21.15.82:0/3663414394 shutdown_connections 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 --2- 172.21.15.82:0/3663414394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc107a70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 -- 172.21.15.82:0/3663414394 >> 172.21.15.82:0/3663414394 conn(0x7fb9dc0fb9f0 msgr2=0x7fb9dc0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 -- 172.21.15.82:0/3663414394 shutdown_connections 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.009+0000 7fb9e4764640 1 -- 172.21.15.82:0/3663414394 wait complete. 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e4764640 1 Processor -- start 2024-09-19T05:12:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e4764640 1 -- start start 2024-09-19T05:12:44.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e4764640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:44.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e4764640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc10bcd0 con 0x7fb9dc107690 2024-09-19T05:12:44.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e2500640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:44.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e2500640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.82:51806/0 (socket says 172.21.15.82:51806) 2024-09-19T05:12:44.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.010+0000 7fb9e2500640 1 -- 172.21.15.82:0/2530192223 learned_addr learned my addr 172.21.15.82:0/2530192223 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:44.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9e2500640 1 -- 172.21.15.82:0/2530192223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc1976e0 con 0x7fb9dc107690 2024-09-19T05:12:44.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9e2500640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009230 tx=0x7fb9d8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:44.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d803f070 con 0x7fb9dc107690 2024-09-19T05:12:44.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d803bc80 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc1979d0 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d8035030 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.011+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc19ba70 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.012+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb9d8042070 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.012+0000 7fb9d37fe640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 0x7fb9c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.012+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb9d806cd40 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.012+0000 7fb9e1cff640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 0x7fb9c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.012+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9dc102ec0 con 0x7fb9dc107690 2024-09-19T05:12:44.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.013+0000 7fb9e1cff640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 0x7fb9c803b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098c0 tx=0x7fb9cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:44.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.018+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9d80372d0 con 0x7fb9dc107690 2024-09-19T05:12:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:43 smithi001 ceph-mon[30968]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:44.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.274+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb9dc198500 con 0x7fb9dc107690 2024-09-19T05:12:44.276 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:44 smithi082 systemd[1]: Starting Ceph mon.c for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:12:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.275+0000 7fb9d37fe640 1 -- 172.21.15.82:0/2530192223 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fb9d80314c0 con 0x7fb9dc107690 2024-09-19T05:12:44.277 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:12:44.277 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:11:18.232756Z","created":"2024-09-19T05:11:18.232756Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T05:12:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 1 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 msgr2=0x7fb9c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 0x7fb9c803b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0098c0 tx=0x7fb9cc006db0 comp rx=0 tx=0).stop 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 msgr2=0x7fb9dc1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009230 tx=0x7fb9d8003d40 comp rx=0 tx=0).stop 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 shutdown_connections 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9c80392a0 0x7fb9c803b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 --2- 172.21.15.82:0/2530192223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9dc107690 0x7fb9dc1971a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 >> 172.21.15.82:0/2530192223 conn(0x7fb9dc0fb9f0 msgr2=0x7fb9dc0fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 shutdown_connections 2024-09-19T05:12:44.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:44.277+0000 7fb9e4764640 1 -- 172.21.15.82:0/2530192223 wait complete. 2024-09-19T05:12:45.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:44 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/2530192223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:45.340 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 podman[35176]: 2024-09-19 05:12:45.215040223 +0000 UTC m=+0.097126949 container create c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T05:12:45.341 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 podman[35176]: 2024-09-19 05:12:45.133695329 +0000 UTC m=+0.015782066 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:12:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 podman[35176]: 2024-09-19 05:12:45.409103283 +0000 UTC m=+0.291190025 container init c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:12:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 podman[35176]: 2024-09-19 05:12:45.41230157 +0000 UTC m=+0.294388303 container start c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: pidfile_write: ignore empty --pid-file 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: load: jerasure load: lrc 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Git sha 0 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: DB SUMMARY 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: DB Session ID: EO77FBOGCTT4A4X9M5SE 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:12:45.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.env: 0x55c87c0b1940 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.info_log: 0x55c87d53f6e0 2024-09-19T05:12:45.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.statistics: (nil) 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.use_fsync: 0 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:12:45.762 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.db_log_dir: 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.wal_dir: 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:12:45.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.write_buffer_manager: 0x55c87d54edc0 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:12:45.764 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.unordered_write: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.row_cache: None 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.wal_filter: None 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:12:45.765 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.wal_compression: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:12:45.766 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:12:45.767 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_open_files: -1 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Compression algorithms supported: 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kZSTD supported: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:12:45.768 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.merge_operator: 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_filter: None 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:12:45.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c87d53f320) 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: index_type: 0 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: data_block_index_type: 0 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: index_shortening: 1 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: checksum: 4 2024-09-19T05:12:45.770 INFO:journalctl@ceph.mon.c.smithi082.stdout: no_block_cache: 0 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_cache: 0x55c87d5331f0 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_cache_options: 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: capacity : 536870912 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: num_shard_bits : 4 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: strict_capacity_limit : 0 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_cache_compressed: (nil) 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: persistent_cache: (nil) 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_size: 4096 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_size_deviation: 10 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_restart_interval: 16 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: index_block_restart_interval: 1 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: metadata_block_size: 4096 2024-09-19T05:12:45.771 INFO:journalctl@ceph.mon.c.smithi082.stdout: partition_filters: 0 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: use_delta_encoding: 1 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: filter_policy: bloomfilter 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: whole_key_filtering: 1 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: verify_compression: 0 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: format_version: 5 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: enable_index_compression: 1 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: block_align: 0 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: max_auto_readahead_size: 262144 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: prepopulate_block_cache: 0 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:12:45.772 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression: NoCompression 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.num_levels: 7 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:12:45.773 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:12:45.774 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:12:45.775 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:12:45.776 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:12:45.777 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.ttl: 2592000 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:12:45.778 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5b77e19c-3986-4abe-958b-32430a1fd4cf 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722765439598, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722765440179, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726722765, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5b77e19c-3986-4abe-958b-32430a1fd4cf", "db_session_id": "EO77FBOGCTT4A4X9M5SE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722765440305, "job": 1, "event": "recovery_finished"} 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T05:12:45.779 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c87d560e00 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: DB pointer 0x55c87d65c000 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: ** DB Stats ** 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.780 INFO:journalctl@ceph.mon.c.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:12:45.781 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:12:45.782 INFO:journalctl@ceph.mon.c.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: Block cache BinnedLRUCache@0x55c87d5331f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: using public_addr v2:172.21.15.82:0/0 -> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-19T05:12:45.783 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: starting mon.c rank -1 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(???) e0 preinit fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: e1 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: btime 2024-09-19T05:11:21:229522+0000 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: legacy client fscid: -1 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout: No filesystems configured 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T05:12:45.784 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T05:12:45.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T05:12:45.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T05:12:45.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:12:45.785 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3111389517' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3111389517' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.786 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c;count:3 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:45.787 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: Deploying daemon mon.c on smithi082 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/4057184219' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/2530192223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 ceph-mon[35195]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 bash[35176]: c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 2024-09-19T05:12:45.788 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:45 smithi082 systemd[1]: Started Ceph mon.c for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:12:46.106 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:12:46.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:12:46.351 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:50.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: mon.a calling monitor election 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: mon.c calling monitor election 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: monmap epoch 2 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: last_changed 2024-09-19T05:12:45.466380+0000 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: election_strategy: 1 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: fsmap 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: mgrmap e13: x(active, since 40s) 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:12:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:50.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:50.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:50.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:12:50.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:12:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: mon.a calling monitor election 2024-09-19T05:12:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: mon.c calling monitor election 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: monmap epoch 2 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: last_changed 2024-09-19T05:12:45.466380+0000 2024-09-19T05:12:51.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: min_mon_release 19 (squid) 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: election_strategy: 1 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: fsmap 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: mgrmap e13: x(active, since 40s) 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:12:51.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 -- 172.21.15.82:0/298688555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4468003530 msgr2=0x7f44680059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 --2- 172.21.15.82:0/298688555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4468003530 0x7f44680059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f447c06a9f0 tx=0x7f447802c490 comp rx=0 tx=0).stop 2024-09-19T05:12:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 -- 172.21.15.82:0/298688555 shutdown_connections 2024-09-19T05:12:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 --2- 172.21.15.82:0/298688555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4468003530 0x7f44680059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 -- 172.21.15.82:0/298688555 >> 172.21.15.82:0/298688555 conn(0x7f447c0fc280 msgr2=0x7f447c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 -- 172.21.15.82:0/298688555 shutdown_connections 2024-09-19T05:12:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.223+0000 7f4483a04640 1 -- 172.21.15.82:0/298688555 wait complete. 2024-09-19T05:12:51.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 Processor -- start 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 -- start start 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1097c0 con 0x7f447c100a60 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.224+0000 7f4483a04640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447c109640 con 0x7f4468003530 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.82:43452/0 (socket says 172.21.15.82:43452) 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 -- 172.21.15.82:0/650928004 learned_addr learned my addr 172.21.15.82:0/650928004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f44817a0640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f44817a0640 1 -- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 msgr2=0x7f447c100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f44817a0640 1 -- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 msgr2=0x7f447c100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f44817a0640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:12:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f44817a0640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 -- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 msgr2=0x7f447c100520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 -- 172.21.15.82:0/650928004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c102410 con 0x7f447c100a60 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.225+0000 7f4480f9f640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b4d0 tx=0x7f446c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.226+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f446c010670 con 0x7f447c100a60 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.226+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f446c010cf0 con 0x7f447c100a60 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.226+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c1a35b0 con 0x7f447c100a60 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.226+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f446c00fe60 con 0x7f447c100a60 2024-09-19T05:12:51.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.226+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1a3b40 con 0x7f447c100a60 2024-09-19T05:12:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.227+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f446c017070 con 0x7f447c100a60 2024-09-19T05:12:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.227+0000 7f44727fc640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 0x7f446003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.227+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f446c04c210 con 0x7f447c100a60 2024-09-19T05:12:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.227+0000 7f44817a0640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 0x7f446003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.227+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c06aca0 con 0x7f447c100a60 2024-09-19T05:12:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.228+0000 7f44817a0640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 0x7f446003b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f44780129e0 tx=0x7f447802c9b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.233+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f446c01e030 con 0x7f447c100a60 2024-09-19T05:12:51.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.465+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f447c101a50 con 0x7f447c100a60 2024-09-19T05:12:51.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.466+0000 7f44727fc640 1 -- 172.21.15.82:0/650928004 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f446c0187b0 con 0x7f447c100a60 2024-09-19T05:12:51.468 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:12:51.468 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:12:45.466380Z","created":"2024-09-19T05:11:18.232756Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:12:51.468 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 2 2024-09-19T05:12:51.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 msgr2=0x7f446003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:51.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 0x7f446003b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f44780129e0 tx=0x7f447802c9b0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 msgr2=0x7f447c100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b4d0 tx=0x7f446c00b990 comp rx=0 tx=0).stop 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 shutdown_connections 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4460039090 0x7f446003b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f447c100a60 0x7f447c100ec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 --2- 172.21.15.82:0/650928004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4468003530 0x7f447c100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 >> 172.21.15.82:0/650928004 conn(0x7f447c0fc280 msgr2=0x7f447c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 shutdown_connections 2024-09-19T05:12:51.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:51.468+0000 7f4483a04640 1 -- 172.21.15.82:0/650928004 wait complete. 2024-09-19T05:12:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:51 smithi082 ceph-mon[35195]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:51 smithi082 ceph-mon[35195]: Deploying daemon mon.b on smithi060 2024-09-19T05:12:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:51 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/650928004' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:51 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:51 smithi001 ceph-mon[30968]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:51 smithi001 ceph-mon[30968]: Deploying daemon mon.b on smithi060 2024-09-19T05:12:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:51 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/650928004' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:12:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:51 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:53.009 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:12:53.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:12:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:53.626 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:53 smithi082 ceph-mon[35195]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 -- 172.21.15.82:0/3050490872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180107680 msgr2=0x7f7180107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 --2- 172.21.15.82:0/3050490872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180107680 0x7f7180107a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7178009880 tx=0x7f717802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 -- 172.21.15.82:0/3050490872 shutdown_connections 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 --2- 172.21.15.82:0/3050490872 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180107680 0x7f7180107a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 -- 172.21.15.82:0/3050490872 >> 172.21.15.82:0/3050490872 conn(0x7f71800fd380 msgr2=0x7f71800ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 -- 172.21.15.82:0/3050490872 shutdown_connections 2024-09-19T05:12:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.629+0000 7f71854c6640 1 -- 172.21.15.82:0/3050490872 wait complete. 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 Processor -- start 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 -- start start 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 0x7f718019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f718010bd40 con 0x7f7180197960 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f71854c6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f718010bbc0 con 0x7f7180107680 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:53.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57886/0 (socket says 172.21.15.82:57886) 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 -- 172.21.15.82:0/1645057297 learned_addr learned my addr 172.21.15.82:0/1645057297 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717e7fc640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 0x7f718019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 -- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 msgr2=0x7f7180197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 -- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 msgr2=0x7f7180197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.630+0000 7f717effd640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f717e7fc640 1 -- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 msgr2=0x7f7180197420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f717e7fc640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f717e7fc640 1 -- 172.21.15.82:0/1645057297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7180197f80 con 0x7f7180197960 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f717e7fc640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 0x7f718019bcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f716800b3d0 tx=0x7f716800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7168011630 con 0x7f7180197960 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718019c230 con 0x7f7180197960 2024-09-19T05:12:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f718019c770 con 0x7f7180197960 2024-09-19T05:12:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7168011cb0 con 0x7f7180197960 2024-09-19T05:12:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.631+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f71680193b0 con 0x7f7180197960 2024-09-19T05:12:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.632+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f7168018020 con 0x7f7180197960 2024-09-19T05:12:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.632+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7160005290 con 0x7f7180197960 2024-09-19T05:12:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.632+0000 7f7177fff640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 0x7f716c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.632+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f716804bf70 con 0x7f7180197960 2024-09-19T05:12:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.632+0000 7f717effd640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 0x7f716c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.633+0000 7f717effd640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 0x7f716c03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f71780096c0 tx=0x7f7178031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.638+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f716801f020 con 0x7f7180197960 2024-09-19T05:12:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:53 smithi001 ceph-mon[30968]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:53.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.866+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7160005580 con 0x7f7180197960 2024-09-19T05:12:53.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.866+0000 7f7177fff640 1 -- 172.21.15.82:0/1645057297 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f71680214c0 con 0x7f7180197960 2024-09-19T05:12:53.868 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:12:53.868 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:12:45.466380Z","created":"2024-09-19T05:11:18.232756Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:12:53.868 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 2 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 msgr2=0x7f716c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 0x7f716c03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f71780096c0 tx=0x7f7178031400 comp rx=0 tx=0).stop 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 msgr2=0x7f718019bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 0x7f718019bcf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f716800b3d0 tx=0x7f716800b890 comp rx=0 tx=0).stop 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 shutdown_connections 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f716c039040 0x7f716c03b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7180197960 0x7f718019bcf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 --2- 172.21.15.82:0/1645057297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7180107680 0x7f7180197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 >> 172.21.15.82:0/1645057297 conn(0x7f71800fd380 msgr2=0x7f71800fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 shutdown_connections 2024-09-19T05:12:53.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:53.868+0000 7f71854c6640 1 -- 172.21.15.82:0/1645057297 wait complete. 2024-09-19T05:12:54.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:12:54 smithi060 systemd[1]: Started Ceph mon.b for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:12:55.509 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:12:55.509 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:12:55.760 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 -- 172.21.15.82:0/524433491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b8003530 msgr2=0x7ff8b80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/524433491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b8003530 0x7ff8b80059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc1016e0 tx=0x7ff8c802bc80 comp rx=0 tx=0).stop 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 -- 172.21.15.82:0/524433491 shutdown_connections 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/524433491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8b8003530 0x7ff8b80059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 -- 172.21.15.82:0/524433491 >> 172.21.15.82:0/524433491 conn(0x7ff8cc0fc2c0 msgr2=0x7ff8cc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 -- 172.21.15.82:0/524433491 shutdown_connections 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.182+0000 7ff8d32ce640 1 -- 172.21.15.82:0/524433491 wait complete. 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 Processor -- start 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 -- start start 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 0x7ff8cc19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1086b0 con 0x7ff8cc19c190 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc108530 con 0x7ff8b8003530 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d32ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc108830 con 0x7ff8cc1978c0 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d0869640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d0869640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33958/0 (socket says 172.21.15.82:33958) 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d0869640 1 -- 172.21.15.82:0/3013540454 learned_addr learned my addr 172.21.15.82:0/3013540454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.183+0000 7ff8d186b640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 0x7ff8cc19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d106a640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d0869640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 msgr2=0x7ff8cc19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d0869640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 msgr2=0x7ff8cc19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d0869640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d0869640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d106a640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 msgr2=0x7ff8cc197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d106a640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 msgr2=0x7ff8cc197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d106a640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d106a640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 msgr2=0x7ff8cc19bc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 msgr2=0x7ff8cc197380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 -- 172.21.15.82:0/3013540454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1a3f00 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8d186b640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 0x7ff8cc19c640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009fd0 tx=0x7ff8c400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.184+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4015020 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.185+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c4011d10 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.185+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc1a4130 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.185+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400f2e0 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.185+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc1a46c0 con 0x7ff8cc19c190 2024-09-19T05:12:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.186+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff8c4018020 con 0x7ff8cc19c190 2024-09-19T05:12:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.186+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc109860 con 0x7ff8cc19c190 2024-09-19T05:12:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.186+0000 7ff8c27fc640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 0x7ff8b003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.186+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff8c404bf00 con 0x7ff8cc19c190 2024-09-19T05:12:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.186+0000 7ff8d106a640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 0x7ff8b003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.187+0000 7ff8d106a640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 0x7ff8b003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009b80 tx=0x7ff8c8014020 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.193+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff8c401f020 con 0x7ff8cc19c190 2024-09-19T05:12:59.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.443+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff8cc1a4ab0 con 0x7ff8cc19c190 2024-09-19T05:12:59.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:12:59.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: mon.c calling monitor election 2024-09-19T05:12:59.445 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: mon.a calling monitor election 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:12:59.446 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: monmap epoch 3 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: min_mon_release 19 (squid) 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: election_strategy: 1 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: fsmap 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: mgrmap e13: x(active, since 49s) 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:12:59.447 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.448 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:12:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.443+0000 7ff8c27fc640 1 -- 172.21.15.82:0/3013540454 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1271 (secure 0 0 0) 0x7ff8c4018310 con 0x7ff8cc19c190 2024-09-19T05:12:59.448 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:12:59.449 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:12:54.169280Z","created":"2024-09-19T05:11:18.232756Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:12:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:dumped monmap epoch 3 2024-09-19T05:12:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 msgr2=0x7ff8b003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 0x7ff8b003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009b80 tx=0x7ff8c8014020 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 msgr2=0x7ff8cc19c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 0x7ff8cc19c640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009fd0 tx=0x7ff8c400b870 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 shutdown_connections 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff8b0039730 0x7ff8b003bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8cc19c190 0x7ff8cc19c640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8cc1978c0 0x7ff8cc19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 --2- 172.21.15.82:0/3013540454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b8003530 0x7ff8cc197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 >> 172.21.15.82:0/3013540454 conn(0x7ff8cc0fc2c0 msgr2=0x7ff8cc1058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 shutdown_connections 2024-09-19T05:12:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:12:59.446+0000 7ff8d32ce640 1 -- 172.21.15.82:0/3013540454 wait complete. 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: mon.c calling monitor election 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: mon.a calling monitor election 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:12:59.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: monmap epoch 3 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:12:59.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: election_strategy: 1 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: fsmap 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: mgrmap e13: x(active, since 49s) 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.524 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:12:59.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:12:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:00.060 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T05:13:00.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T05:13:00.320 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:13:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/3013540454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:13:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:00.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:00.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:00 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/3013540454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:13:00.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:00.354 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:00.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 -- 172.21.15.1:0/3120880625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950102750 msgr2=0x7fc950102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:00.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 --2- 172.21.15.1:0/3120880625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950102750 0x7fc950102b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc940009880 tx=0x7fc94002a670 comp rx=0 tx=0).stop 2024-09-19T05:13:00.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 -- 172.21.15.1:0/3120880625 shutdown_connections 2024-09-19T05:13:00.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 --2- 172.21.15.1:0/3120880625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950102750 0x7fc950102b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 -- 172.21.15.1:0/3120880625 >> 172.21.15.1:0/3120880625 conn(0x7fc9500fc1b0 msgr2=0x7fc9500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:00.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 -- 172.21.15.1:0/3120880625 shutdown_connections 2024-09-19T05:13:00.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 -- 172.21.15.1:0/3120880625 wait complete. 2024-09-19T05:13:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.755+0000 7fc955ce7640 1 Processor -- start 2024-09-19T05:13:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 -- start start 2024-09-19T05:13:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 0x7fc950197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc95019c220 0x7fc95019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010bc70 con 0x7fc950197950 2024-09-19T05:13:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010baf0 con 0x7fc950102750 2024-09-19T05:13:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc955ce7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc95010bdf0 con 0x7fc95019c220 2024-09-19T05:13:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55226/0 (socket says 172.21.15.1:55226) 2024-09-19T05:13:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 -- 172.21.15.1:0/1972561879 learned_addr learned my addr 172.21.15.1:0/1972561879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:13:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94f7fe640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 0x7fc950197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94ffff640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc95019c220 0x7fc95019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:00.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 -- 172.21.15.1:0/1972561879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc95019c220 msgr2=0x7fc95019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:00.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc95019c220 0x7fc95019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 -- 172.21.15.1:0/1972561879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 msgr2=0x7fc950197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:00.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 0x7fc950197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94effd640 1 -- 172.21.15.1:0/1972561879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9501a3f90 con 0x7fc950197950 2024-09-19T05:13:00.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.756+0000 7fc94f7fe640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 0x7fc950197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:13:00.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc94effd640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc94400b520 tx=0x7fc94400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:00.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944004230 con 0x7fc950197950 2024-09-19T05:13:00.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9440043d0 con 0x7fc950197950 2024-09-19T05:13:00.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9501a41c0 con 0x7fc950197950 2024-09-19T05:13:00.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944003d60 con 0x7fc950197950 2024-09-19T05:13:00.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.757+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a4720 con 0x7fc950197950 2024-09-19T05:13:00.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.758+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc94400e070 con 0x7fc950197950 2024-09-19T05:13:00.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.758+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc950102bb0 con 0x7fc950197950 2024-09-19T05:13:00.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.758+0000 7fc94cff9640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 0x7fc93803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:00.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.758+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc94404bc10 con 0x7fc950197950 2024-09-19T05:13:00.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.758+0000 7fc94f7fe640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 0x7fc93803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:00.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.759+0000 7fc94f7fe640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 0x7fc93803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc940031550 tx=0x7fc940005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:00.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.763+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc944014020 con 0x7fc950197950 2024-09-19T05:13:00.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.945+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc9501a4b10 con 0x7fc950197950 2024-09-19T05:13:00.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.945+0000 7fc94cff9640 1 -- 172.21.15.1:0/1972561879 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7fc944010d70 con 0x7fc950197950 2024-09-19T05:13:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:00.948 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-19T05:13:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:00.948 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-09-19T05:13:00.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 msgr2=0x7fc93803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:00.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 0x7fc93803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc940031550 tx=0x7fc940005a40 comp rx=0 tx=0).stop 2024-09-19T05:13:00.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 msgr2=0x7fc95019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:00.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc94400b520 tx=0x7fc94400b9e0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 shutdown_connections 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.947+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc938039730 0x7fc93803bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc95019c220 0x7fc95019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc950197950 0x7fc95019bce0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 --2- 172.21.15.1:0/1972561879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc950102750 0x7fc950197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 >> 172.21.15.1:0/1972561879 conn(0x7fc9500fc1b0 msgr2=0x7fc950105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 shutdown_connections 2024-09-19T05:13:00.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:00.948+0000 7fc955ce7640 1 -- 172.21.15.1:0/1972561879 wait complete. 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.c calling monitor election 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.a calling monitor election 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: monmap epoch 3 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: min_mon_release 19 (squid) 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: election_strategy: 1 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:13:01.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: fsmap 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mgrmap e13: x(active, since 49s) 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: overall HEALTH_OK 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/3013540454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:01.615 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T05:13:01.616 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:13:01.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:13:01.644 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:13:01.644 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:13:01.711 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:13:01.711 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:13:01.741 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:13:01.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:13:01.808 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:13:01.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:13:01.835 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:13:01.835 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:13:01.900 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-19T05:13:01.900 INFO:tasks.cephadm:Adding mgr.y on smithi060 2024-09-19T05:13:01.901 INFO:tasks.cephadm:Adding mgr.z on smithi082 2024-09-19T05:13:01.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi060=y;smithi082=z' 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mon.b calling monitor election 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Updating smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mon.b calling monitor election 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mon.c calling monitor election 2024-09-19T05:13:01.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mon.a calling monitor election 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: monmap epoch 3 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: election_strategy: 1 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: fsmap 2024-09-19T05:13:01.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: mgrmap e13: x(active, since 51s) 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:01.962 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:13:01.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:01.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:01.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:01.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:01 smithi001 ceph-mon[30968]: Reconfiguring daemon mon.a on smithi001 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.b calling monitor election 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Updating smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.b calling monitor election 2024-09-19T05:13:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.c calling monitor election 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.a calling monitor election 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: monmap epoch 3 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: min_mon_release 19 (squid) 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: election_strategy: 1 2024-09-19T05:13:02.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: fsmap 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: mgrmap e13: x(active, since 51s) 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: overall HEALTH_OK 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.003 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:02.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:01 smithi060 ceph-mon[35058]: Reconfiguring daemon mon.a on smithi001 2024-09-19T05:13:02.176 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:13:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mon.b calling monitor election 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Updating smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mon.b calling monitor election 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mon.c calling monitor election 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mon.a calling monitor election 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: monmap epoch 3 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: last_changed 2024-09-19T05:12:54.169280+0000 2024-09-19T05:13:02.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: created 2024-09-19T05:11:18.232756+0000 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: min_mon_release 19 (squid) 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: election_strategy: 1 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: 1: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.c 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: fsmap 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: mgrmap e13: x(active, since 51s) 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:02.261 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:01 smithi082 ceph-mon[35195]: Reconfiguring daemon mon.a on smithi001 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 -- 172.21.15.82:0/2627319213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc101720 msgr2=0x7ff2cc101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2627319213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc101720 0x7ff2cc101b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009880 tx=0x7ff2bc02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 -- 172.21.15.82:0/2627319213 shutdown_connections 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2627319213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc101720 0x7ff2cc101b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 -- 172.21.15.82:0/2627319213 >> 172.21.15.82:0/2627319213 conn(0x7ff2cc0fceb0 msgr2=0x7ff2cc0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 -- 172.21.15.82:0/2627319213 shutdown_connections 2024-09-19T05:13:02.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 -- 172.21.15.82:0/2627319213 wait complete. 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.588+0000 7ff2d1537640 1 Processor -- start 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 -- start start 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc197510 0x7ff2cc19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc197990 0x7ff2cc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc107810 con 0x7ff2cc197510 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc107690 con 0x7ff2cc197990 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2d1537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc107990 con 0x7ff2cc101720 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33964/0 (socket says 172.21.15.82:33964) 2024-09-19T05:13:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 -- 172.21.15.82:0/2440416724 learned_addr learned my addr 172.21.15.82:0/2440416724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2ca7fc640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc197510 0x7ff2cc19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2cb7fe640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc197990 0x7ff2cc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 -- 172.21.15.82:0/2440416724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc197990 msgr2=0x7ff2cc19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc197990 0x7ff2cc19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 -- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc197510 msgr2=0x7ff2cc19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc197510 0x7ff2cc19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.589+0000 7ff2caffd640 1 -- 172.21.15.82:0/2440416724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc19f3d0 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2caffd640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc031610 tx=0x7ff2bc0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc03f030 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2bc003ce0 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc19f660 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc035070 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.590+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc19fbc0 con 0x7ff2cc101720 2024-09-19T05:13:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.591+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff2bc042030 con 0x7ff2cc101720 2024-09-19T05:13:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.591+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc1905d0 con 0x7ff2cc101720 2024-09-19T05:13:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.591+0000 7ff2c3fff640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 0x7ff2b803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.591+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff2bc06ca40 con 0x7ff2cc101720 2024-09-19T05:13:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.591+0000 7ff2ca7fc640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 0x7ff2b803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.592+0000 7ff2ca7fc640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 0x7ff2b803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc1984f0 tx=0x7ff2b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:02.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.596+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2bc036df0 con 0x7ff2cc101720 2024-09-19T05:13:02.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.775+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi060=y;smithi082=z", "target": ["mon-mgr", ""]}) -- 0x7ff2cc0626c0 con 0x7ff2b8039730 2024-09-19T05:13:02.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.780+0000 7ff2c3fff640 1 -- 172.21.15.82:0/2440416724 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff2cc0626c0 con 0x7ff2b8039730 2024-09-19T05:13:02.781 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mgr update... 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 msgr2=0x7ff2b803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 0x7ff2b803bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc1984f0 tx=0x7ff2b4008040 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 msgr2=0x7ff2cc196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc031610 tx=0x7ff2bc0043c0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 shutdown_connections 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2b8039730 0x7ff2b803bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2cc197990 0x7ff2cc19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2cc197510 0x7ff2cc19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 --2- 172.21.15.82:0/2440416724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2cc101720 0x7ff2cc196fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 >> 172.21.15.82:0/2440416724 conn(0x7ff2cc0fceb0 msgr2=0x7ff2cc0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 shutdown_connections 2024-09-19T05:13:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:02.782+0000 7ff2d1537640 1 -- 172.21.15.82:0/2440416724 wait complete. 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: Reconfiguring daemon mon.b on smithi060 2024-09-19T05:13:03.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: Reconfiguring daemon mon.b on smithi060 2024-09-19T05:13:03.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:13:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:03.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:03.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:03.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: Reconfiguring daemon mon.b on smithi060 2024-09-19T05:13:03.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:03.359 DEBUG:teuthology.orchestra.run.smithi060:mgr.y> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T05:13:03.361 DEBUG:teuthology.orchestra.run.smithi082:mgr.z> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T05:13:03.364 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T05:13:03.364 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:13:03.364 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:13:03.383 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:13:03.383 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-19T05:13:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:13:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:03.440 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 05:12:20.951465274 +0000 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 05:07:19.633626825 +0000 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 05:07:19.633626825 +0000 2024-09-19T05:13:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 05:07:19.633626825 +0000 2024-09-19T05:13:03.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:13:03.507 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T05:13:03.507 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T05:13:03.507 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000118772 s, 4.3 MB/s 2024-09-19T05:13:03.508 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:13:03.566 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 05:12:20.986464834 +0000 2024-09-19T05:13:03.623 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 05:07:19.957622760 +0000 2024-09-19T05:13:03.624 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 05:07:19.957622760 +0000 2024-09-19T05:13:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 05:07:19.957622760 +0000 2024-09-19T05:13:03.624 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:13:03.688 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T05:13:03.689 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T05:13:03.689 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.00011516 s, 4.4 MB/s 2024-09-19T05:13:03.690 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:13:03.748 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 05:12:21.020464406 +0000 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 05:07:20.290618584 +0000 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 05:07:20.290618584 +0000 2024-09-19T05:13:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 05:07:20.290618584 +0000 2024-09-19T05:13:03.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:13:03.871 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T05:13:03.871 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T05:13:03.871 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000113808 s, 4.5 MB/s 2024-09-19T05:13:03.872 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:13:03.929 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 05:12:21.054463978 +0000 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 05:07:20.614614519 +0000 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 05:07:20.614614519 +0000 2024-09-19T05:13:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 05:07:20.614614519 +0000 2024-09-19T05:13:03.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:13:04.050 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T05:13:04.050 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T05:13:04.050 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000119058 s, 4.3 MB/s 2024-09-19T05:13:04.052 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:13:04.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:03 smithi060 ceph-mon[35058]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi060=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:04.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:03 smithi060 ceph-mon[35058]: Saving service mgr spec with placement smithi001=x;smithi060=y;smithi082=z;count:3 2024-09-19T05:13:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:03 smithi001 ceph-mon[30968]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi060=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:03 smithi001 ceph-mon[30968]: Saving service mgr spec with placement smithi001=x;smithi060=y;smithi082=z;count:3 2024-09-19T05:13:04.108 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-19T05:13:04.108 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:13:04.125 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:13:04.125 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-19 05:12:53.587625011 +0000 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-19 05:07:55.518299582 +0000 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-19 05:07:55.518299582 +0000 2024-09-19T05:13:04.182 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-19 05:07:55.518299582 +0000 2024-09-19T05:13:04.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:13:04.247 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-19T05:13:04.248 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-19T05:13:04.248 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000115994 s, 4.4 MB/s 2024-09-19T05:13:04.249 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:13:04.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:03 smithi082 ceph-mon[35195]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi060=y;smithi082=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:03 smithi082 ceph-mon[35195]: Saving service mgr spec with placement smithi001=x;smithi060=y;smithi082=z;count:3 2024-09-19T05:13:04.306 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-19T05:13:04.362 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-19 05:12:53.587625011 +0000 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-19 05:07:55.830296505 +0000 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-19 05:07:55.830296505 +0000 2024-09-19T05:13:04.363 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-19 05:07:55.830296505 +0000 2024-09-19T05:13:04.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:13:04.428 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-19T05:13:04.428 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-19T05:13:04.428 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00011491 s, 4.5 MB/s 2024-09-19T05:13:04.429 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:13:04.486 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-19T05:13:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:13:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:04.542 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:13:04.542 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:04.543 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:04.543 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-19 05:12:53.588625001 +0000 2024-09-19T05:13:04.543 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-19 05:07:56.149293359 +0000 2024-09-19T05:13:04.543 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-19 05:07:56.149293359 +0000 2024-09-19T05:13:04.543 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-19 05:07:56.149293359 +0000 2024-09-19T05:13:04.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:13:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-19T05:13:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-19T05:13:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00011086 s, 4.6 MB/s 2024-09-19T05:13:04.608 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:13:04.665 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-19 05:12:53.588625001 +0000 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-19 05:07:56.464290253 +0000 2024-09-19T05:13:04.721 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-19 05:07:56.464290253 +0000 2024-09-19T05:13:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-19 05:07:56.464290253 +0000 2024-09-19T05:13:04.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:13:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-19T05:13:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-19T05:13:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000109688 s, 4.7 MB/s 2024-09-19T05:13:04.786 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:13:04.843 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-19T05:13:04.843 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:13:04.859 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:13:04.860 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-19 05:12:44.180821012 +0000 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-19 05:07:45.312466128 +0000 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-19 05:07:45.312466128 +0000 2024-09-19T05:13:04.915 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-19 05:07:45.312466128 +0000 2024-09-19T05:13:04.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:13:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-19T05:13:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-19T05:13:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000266505 s, 1.9 MB/s 2024-09-19T05:13:04.981 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:13:05.038 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-09-19T05:13:05.093 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:13:05.093 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-19 05:12:44.180821012 +0000 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-19 05:07:45.661459073 +0000 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-19 05:07:45.661459073 +0000 2024-09-19T05:13:05.094 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-19 05:07:45.661459073 +0000 2024-09-19T05:13:05.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:13:05.157 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-19T05:13:05.157 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-19T05:13:05.157 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000201602 s, 2.5 MB/s 2024-09-19T05:13:05.158 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:13:05.214 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-19 05:12:44.180821012 +0000 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-19 05:07:46.009452038 +0000 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-19 05:07:46.009452038 +0000 2024-09-19T05:13:05.270 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-19 05:07:46.009452038 +0000 2024-09-19T05:13:05.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:13:05.333 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-19T05:13:05.333 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-19T05:13:05.333 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000189994 s, 2.7 MB/s 2024-09-19T05:13:05.336 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:13:05.393 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-19 05:12:44.181820992 +0000 2024-09-19T05:13:05.448 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-19 05:07:46.360444943 +0000 2024-09-19T05:13:05.449 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-19 05:07:46.360444943 +0000 2024-09-19T05:13:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-19 05:07:46.360444943 +0000 2024-09-19T05:13:05.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:05.498 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:05 smithi082 ceph-mon[35195]: Reconfiguring daemon mon.c on smithi082 2024-09-19T05:13:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:13:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:05 smithi060 ceph-mon[35058]: Reconfiguring daemon mon.c on smithi082 2024-09-19T05:13:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-19T05:13:05.511 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-19T05:13:05.512 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000199409 s, 2.6 MB/s 2024-09-19T05:13:05.513 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:13:05.570 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-19T05:13:05.571 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:05 smithi001 ceph-mon[30968]: Reconfiguring daemon mon.c on smithi082 2024-09-19T05:13:05.833 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:13:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:06 smithi001 ceph-mon[30968]: Deploying daemon mgr.z on smithi082 2024-09-19T05:13:06.707 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:06 smithi082 ceph-mon[35195]: Deploying daemon mgr.z on smithi082 2024-09-19T05:13:06.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:06 smithi060 ceph-mon[35058]: Deploying daemon mgr.z on smithi082 2024-09-19T05:13:07.258 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 systemd[1]: Starting Ceph mgr.z for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:13:07.645 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:07 smithi082 ceph-mon[35195]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:07.645 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 podman[36983]: 2024-09-19 05:13:07.269596157 +0000 UTC m=+0.015488563 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:13:07.645 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 podman[36983]: 2024-09-19 05:13:07.450348119 +0000 UTC m=+0.196240517 container create 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:13:07.645 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 podman[36983]: 2024-09-19 05:13:07.644332145 +0000 UTC m=+0.390224536 container init 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T05:13:07.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:07 smithi060 ceph-mon[35058]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:07 smithi001 ceph-mon[30968]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 podman[36983]: 2024-09-19 05:13:07.647068893 +0000 UTC m=+0.392961293 container start 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 ceph-mgr[37003]: -- 172.21.15.82:0/2215594179 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5653f54050e0 con 0x5653f53e3000 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 bash[36983]: 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 systemd[1]: Started Ceph mgr.z for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:07.765+0000 7f21e8531040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:07.838+0000 7f21e8531040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:13:07.985 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:07.983+0000 7f21e8531040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:13:08.258 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.048+0000 7f21e8531040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:13:08.258 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.191+0000 7f21e8531040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:13:08.276 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:13:08.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-19T05:13:08.599 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:13:08.640 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.329+0000 7f21e8531040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:13:09.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:09.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:08 smithi060 ceph-mon[35058]: Deploying daemon mgr.y on smithi060 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.638+0000 7f21e8531040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.697+0000 7f21e8531040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:08.879+0000 7f21e8531040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:09.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:09.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:09.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:09.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:08 smithi082 ceph-mon[35195]: Deploying daemon mgr.y on smithi060 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:09.017 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:08 smithi001 ceph-mon[30968]: Deploying daemon mgr.y on smithi060 2024-09-19T05:13:09.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/488156864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 msgr2=0x7f7ec410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/488156864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec410a050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009ca0 tx=0x7f7ebc02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/488156864 shutdown_connections 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/488156864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec410a050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/488156864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 0x7f7ec4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/488156864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/488156864 >> 172.21.15.1:0/488156864 conn(0x7f7ec40fd390 msgr2=0x7f7ec40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/488156864 shutdown_connections 2024-09-19T05:13:09.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.025+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/488156864 wait complete. 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 Processor -- start 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 -- start start 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 0x7f7ec40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec410d880 con 0x7f7ec41037c0 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec410d700 con 0x7f7ec4102e00 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ecb7c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec410da00 con 0x7f7ec4101c00 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9d64640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:09.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:44018/0 (socket says 172.21.15.1:44018) 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9d64640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53830/0 (socket says 172.21.15.1:53830) 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 -- 172.21.15.1:0/2036638701 learned_addr learned my addr 172.21.15.1:0/2036638701 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec8d62640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 0x7f7ec40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 -- 172.21.15.1:0/2036638701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 msgr2=0x7f7ec40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 0x7f7ec40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 -- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 msgr2=0x7f7ec4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 -- 172.21.15.1:0/2036638701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40753e0 con 0x7f7ec4101c00 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9d64640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.026+0000 7f7ec9563640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000e9c0 tx=0x7f7ec000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.027+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec000cd80 con 0x7f7ec4101c00 2024-09-19T05:13:09.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.027+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ec00035f0 con 0x7f7ec4101c00 2024-09-19T05:13:09.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.027+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec41a1fd0 con 0x7f7ec4101c00 2024-09-19T05:13:09.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.027+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0010690 con 0x7f7ec4101c00 2024-09-19T05:13:09.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.027+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec41a2430 con 0x7f7ec4101c00 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f7ec0004030 con 0x7f7ec4101c00 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec4109000 con 0x7f7ec4101c00 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7eba7fc640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 0x7f7eb003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ec004cac0 con 0x7f7ec4101c00 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7ec8d62640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 0x7f7eb003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:09.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.028+0000 7f7ec8d62640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 0x7f7eb003b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4075d10 tx=0x7f7eb400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:09.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.033+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ec0004320 con 0x7f7ec4101c00 2024-09-19T05:13:09.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:09.218+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7ec4062630 con 0x7f7eb00394d0 2024-09-19T05:13:09.819 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:09 smithi060 systemd[1]: Starting Ceph mgr.y for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:13:09.929 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:09 smithi001 ceph-mon[30968]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:09.929 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:09.929 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:09.929 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-mon[35195]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:09.745+0000 7f21e8531040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:13:10.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:09.810+0000 7f21e8531040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:13:10.114 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:09 smithi060 ceph-mon[35058]: from='client.24112 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:10.114 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:10.114 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:10.115 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:10.115 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:09 smithi060 podman[36408]: 2024-09-19 05:13:09.796434593 +0000 UTC m=+0.015622359 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:13:10.115 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 podman[36408]: 2024-09-19 05:13:10.009056151 +0000 UTC m=+0.228243952 container create a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 podman[36408]: 2024-09-19 05:13:10.194627687 +0000 UTC m=+0.413815443 container init a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 podman[36408]: 2024-09-19 05:13:10.197568472 +0000 UTC m=+0.416756229 container start a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-mgr[36428]: -- 172.21.15.60:0/858928592 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555a869790e0 con 0x555a86956800 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 bash[36408]: a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 systemd[1]: Started Ceph mgr.y for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.321+0000 7f608705c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:13:10.383 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.380+0000 7f608705c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:13:10.750 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.537+0000 7f608705c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:13:10.751 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.607+0000 7f608705c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:13:10.804 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:10.529+0000 7f21e8531040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:13:10.805 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:10.645+0000 7f21e8531040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:13:10.805 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:10.803+0000 7f21e8531040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:13:11.034 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.769+0000 7f608705c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:13:11.034 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:10.921+0000 7f608705c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:13:11.094 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:10.870+0000 7f21e8531040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:13:11.094 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.020+0000 7f21e8531040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:13:11.094 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.092+0000 7f21e8531040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:13:11.319 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:11.254+0000 7f608705c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:13:11.319 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:11.317+0000 7f608705c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:13:11.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:11.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.378 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.153+0000 7f21e8531040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.311+0000 7f21e8531040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:13:11.379 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.376+0000 7f21e8531040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:13:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:11.650 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.442+0000 7f21e8531040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:13:11.650 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.530+0000 7f21e8531040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:13:11.650 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.591+0000 7f21e8531040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:13:11.650 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:11.648+0000 7f21e8531040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:13:11.750 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:11.512+0000 7f608705c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:13:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:12.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1021641740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]': finished 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:12 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/21799791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:12.750 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:12.439+0000 7f608705c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:13:12.750 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:12.508+0000 7f608705c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1021641740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]': finished 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:12 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/21799791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:12.757 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z[36999]: 2024-09-19T05:13:12.430+0000 7f21e8531040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1021641740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]: dispatch 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a55e2ad0-856c-4327-b992-1d8269cb4822"}]': finished 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:12 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/21799791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:13.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:13.329+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f7ec001dd00 con 0x7f7ec4101c00 2024-09-19T05:13:13.526 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.255+0000 7f608705c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:13:13.526 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.375+0000 7f608705c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:13:13.526 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.523+0000 7f608705c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:13:13.527 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:13.527 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:13:13.527 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T05:13:13.527 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: Standby manager daemon z started 2024-09-19T05:13:13.528 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:13:13.528 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:13.528 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:13:13.528 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:13:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T05:13:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: Standby manager daemon z started 2024-09-19T05:13:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:13:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:13:13.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:13 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:13.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:13:13.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T05:13:13.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: Standby manager daemon z started 2024-09-19T05:13:13.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:13:13.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:13.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:13:13.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:13 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.82:0/2453833548' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:13.814 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.587+0000 7f608705c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:13:13.814 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.742+0000 7f608705c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:13:13.815 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.812+0000 7f608705c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:13:14.108 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:13.874+0000 7f608705c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:13:14.108 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.039+0000 7f608705c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:13:14.108 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.106+0000 7f608705c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:13:14.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-mon[35058]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T05:13:14.385 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:13:14.386 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.175+0000 7f608705c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:13:14.386 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.261+0000 7f608705c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:13:14.386 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.322+0000 7f608705c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:13:14.386 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:14.383+0000 7f608705c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:13:14.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:14 smithi001 ceph-mon[30968]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T05:13:14.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:13:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:14 smithi082 ceph-mon[35195]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-19T05:13:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:13:15.500 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y[36424]: 2024-09-19T05:13:15.207+0000 7f608705c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: Standby manager daemon y started 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:13:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:15 smithi060 ceph-mon[35058]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: Standby manager daemon y started 2024-09-19T05:13:15.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:13:15.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:15.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:13:15.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:15 smithi001 ceph-mon[30968]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: Standby manager daemon y started 2024-09-19T05:13:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:13:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:13:15.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:13:15.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:15 smithi082 ceph-mon[35195]: from='mgr.? 172.21.15.60:0/2649716236' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:13:15.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:15.795+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mon.1 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f7ec00217c0 con 0x7f7ec4101c00 2024-09-19T05:13:17.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:16 smithi001 ceph-mon[30968]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:17.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:16 smithi001 ceph-mon[30968]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T05:13:17.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:13:17.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:16 smithi060 ceph-mon[35058]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:17.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:16 smithi060 ceph-mon[35058]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T05:13:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:13:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:16 smithi082 ceph-mon[35195]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:16 smithi082 ceph-mon[35195]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-19T05:13:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:13:19.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:18 smithi001 ceph-mon[30968]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:19.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:18 smithi060 ceph-mon[35058]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:18 smithi082 ceph-mon[35195]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:20.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:20.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.560 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:20.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:21 smithi001 ceph-mon[30968]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:13:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:21 smithi001 ceph-mon[30968]: Deploying daemon osd.0 on smithi001 2024-09-19T05:13:21.652 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:21 smithi060 ceph-mon[35058]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:21.652 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:13:21.652 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:21.652 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:21 smithi060 ceph-mon[35058]: Deploying daemon osd.0 on smithi001 2024-09-19T05:13:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:21 smithi082 ceph-mon[35195]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:13:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:21 smithi082 ceph-mon[35195]: Deploying daemon osd.0 on smithi001 2024-09-19T05:13:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:23 smithi001 ceph-mon[30968]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:23.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:23 smithi060 ceph-mon[35058]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:23 smithi082 ceph-mon[35195]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:25 smithi001 ceph-mon[30968]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:25 smithi060 ceph-mon[35058]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:25 smithi082 ceph-mon[35195]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:27 smithi001 ceph-mon[30968]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:27 smithi060 ceph-mon[35058]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:27.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:27.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:27.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:27.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:27 smithi082 ceph-mon[35195]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.947+0000 7f7eba7fc640 1 -- 172.21.15.1:0/2036638701 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7ec4062630 con 0x7f7eb00394d0 2024-09-19T05:13:30.950 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 msgr2=0x7f7eb003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 0x7f7eb003b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4075d10 tx=0x7f7eb400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 msgr2=0x7f7ec4075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000e9c0 tx=0x7f7ec000ee80 comp rx=0 tx=0).stop 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 shutdown_connections 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7eb00394d0 0x7f7eb003b990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec41037c0 0x7f7ec4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:30.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec4102e00 0x7f7ec40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:30.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 --2- 172.21.15.1:0/2036638701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ec4101c00 0x7f7ec4075f90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:30.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.949+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 >> 172.21.15.1:0/2036638701 conn(0x7f7ec40fd390 msgr2=0x7f7ec41061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:30.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.950+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 shutdown_connections 2024-09-19T05:13:30.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:13:30.950+0000 7f7ecb7c7640 1 -- 172.21.15.1:0/2036638701 wait complete. 2024-09-19T05:13:31.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:31 smithi001 ceph-mon[30968]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:31.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:31.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.521 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.555 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T05:13:31.557 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_4... 2024-09-19T05:13:31.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:13:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:31 smithi060 ceph-mon[35058]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:31 smithi082 ceph-mon[35195]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:13:32.833 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:13:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:13:32.591+0000 7f387f02f640 -1 osd.0 0 log_to_monitors true 2024-09-19T05:13:33.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:33 smithi060 ceph-mon[35058]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:33.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:33 smithi060 ceph-mon[35058]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:13:33.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:33 smithi082 ceph-mon[35195]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:33.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:33 smithi082 ceph-mon[35195]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:13:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:33 smithi001 ceph-mon[30968]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:33 smithi001 ceph-mon[30968]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:13:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:13:34.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-09-19T05:13:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:34.681 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:34.681 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:13:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:13:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:13:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:34.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.841 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:13:34.423+0000 7f387afb2640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T05:13:34.841 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:13:34.427+0000 7f3876dda640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:34.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/2927967897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 msgr2=0x7f0d68109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/2927967897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68109d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009ca0 tx=0x7f0d6002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/2927967897 shutdown_connections 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/2927967897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68109d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/2927967897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d681073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/2927967897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 0x7f0d68104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/2927967897 >> 172.21.15.60:0/2927967897 conn(0x7f0d680fc2a0 msgr2=0x7f0d680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/2927967897 shutdown_connections 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.965+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/2927967897 wait complete. 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 Processor -- start 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 -- start start 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 0x7f0d68102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d68100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d8a0 con 0x7f0d681026a0 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810d720 con 0x7f0d68107900 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6e9d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6810da20 con 0x7f0d68104fd0 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6cf75640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6cf75640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36020/0 (socket says 172.21.15.60:36020) 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.966+0000 7f0d6cf75640 1 -- 172.21.15.60:0/214133568 learned_addr learned my addr 172.21.15.60:0/214133568 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-19T05:13:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d677fe640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d68100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d67fff640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 0x7f0d68102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 -- 172.21.15.60:0/214133568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 msgr2=0x7f0d68100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d68100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 -- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 msgr2=0x7f0d68102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 0x7f0d68102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 -- 172.21.15.60:0/214133568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68101450 con 0x7f0d68107900 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d677fe640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d68100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6cf75640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d60005e30 tx=0x7f0d60031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60003c30 con 0x7f0d68107900 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d60003dd0 con 0x7f0d68107900 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d681a2000 con 0x7f0d68107900 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6002fde0 con 0x7f0d68107900 2024-09-19T05:13:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.967+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681a2510 con 0x7f0d68107900 2024-09-19T05:13:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.968+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d680fdd90 con 0x7f0d68107900 2024-09-19T05:13:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.970+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f0d60004050 con 0x7f0d68107900 2024-09-19T05:13:34.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.971+0000 7f0d657fa640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 0x7f0d500a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.971+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f0d600ef3b0 con 0x7f0d68107900 2024-09-19T05:13:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.971+0000 7f0d67fff640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 0x7f0d500a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.971+0000 7f0d67fff640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 0x7f0d500a5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d580058c0 tx=0x7f0d5800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:34.974+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d600bdc50 con 0x7f0d68107900 2024-09-19T05:13:35.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:35.158+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0d68062630 con 0x7f0d500a31b0 2024-09-19T05:13:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi001 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi001 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:35.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:35.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi001 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] boot 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:13:36.592 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:36 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] boot 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:13:36.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:36 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:13:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:13:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: osd.0 [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] boot 2024-09-19T05:13:36.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:13:36.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:13:37.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:37 smithi060 ceph-mon[35058]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:37.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:37 smithi060 ceph-mon[35058]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:13:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:37 smithi082 ceph-mon[35195]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:37 smithi082 ceph-mon[35195]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:13:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:37 smithi001 ceph-mon[30968]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:13:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:37 smithi001 ceph-mon[30968]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/1293672120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]': finished 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:38.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:38 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/3631726905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:38.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/1293672120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]': finished 2024-09-19T05:13:38.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:13:38.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:38.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:38 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/3631726905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:38.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/1293672120' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]: dispatch 2024-09-19T05:13:38.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ab3f0a0-9572-420a-a9bd-b0bf499761b0"}]': finished 2024-09-19T05:13:38.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:13:38.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:38.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:38 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/3631726905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:39 smithi001 ceph-mon[30968]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:39 smithi060 ceph-mon[35058]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:39 smithi082 ceph-mon[35195]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:41 smithi001 ceph-mon[30968]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:41 smithi060 ceph-mon[35058]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:42.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:41 smithi082 ceph-mon[35195]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:43 smithi060 ceph-mon[35058]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:43 smithi001 ceph-mon[30968]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:43 smithi082 ceph-mon[35195]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:45 smithi001 ceph-mon[30968]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:45.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:13:45.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:45.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:45 smithi060 ceph-mon[35058]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:45.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:13:45.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:45 smithi082 ceph-mon[35195]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:13:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:46.841 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:46 smithi060 ceph-mon[35058]: Deploying daemon osd.1 on smithi060 2024-09-19T05:13:47.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:46 smithi082 ceph-mon[35195]: Deploying daemon osd.1 on smithi060 2024-09-19T05:13:47.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:46 smithi001 ceph-mon[30968]: Deploying daemon osd.1 on smithi060 2024-09-19T05:13:47.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:47 smithi060 ceph-mon[35058]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:47 smithi082 ceph-mon[35195]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:47 smithi001 ceph-mon[30968]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:50.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:49 smithi060 ceph-mon[35058]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:50.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:49 smithi082 ceph-mon[35195]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:49 smithi001 ceph-mon[30968]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:52.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:51 smithi060 ceph-mon[35058]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:52.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:51 smithi082 ceph-mon[35195]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:51 smithi001 ceph-mon[30968]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:52.676 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:52.676 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:52.676 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:53.966 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:53 smithi060 ceph-mon[35058]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:53 smithi082 ceph-mon[35195]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:53 smithi001 ceph-mon[30968]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.217+0000 7f0d657fa640 1 -- 172.21.15.60:0/214133568 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d68062630 con 0x7f0d500a31b0 2024-09-19T05:13:55.219 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-09-19T05:13:55.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 msgr2=0x7f0d500a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:55.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 0x7f0d500a5670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d580058c0 tx=0x7f0d5800a4c0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 msgr2=0x7f0d68100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d60005e30 tx=0x7f0d60031ee0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 shutdown_connections 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0d500a31b0 0x7f0d500a5670 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68107900 0x7f0d68100b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d68104fd0 0x7f0d68100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 --2- 172.21.15.60:0/214133568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0d681026a0 0x7f0d68102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 >> 172.21.15.60:0/214133568 conn(0x7f0d680fc2a0 msgr2=0x7f0d68102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 shutdown_connections 2024-09-19T05:13:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:13:55.220+0000 7f0d6e9d8640 1 -- 172.21.15.60:0/214133568 wait complete. 2024-09-19T05:13:55.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:55.814 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T05:13:55.817 INFO:tasks.cephadm:Deploying osd.2 on smithi082 with /dev/vg_nvme/lv_4... 2024-09-19T05:13:55.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:13:56.068 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:13:57.373 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:57 smithi082 ceph-mon[35195]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:57.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:57 smithi060 ceph-mon[35058]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:57 smithi001 ceph-mon[30968]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:58.251 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:13:57 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:13:57.989+0000 7ff1336a6640 -1 osd.1 0 log_to_monitors true 2024-09-19T05:13:58.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:13:58.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:58 smithi082 ceph-mon[35195]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:58.460 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:58 smithi082 ceph-mon[35195]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:58.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-09-19T05:13:58.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:58 smithi001 ceph-mon[30968]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:58.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:58 smithi001 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:58.712 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:13:58.753 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:58 smithi060 ceph-mon[35058]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:58.753 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:58 smithi060 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 -- 172.21.15.82:0/1701253849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2078104f90 msgr2=0x7f2078107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 --2- 172.21.15.82:0/1701253849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2078104f90 0x7f2078107380 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2068009900 tx=0x7f206802a410 comp rx=0 tx=0).stop 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 -- 172.21.15.82:0/1701253849 shutdown_connections 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 --2- 172.21.15.82:0/1701253849 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20781078c0 0x7f2078109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 --2- 172.21.15.82:0/1701253849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2078104f90 0x7f2078107380 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:59.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 --2- 172.21.15.82:0/1701253849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 0x7f2078104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 -- 172.21.15.82:0/1701253849 >> 172.21.15.82:0/1701253849 conn(0x7f20780fc280 msgr2=0x7f20780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 -- 172.21.15.82:0/1701253849 shutdown_connections 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.167+0000 7f207fd82640 1 -- 172.21.15.82:0/1701253849 wait complete. 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 Processor -- start 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 -- start start 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 0x7f2078101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 0x7f2078100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f207810d840 con 0x7f2078104f90 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f207810d6c0 con 0x7f2078102660 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207fd82640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f207810d9c0 con 0x7f20781078c0 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207e31f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:59.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207e31f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44818/0 (socket says 172.21.15.82:44818) 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207e31f640 1 -- 172.21.15.82:0/2428183164 learned_addr learned my addr 172.21.15.82:0/2428183164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207d31d640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 0x7f2078100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207db1e640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 0x7f2078101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207e31f640 1 -- 172.21.15.82:0/2428183164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 msgr2=0x7f2078101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.168+0000 7f207e31f640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 0x7f2078101fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207e31f640 1 -- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 msgr2=0x7f2078100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207e31f640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 0x7f2078100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207e31f640 1 -- 172.21.15.82:0/2428183164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078101410 con 0x7f20781078c0 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207d31d640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 0x7f2078100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207e31f640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f207000eaa0 tx=0x7f207000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207000cdb0 con 0x7f20781078c0 2024-09-19T05:13:59.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20781a1fa0 con 0x7f20781078c0 2024-09-19T05:13:59.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2070005020 con 0x7f20781078c0 2024-09-19T05:13:59.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20700116b0 con 0x7f20781078c0 2024-09-19T05:13:59.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.169+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781a2460 con 0x7f20781078c0 2024-09-19T05:13:59.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.170+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20780fdd70 con 0x7f20781078c0 2024-09-19T05:13:59.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.171+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f2070005560 con 0x7f20781078c0 2024-09-19T05:13:59.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.172+0000 7f206effd640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 0x7f20640a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:59.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.172+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f20700ce540 con 0x7f20781078c0 2024-09-19T05:13:59.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.172+0000 7f207db1e640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 0x7f20640a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:59.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.173+0000 7f207db1e640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 0x7f20640a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f207400ba40 tx=0x7f2074005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:59.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.175+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2070016030 con 0x7f20781078c0 2024-09-19T05:13:59.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:13:59.356+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2078062630 con 0x7f20640a31b0 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi060 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.358 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:59.359 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:13:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:13:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi060 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:59.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:13:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.750 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:13:59.265+0000 7ff12f629640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T05:13:59.751 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:13:59.269+0000 7ff12b451640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi060 2024-09-19T05:13:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:59.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:13:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:00.574 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:00.575 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:00.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:14:00.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:14:00.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:00.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:00.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:00.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:00.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:00.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:14:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:14:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:14:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] boot 2024-09-19T05:14:01.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:14:01.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] boot 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:14:01.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: osd.1 [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] boot 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:14:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/65712499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]': finished 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:02 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/3730113286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:02.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:14:02.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/65712499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]': finished 2024-09-19T05:14:02.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:14:02.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:02.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:02 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/3730113286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:02.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T05:14:02.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/65712499' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]: dispatch 2024-09-19T05:14:02.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8f3e5ee-cf96-490f-b3e1-125f018ed9ee"}]': finished 2024-09-19T05:14:02.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:14:02.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:02.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:02 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/3730113286' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:03 smithi001 ceph-mon[30968]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:03 smithi060 ceph-mon[35058]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:04.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:03 smithi082 ceph-mon[35195]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:05 smithi001 ceph-mon[30968]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:06.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:05 smithi060 ceph-mon[35058]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:06.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:05 smithi082 ceph-mon[35195]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:07 smithi082 ceph-mon[35195]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:07 smithi001 ceph-mon[30968]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:07 smithi060 ceph-mon[35058]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:09.703 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:09 smithi082 ceph-mon[35195]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:09 smithi001 ceph-mon[30968]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:09 smithi060 ceph-mon[35058]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:14:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:10 smithi082 ceph-mon[35195]: Deploying daemon osd.2 on smithi082 2024-09-19T05:14:10.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:14:10.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:10.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:10 smithi001 ceph-mon[30968]: Deploying daemon osd.2 on smithi082 2024-09-19T05:14:11.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:14:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:10 smithi060 ceph-mon[35058]: Deploying daemon osd.2 on smithi082 2024-09-19T05:14:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:11 smithi082 ceph-mon[35195]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:11 smithi001 ceph-mon[30968]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:11 smithi060 ceph-mon[35058]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:13 smithi001 ceph-mon[30968]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:14.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:13 smithi060 ceph-mon[35058]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:13 smithi082 ceph-mon[35195]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:15 smithi001 ceph-mon[30968]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:16.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:15 smithi060 ceph-mon[35058]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:15 smithi082 ceph-mon[35195]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:16.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:16.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:16.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:16.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:16.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:16.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:17.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:17.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:17.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:17 smithi001 ceph-mon[30968]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:18.090 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:17 smithi082 ceph-mon[35195]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:18.090 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:17 smithi060 ceph-mon[35058]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:19.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:19.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:19.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:19.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:19.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:20.008 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 2 on host 'smithi082' 2024-09-19T05:14:20.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.005+0000 7f206effd640 1 -- 172.21.15.82:0/2428183164 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2078062630 con 0x7f20640a31b0 2024-09-19T05:14:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 msgr2=0x7f20640a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 0x7f20640a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f207400ba40 tx=0x7f2074005cc0 comp rx=0 tx=0).stop 2024-09-19T05:14:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 msgr2=0x7f2078100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f207000eaa0 tx=0x7f207000ef60 comp rx=0 tx=0).stop 2024-09-19T05:14:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 shutdown_connections 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f20640a31b0 0x7f20640a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20781078c0 0x7f2078100b50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2078104f90 0x7f2078100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 --2- 172.21.15.82:0/2428183164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2078102660 0x7f2078101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 >> 172.21.15.82:0/2428183164 conn(0x7f20780fc280 msgr2=0x7f2078102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 shutdown_connections 2024-09-19T05:14:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:14:20.008+0000 7f207fd82640 1 -- 172.21.15.82:0/2428183164 wait complete. 2024-09-19T05:14:20.652 DEBUG:teuthology.orchestra.run.smithi082:osd.2> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T05:14:20.654 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-19T05:14:20.655 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:14:20.910 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:14:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:20 smithi060 ceph-mon[35058]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:20 smithi082 ceph-mon[35195]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:21.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:20 smithi001 ceph-mon[30968]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:21.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:21.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:21.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:22.075 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:21 smithi082 ceph-mon[35195]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:22.076 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:21 smithi082 ceph-mon[35195]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:22.076 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:14:21.817+0000 7fbbb63ca640 -1 osd.2 0 log_to_monitors true 2024-09-19T05:14:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:21 smithi060 ceph-mon[35058]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:21 smithi060 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:22.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:21 smithi001 ceph-mon[30968]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:22.340 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:21 smithi001 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.191 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:22 smithi082 ceph-mon[35195]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:14:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:14:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:22 smithi060 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:14:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:14:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: from='osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:22 smithi001 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:14:23.417 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:14:23.445 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-19T05:14:23.508 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:14:23.391+0000 7fbbb234d640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T05:14:23.508 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:14:23.395+0000 7fbbaa16d640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:14:23.714 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 -- 172.21.15.1:0/2056741920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0100ad0 msgr2=0x7fa2d0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/2056741920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0100ad0 0x7fa2d0100ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009900 tx=0x7fa2cc02a410 comp rx=0 tx=0).stop 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 -- 172.21.15.1:0/2056741920 shutdown_connections 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/2056741920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0102690 0x7fa2d0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/2056741920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/2056741920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0100ad0 0x7fa2d0100ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 -- 172.21.15.1:0/2056741920 >> 172.21.15.1:0/2056741920 conn(0x7fa2d00fc280 msgr2=0x7fa2d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 -- 172.21.15.1:0/2056741920 shutdown_connections 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.177+0000 7fa2d76b0640 1 -- 172.21.15.1:0/2056741920 wait complete. 2024-09-19T05:14:24.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 Processor -- start 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 -- start start 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0102690 0x7fa2d019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c760 con 0x7fa2d0102690 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c5e0 con 0x7fa2d0101cd0 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.178+0000 7fa2d76b0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c8e0 con 0x7fa2d0100ad0 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:56502/0 (socket says 172.21.15.1:56502) 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 -- 172.21.15.1:0/4139835541 learned_addr learned my addr 172.21.15.1:0/4139835541 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d5c4d640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0102690 0x7fa2d019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d4c4b640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:24.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 -- 172.21.15.1:0/4139835541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 msgr2=0x7fa2d019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 -- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0102690 msgr2=0x7fa2d019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0102690 0x7fa2d019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 -- 172.21.15.1:0/4139835541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d019fb70 con 0x7fa2d0100ad0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d4c4b640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d544c640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc031610 tx=0x7fa2cc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc03f030 con 0x7fa2d0100ad0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2cc003ad0 con 0x7fa2d0100ad0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d019fda0 con 0x7fa2d0100ad0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.179+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc035070 con 0x7fa2d0100ad0 2024-09-19T05:14:24.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.180+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d01a0220 con 0x7fa2d0100ad0 2024-09-19T05:14:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.180+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d0107ef0 con 0x7fa2d0100ad0 2024-09-19T05:14:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.182+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fa2cc042030 con 0x7fa2d0100ad0 2024-09-19T05:14:24.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.183+0000 7fa2c27fc640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 0x7fa2bc0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.183+0000 7fa2d4c4b640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 0x7fa2bc0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.183+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fa2cc0eeb90 con 0x7fa2d0100ad0 2024-09-19T05:14:24.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.184+0000 7fa2d4c4b640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 0x7fa2bc0a5670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2d006b050 tx=0x7fa2c4005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:24.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.186+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2cc0bcf60 con 0x7fa2d0100ad0 2024-09-19T05:14:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='osd.2 ' entity='osd.2' 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi082 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 17088M 2024-09-19T05:14:24.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:24.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:24.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='osd.2 ' entity='osd.2' 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi082 2024-09-19T05:14:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 17088M 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:24.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:14:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T05:14:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='osd.2 ' entity='osd.2' 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi082 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 17088M 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:24.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:24.371+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa2d0062630 con 0x7fa2bc0a31b0 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:25.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] boot 2024-09-19T05:14:25.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:14:25.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:25.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] boot 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:14:25.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:25.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: osd.2 [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] boot 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T05:14:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:14:26.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:26 smithi001 ceph-mon[30968]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:14:26.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:26 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:27.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:26 smithi060 ceph-mon[35058]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:14:27.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:26 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:27.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:26 smithi082 ceph-mon[35195]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T05:14:27.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:26 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:27.591 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:27.591 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:27.591 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:27.591 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49581]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: pgmap v77: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]: dispatch 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]': finished 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2538644471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: pgmap v77: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]: dispatch 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]': finished 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2538644471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: pgmap v77: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]: dispatch 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4041427900' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a561d3ad-02a1-4328-8553-d1974ff00b0d"}]': finished 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:14:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:28.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2538644471' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:28.091 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49630]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:28.091 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49630]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:28.091 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:28.091 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:14:27 smithi001 sudo[49630]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:28.351 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43356]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:28.351 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43356]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:28.351 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:28.352 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43356]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:28.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:28.588+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa2cc003c80 con 0x7fa2d0100ad0 2024-09-19T05:14:28.750 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43359]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:28.751 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43359]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:28.751 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:28.751 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:14:28 smithi060 sudo[43359]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:28.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:28 smithi001 ceph-mon[30968]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:14:28.880 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44211]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:28.880 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44211]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:28.880 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:28.880 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44211]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:28.881 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:28 smithi082 ceph-mon[35195]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:14:29.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:14:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:28 smithi060 ceph-mon[35058]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:14:29.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44214]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:29.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44214]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:29.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:29.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:14:28 smithi082 sudo[44214]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:29.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:29.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:29.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:29.743 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50196]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50382]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50382]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:29 smithi001 sudo[50382]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:30.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44217]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:30.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44217]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:30.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:30.314 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44217]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:30.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44220]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:30.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:30.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:30.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 sudo[44220]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:30.840 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:14:30.840 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:30.840 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:30.841 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43364]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:31.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43367]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43367]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 sudo[43367]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:31.883 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:31.884 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:31.884 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:31 smithi001 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:31 smithi060 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:14:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:31 smithi082 ceph-mon[35195]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:14:33.038 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:32 smithi001 ceph-mon[30968]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:33.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:32 smithi060 ceph-mon[35058]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:33.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:32 smithi082 ceph-mon[35195]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:34 smithi001 ceph-mon[30968]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:14:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:34 smithi001 ceph-mon[30968]: Deploying daemon osd.3 on smithi001 2024-09-19T05:14:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:34 smithi060 ceph-mon[35058]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:14:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:34 smithi060 ceph-mon[35058]: Deploying daemon osd.3 on smithi001 2024-09-19T05:14:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:34 smithi082 ceph-mon[35195]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:14:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:34 smithi082 ceph-mon[35195]: Deploying daemon osd.3 on smithi001 2024-09-19T05:14:37.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:36 smithi001 ceph-mon[30968]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:37.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:36 smithi060 ceph-mon[35058]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:37.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:36 smithi082 ceph-mon[35195]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:39.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:38 smithi060 ceph-mon[35058]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:39.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:38 smithi082 ceph-mon[35195]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:38 smithi001 ceph-mon[30968]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:40.992 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:40 smithi001 ceph-mon[30968]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:41.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:40 smithi060 ceph-mon[35058]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:41.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:40 smithi082 ceph-mon[35195]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:41.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:41.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:41.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:42.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:43.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:43 smithi060 ceph-mon[35058]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:43 smithi082 ceph-mon[35195]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:43.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:43 smithi001 ceph-mon[30968]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:45.307 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:45.308 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.346+0000 7fa2c27fc640 1 -- 172.21.15.1:0/4139835541 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2d0062630 con 0x7fa2bc0a31b0 2024-09-19T05:14:45.348 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-19T05:14:45.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.348+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 msgr2=0x7fa2bc0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:45.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.348+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 0x7fa2bc0a5670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2d006b050 tx=0x7fa2c4005d30 comp rx=0 tx=0).stop 2024-09-19T05:14:45.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.348+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 msgr2=0x7fa2d006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:45.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.348+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc031610 tx=0x7fa2cc004270 comp rx=0 tx=0).stop 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 shutdown_connections 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa2bc0a31b0 0x7fa2bc0a5670 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2d0102690 0x7fa2d019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2d0101cd0 0x7fa2d019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 --2- 172.21.15.1:0/4139835541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2d0100ad0 0x7fa2d006aad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 >> 172.21.15.1:0/4139835541 conn(0x7fa2d00fc280 msgr2=0x7fa2d01050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 shutdown_connections 2024-09-19T05:14:45.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:14:45.349+0000 7fa2d76b0640 1 -- 172.21.15.1:0/4139835541 wait complete. 2024-09-19T05:14:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:45.970 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T05:14:45.972 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2024-09-19T05:14:45.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:14:46.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:46.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.225 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.233 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:14:46.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:46.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.354 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:46.841 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:14:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:14:46.586+0000 7fbf8c6a3640 -1 osd.3 0 log_to_monitors true 2024-09-19T05:14:47.421 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:47 smithi001 ceph-mon[30968]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:47.422 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:47 smithi001 ceph-mon[30968]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:14:47.669 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:47 smithi060 ceph-mon[35058]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:47.669 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:47 smithi060 ceph-mon[35058]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:14:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:47 smithi082 ceph-mon[35195]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:47 smithi082 ceph-mon[35195]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:14:48.525 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-mon[30968]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:14:48.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-mon[30968]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:14:48.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-mon[30968]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:14:48.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:48.633 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:48 smithi060 ceph-mon[35058]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:14:48.633 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:48 smithi060 ceph-mon[35058]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:14:48.633 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:48 smithi060 ceph-mon[35058]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:14:48.633 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:48.636 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:14:48.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-09-19T05:14:48.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:48 smithi082 ceph-mon[35195]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:14:48.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:48 smithi082 ceph-mon[35195]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:14:48.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:48 smithi082 ceph-mon[35195]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:14:48.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:48.931 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:14:49.091 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:14:48.800+0000 7fbf88626640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T05:14:49.091 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:14:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:14:48.806+0000 7fbf80446640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:14:49.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 -- 172.21.15.60:0/1785787152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101e50 msgr2=0x7f5ac41086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:49.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 --2- 172.21.15.60:0/1785787152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101e50 0x7f5ac41086e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009ca0 tx=0x7f5abc02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 -- 172.21.15.60:0/1785787152 shutdown_connections 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 --2- 172.21.15.60:0/1785787152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101e50 0x7f5ac41086e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 --2- 172.21.15.60:0/1785787152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101490 0x7f5ac4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 --2- 172.21.15.60:0/1785787152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac4100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 -- 172.21.15.60:0/1785787152 >> 172.21.15.60:0/1785787152 conn(0x7f5ac40fba40 msgr2=0x7f5ac40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 -- 172.21.15.60:0/1785787152 shutdown_connections 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.403+0000 7f5acb584640 1 -- 172.21.15.60:0/1785787152 wait complete. 2024-09-19T05:14:49.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 Processor -- start 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 -- start start 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac410ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101e50 0x7f5ac410a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410d8f0 con 0x7f5ac4100290 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410d770 con 0x7f5ac4101490 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5acb584640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac410da70 con 0x7f5ac4101e50 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5ac8b1f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5ac8b1f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44146/0 (socket says 172.21.15.60:44146) 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5ac8b1f640 1 -- 172.21.15.60:0/2296676907 learned_addr learned my addr 172.21.15.60:0/2296676907 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-19T05:14:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.404+0000 7f5ac9320640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac410ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 -- 172.21.15.60:0/2296676907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101e50 msgr2=0x7f5ac410a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac9b21640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101e50 0x7f5ac410a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101e50 0x7f5ac410a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 -- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 msgr2=0x7f5ac410ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac410ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 -- 172.21.15.60:0/2296676907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac410ae70 con 0x7f5ac4101490 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac9320640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5ac8b1f640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c920 tx=0x7f5ab400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007c70 con 0x7f5ac4101490 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab4007e10 con 0x7f5ac4101490 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac41a1fc0 con 0x7f5ac4101490 2024-09-19T05:14:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4018890 con 0x7f5ac4101490 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.405+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac41a2470 con 0x7f5ac4101490 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.406+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4107640 con 0x7f5ac4101490 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.407+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5ab4018a70 con 0x7f5ac4101490 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.408+0000 7f5aba7fc640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 0x7f5ab00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.408+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f5ab40ce8f0 con 0x7f5ac4101490 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.408+0000 7f5ac9320640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 0x7f5ab00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.408+0000 7f5ac9320640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 0x7f5ab00a5700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ac41012f0 tx=0x7f5ac000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.412+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ab4014030 con 0x7f5ac4101490 2024-09-19T05:14:49.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:14:49.599+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5ac4062630 con 0x7f5ab00a3240 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.601 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.602 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:49.602 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:49.602 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' 2024-09-19T05:14:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:49.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:49.845 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877]' entity='osd.3' 2024-09-19T05:14:49.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:49.846 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:49.847 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:49.847 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:49.847 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:14:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:14:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:14:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi001 2024-09-19T05:14:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T05:14:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] boot 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:50.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:50 smithi082 ceph-mon[35195]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi001 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] boot 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:50.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:50.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:50.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:50 smithi060 ceph-mon[35058]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:14:50.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi001 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: osd.3 [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] boot 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: from='client.24203 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:50.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:50 smithi001 ceph-mon[30968]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:14:51.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:51 smithi060 ceph-mon[35058]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:51.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:51 smithi060 ceph-mon[35058]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:14:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:51 smithi082 ceph-mon[35195]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:51 smithi082 ceph-mon[35195]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:14:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:51 smithi001 ceph-mon[30968]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:14:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:51 smithi001 ceph-mon[30968]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/3628996749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]': finished 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:14:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:52 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/1088234046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/3628996749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]': finished 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:14:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:52 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/1088234046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:53.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/3628996749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]: dispatch 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc98f99a-3a3b-471f-b883-2288983fea40"}]': finished 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:14:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:52 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/1088234046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:55.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:54 smithi060 ceph-mon[35058]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:54 smithi082 ceph-mon[35195]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:55.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:54 smithi001 ceph-mon[30968]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:57.193 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:56 smithi060 ceph-mon[35058]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:56 smithi082 ceph-mon[35195]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:56 smithi001 ceph-mon[30968]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:14:59.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:14:58 smithi060 ceph-mon[35058]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T05:14:59.144 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:14:58 smithi001 ceph-mon[30968]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T05:14:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:14:58 smithi082 ceph-mon[35195]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T05:15:01.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:00 smithi060 ceph-mon[35058]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:01.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:15:01.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:01.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:00 smithi060 ceph-mon[35058]: Deploying daemon osd.4 on smithi060 2024-09-19T05:15:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:00 smithi082 ceph-mon[35195]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:15:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:00 smithi082 ceph-mon[35195]: Deploying daemon osd.4 on smithi060 2024-09-19T05:15:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:00 smithi001 ceph-mon[30968]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:01.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:15:01.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:01.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:00 smithi001 ceph-mon[30968]: Deploying daemon osd.4 on smithi060 2024-09-19T05:15:03.147 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:02 smithi082 ceph-mon[35195]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:02 smithi060 ceph-mon[35058]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:02 smithi001 ceph-mon[30968]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:04.993 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:04 smithi060 ceph-mon[35058]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T05:15:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:04 smithi082 ceph-mon[35195]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T05:15:05.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:04 smithi001 ceph-mon[30968]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T05:15:06.987 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:06 smithi060 ceph-mon[35058]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:06.987 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:06.987 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:06.988 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:06 smithi082 ceph-mon[35195]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:07.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:07.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:07.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:07.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:06 smithi001 ceph-mon[30968]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:07.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:07.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:07.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:08 smithi060 ceph-mon[35058]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:08 smithi082 ceph-mon[35195]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:09.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:08 smithi001 ceph-mon[30968]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:09.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:09.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:10.152 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:10.152 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.191+0000 7f5aba7fc640 1 -- 172.21.15.60:0/2296676907 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5ac4062630 con 0x7f5ab00a3240 2024-09-19T05:15:10.194 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2024-09-19T05:15:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 msgr2=0x7f5ab00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 0x7f5ab00a5700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ac41012f0 tx=0x7f5ac000b390 comp rx=0 tx=0).stop 2024-09-19T05:15:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 msgr2=0x7f5ac410a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c920 tx=0x7f5ab400cde0 comp rx=0 tx=0).stop 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 shutdown_connections 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5ab00a3240 0x7f5ab00a5700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ac4101e50 0x7f5ac410a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac4101490 0x7f5ac410a070 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 --2- 172.21.15.60:0/2296676907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ac4100290 0x7f5ac410ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 >> 172.21.15.60:0/2296676907 conn(0x7f5ac40fba40 msgr2=0x7f5ac4104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 shutdown_connections 2024-09-19T05:15:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:15:10.194+0000 7f5acb584640 1 -- 172.21.15.60:0/2296676907 wait complete. 2024-09-19T05:15:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:10.900 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T05:15:10.902 INFO:tasks.cephadm:Deploying osd.5 on smithi082 with /dev/vg_nvme/lv_3... 2024-09-19T05:15:10.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:15:11.148 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:10 smithi060 ceph-mon[35058]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:11.148 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:11.148 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:11.148 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:11.153 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:15:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:10 smithi082 ceph-mon[35195]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:11.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:10 smithi001 ceph-mon[30968]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:11.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:11.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:11.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:12.894 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:15:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:15:12.528+0000 7f8b408e7640 -1 osd.4 0 log_to_monitors true 2024-09-19T05:15:13.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:12 smithi060 ceph-mon[35058]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:13.220 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:12 smithi060 ceph-mon[35058]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.220 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:12 smithi060 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:12 smithi082 ceph-mon[35195]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:12 smithi082 ceph-mon[35195]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:12 smithi082 ceph-mon[35195]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:12 smithi001 ceph-mon[30968]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:12 smithi001 ceph-mon[30968]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:12 smithi001 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:15:13.702 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:15:13.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-09-19T05:15:13.995 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi060 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:14.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:15:14.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi060 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi060 2024-09-19T05:15:14.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:14.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 -- 172.21.15.82:0/4205528875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c102690 msgr2=0x7f689c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/4205528875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c102690 0x7f689c108f20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f688c009ca0 tx=0x7f688c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 -- 172.21.15.82:0/4205528875 shutdown_connections 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/4205528875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c102690 0x7f689c108f20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/4205528875 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 0x7f689c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/4205528875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c100ad0 0x7f689c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 -- 172.21.15.82:0/4205528875 >> 172.21.15.82:0/4205528875 conn(0x7f689c0fc280 msgr2=0x7f689c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 -- 172.21.15.82:0/4205528875 shutdown_connections 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.437+0000 7f68a0ef1640 1 -- 172.21.15.82:0/4205528875 wait complete. 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 Processor -- start 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 -- start start 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 0x7f689c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c102690 0x7f689c109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10d880 con 0x7f689c101cd0 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10d700 con 0x7f689c102690 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68a0ef1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10da00 con 0x7f689c100ad0 2024-09-19T05:15:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54616/0 (socket says 172.21.15.82:54616) 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 -- 172.21.15.82:0/3376852178 learned_addr learned my addr 172.21.15.82:0/3376852178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f6899d9b640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 0x7f689c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689ad9d640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c102690 0x7f689c109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 -- 172.21.15.82:0/3376852178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c102690 msgr2=0x7f689c109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c102690 0x7f689c109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 -- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 msgr2=0x7f689c109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 0x7f689c109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 -- 172.21.15.82:0/3376852178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c10a8a0 con 0x7f689c100ad0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f689a59c640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f689400c970 tx=0x7f689400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.438+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894004220 con 0x7f689c100ad0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.439+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c1a1ff0 con 0x7f689c100ad0 2024-09-19T05:15:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.439+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68940043c0 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.439+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689400f450 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.439+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1a2440 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.440+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c107ed0 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.441+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f68940079b0 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.441+0000 7f68937fe640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 0x7f68880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.441+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7f68940ce5c0 con 0x7f689c100ad0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.441+0000 7f6899d9b640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 0x7f68880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.442+0000 7f6899d9b640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 0x7f68880a5700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f689c10b1d0 tx=0x7f6884005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.446+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6894014030 con 0x7f689c100ad0 2024-09-19T05:15:14.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:14.623+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f689c062630 con 0x7f68880a3240 2024-09-19T05:15:14.750 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:15:14.289+0000 7f8b3c86a640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T05:15:14.750 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:15:14.295+0000 7f8b3468a640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:15:15.165 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:15.165 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:15:15.165 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:15:15.165 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='osd.4 ' entity='osd.4' 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:15.166 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:15.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='osd.4 ' entity='osd.4' 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:15.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:15.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:15:15.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='osd.4 ' entity='osd.4' 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:15.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] boot 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:15:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:16.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:15:16.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:15:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] boot 2024-09-19T05:15:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:15:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:15:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:15:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: osd.4 [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] boot 2024-09-19T05:15:16.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:15:16.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:15:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:15:17.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/607466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]': finished 2024-09-19T05:15:17.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:15:17.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/607466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]': finished 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:15:17.623 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:17.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/607466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]: dispatch 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41f74801-2f20-401e-832b-dda19c19dc0b"}]': finished 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:15:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:18 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/2965334683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:18.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:18 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/2965334683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:18.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:18 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/2965334683' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:19 smithi001 ceph-mon[30968]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:19.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:19 smithi060 ceph-mon[35058]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:19.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:19 smithi082 ceph-mon[35195]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:21.560 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:21 smithi082 ceph-mon[35195]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:21 smithi001 ceph-mon[30968]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:21.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:21 smithi060 ceph-mon[35058]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:23 smithi001 ceph-mon[30968]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:23.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:23 smithi060 ceph-mon[35058]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:23 smithi082 ceph-mon[35195]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:25 smithi082 ceph-mon[35195]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:15:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:25.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:25 smithi001 ceph-mon[30968]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:25.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:15:25.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:25 smithi060 ceph-mon[35058]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:15:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:26.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:26 smithi001 ceph-mon[30968]: Deploying daemon osd.5 on smithi082 2024-09-19T05:15:26.613 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:26 smithi082 ceph-mon[35195]: Deploying daemon osd.5 on smithi082 2024-09-19T05:15:26.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:26 smithi060 ceph-mon[35058]: Deploying daemon osd.5 on smithi082 2024-09-19T05:15:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:27 smithi082 ceph-mon[35195]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:27 smithi001 ceph-mon[30968]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:27 smithi060 ceph-mon[35058]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:29 smithi001 ceph-mon[30968]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:29.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:29 smithi060 ceph-mon[35058]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:29 smithi082 ceph-mon[35195]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:31 smithi001 ceph-mon[30968]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:31.607 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:31 smithi082 ceph-mon[35195]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:31 smithi060 ceph-mon[35058]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:32.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:32.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:32.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:32.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:32.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:32.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:32.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:32.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:32.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:33 smithi001 ceph-mon[30968]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:33.900 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:33 smithi060 ceph-mon[35058]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:33 smithi082 ceph-mon[35195]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:35.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.555+0000 7f68937fe640 1 -- 172.21.15.82:0/3376852178 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f689c062630 con 0x7f68880a3240 2024-09-19T05:15:35.557 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 5 on host 'smithi082' 2024-09-19T05:15:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 msgr2=0x7f68880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 0x7f68880a5700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f689c10b1d0 tx=0x7f6884005f90 comp rx=0 tx=0).stop 2024-09-19T05:15:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 msgr2=0x7f689c10b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f689400c970 tx=0x7f689400ce30 comp rx=0 tx=0).stop 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 shutdown_connections 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68880a3240 0x7f68880a5700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c102690 0x7f689c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689c101cd0 0x7f689c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 --2- 172.21.15.82:0/3376852178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f689c100ad0 0x7f689c10b450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.557+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 >> 172.21.15.82:0/3376852178 conn(0x7f689c0fc280 msgr2=0x7f689c1050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.558+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 shutdown_connections 2024-09-19T05:15:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:15:35.558+0000 7f68a0ef1640 1 -- 172.21.15.82:0/3376852178 wait complete. 2024-09-19T05:15:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:35.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.188 DEBUG:teuthology.orchestra.run.smithi082:osd.5> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T05:15:36.190 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-19T05:15:36.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:15:36.456 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:15:36.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:36 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:36.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:36 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:36 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.507 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:36 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:36.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:36 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:36 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:36.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:36.577 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:37.725 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:37 smithi082 ceph-mon[35195]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:37.725 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:15:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:15:37.614+0000 7f2ebe7e9640 -1 osd.5 0 log_to_monitors true 2024-09-19T05:15:37.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:37 smithi001 ceph-mon[30968]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:37 smithi060 ceph-mon[35058]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:38.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:38 smithi001 ceph-mon[30968]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:38.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:38 smithi001 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:38.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:38 smithi082 ceph-mon[35195]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:38.754 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:38 smithi082 ceph-mon[35195]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:38 smithi060 ceph-mon[35058]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:38 smithi060 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:15:39.068 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:15:39.098 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-19T05:15:39.363 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:39.745 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:39.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:39.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:39.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:39 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 -- 172.21.15.1:0/1368538059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4101d10 msgr2=0x7f8bf4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:39.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/1368538059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4101d10 0x7f8bf4102190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009900 tx=0x7f8bdc02a410 comp rx=0 tx=0).stop 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 -- 172.21.15.1:0/1368538059 shutdown_connections 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/1368538059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 0x7f8bf4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/1368538059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4101d10 0x7f8bf4102190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/1368538059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4100b10 0x7f8bf4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.828+0000 7f8bf97ac640 1 -- 172.21.15.1:0/1368538059 >> 172.21.15.1:0/1368538059 conn(0x7f8bf40fc2a0 msgr2=0x7f8bf40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- 172.21.15.1:0/1368538059 shutdown_connections 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- 172.21.15.1:0/1368538059 wait complete. 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 Processor -- start 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- start start 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4101d10 0x7f8bf4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:39.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 0x7f8bf419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410c810 con 0x7f8bf4100b10 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410c690 con 0x7f8bf41026d0 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.829+0000 7f8bf97ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410c990 con 0x7f8bf4101d10 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51154/0 (socket says 172.21.15.1:51154) 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 -- 172.21.15.1:0/3592268912 learned_addr learned my addr 172.21.15.1:0/3592268912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf27fc640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4101d10 0x7f8bf4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf37fe640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 0x7f8bf419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 -- 172.21.15.1:0/3592268912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4101d10 msgr2=0x7f8bf4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4101d10 0x7f8bf4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 -- 172.21.15.1:0/3592268912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 msgr2=0x7f8bf419f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:39.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 0x7f8bf419f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 -- 172.21.15.1:0/3592268912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf419fc10 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf2ffd640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8be400d950 tx=0x7f8be400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4017070 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be4009c30 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf419ff00 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400f600 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.830+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf41a0380 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.831+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf41a05b0 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.833+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8be401a070 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.833+0000 7f8bebfff640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 0x7f8be00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.833+0000 7f8bf27fc640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 0x7f8be00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.833+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f8be40ce340 con 0x7f8bf4100b10 2024-09-19T05:15:39.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.834+0000 7f8bf27fc640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 0x7f8be00a5730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0314e0 tx=0x7f8bdc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:39.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:39.837+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8be409c040 con 0x7f8bf4100b10 2024-09-19T05:15:39.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:39.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:15:39.927 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:39.928 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:40.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:40.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:40.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:40.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:40.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:39 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:40.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:15:40.022+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8bf41a0840 con 0x7f8be00a3270 2024-09-19T05:15:40.258 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:15:39.925+0000 7f2eba76c640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T05:15:40.258 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:15:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:15:39.932+0000 7f2eb258c640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:15:40.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi082 2024-09-19T05:15:40.772 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 8544M 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='osd.5 ' entity='osd.5' 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:40.773 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi082 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 8544M 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='osd.5 ' entity='osd.5' 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:41.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi082 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 8544M 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='osd.5 ' entity='osd.5' 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:15:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:15:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:41.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:41.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:41.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] boot 2024-09-19T05:15:41.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:15:41.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] boot 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:15:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: osd.5 [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] boot 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:15:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:15:42.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:42 smithi001 ceph-mon[30968]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:15:43.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:42 smithi060 ceph-mon[35058]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:15:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:42 smithi082 ceph-mon[35195]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:15:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]: dispatch 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]': finished 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:43.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1239951362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]: dispatch 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]': finished 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1239951362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]: dispatch 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/620050572' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8042adc6-6495-4a69-b68d-80eb89b0bb10"}]': finished 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1239951362' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:45.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:44 smithi060 ceph-mon[35058]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:15:45.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:44 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:45.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:44 smithi082 ceph-mon[35195]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:15:45.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:44 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:45.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:44 smithi001 ceph-mon[30968]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:15:45.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:44 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:46.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:45 smithi060 ceph-mon[35058]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:46.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:45 smithi060 ceph-mon[35058]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:15:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:46.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:45 smithi082 ceph-mon[35195]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:45 smithi082 ceph-mon[35195]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:15:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:45 smithi001 ceph-mon[30968]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:45 smithi001 ceph-mon[30968]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:15:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:15:47.818 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:47 smithi001 ceph-mon[30968]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:48.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:47 smithi060 ceph-mon[35058]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:47 smithi082 ceph-mon[35195]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:15:49.888 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:49 smithi001 ceph-mon[30968]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-19T05:15:50.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:49 smithi060 ceph-mon[35058]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-19T05:15:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:49 smithi082 ceph-mon[35195]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-19T05:15:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:51 smithi001 ceph-mon[30968]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T05:15:51.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:51 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:15:51.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:51 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:51 smithi060 ceph-mon[35058]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T05:15:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:51 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:15:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:51 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:51 smithi082 ceph-mon[35195]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T05:15:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:51 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:15:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:51 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:52 smithi001 ceph-mon[30968]: Deploying daemon osd.6 on smithi001 2024-09-19T05:15:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:52 smithi060 ceph-mon[35058]: Deploying daemon osd.6 on smithi001 2024-09-19T05:15:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:52 smithi082 ceph-mon[35195]: Deploying daemon osd.6 on smithi001 2024-09-19T05:15:54.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:53 smithi060 ceph-mon[35058]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T05:15:54.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:53 smithi082 ceph-mon[35195]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T05:15:54.065 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:53 smithi001 ceph-mon[30968]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T05:15:55.716 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:55 smithi001 ceph-mon[30968]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:56.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:55 smithi060 ceph-mon[35058]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:56.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:55 smithi082 ceph-mon[35195]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:15:58.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:57 smithi060 ceph-mon[35058]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:15:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:57 smithi082 ceph-mon[35195]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:15:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:57 smithi001 ceph-mon[30968]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:15:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:58.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:15:59.908 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:15:59 smithi001 ceph-mon[30968]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:16:00.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:15:59 smithi060 ceph-mon[35058]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:16:00.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:15:59 smithi082 ceph-mon[35195]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:16:00.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.518+0000 7f8bebfff640 1 -- 172.21.15.1:0/3592268912 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8bf41a0840 con 0x7f8be00a3270 2024-09-19T05:16:00.521 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-19T05:16:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 msgr2=0x7f8be00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 0x7f8be00a5730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0314e0 tx=0x7f8bdc000bc0 comp rx=0 tx=0).stop 2024-09-19T05:16:00.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 msgr2=0x7f8bf4197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8be400d950 tx=0x7f8be400de10 comp rx=0 tx=0).stop 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 shutdown_connections 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8be00a3270 0x7f8be00a5730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8bf41026d0 0x7f8bf419f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4101d10 0x7f8bf4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:00.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 --2- 172.21.15.1:0/3592268912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8bf4100b10 0x7f8bf4197fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:00.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 >> 172.21.15.1:0/3592268912 conn(0x7f8bf40fc2a0 msgr2=0x7f8bf406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:00.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 shutdown_connections 2024-09-19T05:16:00.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:00.520+0000 7f8bf97ac640 1 -- 172.21.15.1:0/3592268912 wait complete. 2024-09-19T05:16:01.207 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T05:16:01.210 INFO:tasks.cephadm:Deploying osd.7 on smithi060 with /dev/vg_nvme/lv_2... 2024-09-19T05:16:01.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.399 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.471 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:16:01.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:01.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:02.721 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:16:02 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:16:02.509+0000 7fa75dca2640 -1 osd.6 0 log_to_monitors true 2024-09-19T05:16:03.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:03 smithi060 ceph-mon[35058]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:03.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:03 smithi060 ceph-mon[35058]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:16:03.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:03 smithi001 ceph-mon[30968]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:03.455 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:03 smithi001 ceph-mon[30968]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:16:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:03 smithi082 ceph-mon[35195]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:03 smithi082 ceph-mon[35195]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:16:04.122 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:16:04.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-09-19T05:16:04.406 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:16:04.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:04 smithi060 ceph-mon[35058]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:16:04.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:04 smithi060 ceph-mon[35058]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:16:04.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:04 smithi060 ceph-mon[35058]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:16:04.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:04.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:04 smithi082 ceph-mon[35195]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:16:04.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:04 smithi082 ceph-mon[35195]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:16:04.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:04 smithi082 ceph-mon[35195]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:16:04.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:04.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-mon[30968]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:16:04.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-mon[30968]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:16:04.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-mon[30968]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:16:04.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:04.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 -- 172.21.15.60:0/3043703923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598101d10 msgr2=0x7f9598102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:04.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 --2- 172.21.15.60:0/3043703923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598101d10 0x7f9598102190 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9588009900 tx=0x7f958802a410 comp rx=0 tx=0).stop 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 -- 172.21.15.60:0/3043703923 shutdown_connections 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 --2- 172.21.15.60:0/3043703923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95981026d0 0x7f9598108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 --2- 172.21.15.60:0/3043703923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598101d10 0x7f9598102190 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 --2- 172.21.15.60:0/3043703923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9598100b10 0x7f9598100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 -- 172.21.15.60:0/3043703923 >> 172.21.15.60:0/3043703923 conn(0x7f95980fc2a0 msgr2=0x7f95980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 -- 172.21.15.60:0/3043703923 shutdown_connections 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.897+0000 7f959ffa5640 1 -- 172.21.15.60:0/3043703923 wait complete. 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 Processor -- start 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 -- start start 2024-09-19T05:16:04.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 0x7f959819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95981026d0 0x7f959819f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f959810c790 con 0x7f9598101d10 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f959810c610 con 0x7f9598100b10 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959ffa5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f959810c910 con 0x7f95981026d0 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56946/0 (socket says 172.21.15.60:56946) 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 -- 172.21.15.60:0/2823976332 learned_addr learned my addr 172.21.15.60:0/2823976332 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959d540640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 0x7f959819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:04.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 -- 172.21.15.60:0/2823976332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95981026d0 msgr2=0x7f959819f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95981026d0 0x7f959819f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 -- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 msgr2=0x7f959819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 0x7f959819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959dd41640 1 -- 172.21.15.60:0/2823976332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959819fbf0 con 0x7f9598100b10 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.898+0000 7f959d540640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 0x7f959819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f959dd41640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f959400c970 tx=0x7f959400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594004220 con 0x7f9598100b10 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95940043c0 con 0x7f9598100b10 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959819fe80 con 0x7f9598100b10 2024-09-19T05:16:04.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594004a00 con 0x7f9598100b10 2024-09-19T05:16:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.899+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95981a0280 con 0x7f9598100b10 2024-09-19T05:16:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.900+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9598107f00 con 0x7f9598100b10 2024-09-19T05:16:04.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.901+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f95940079b0 con 0x7f9598100b10 2024-09-19T05:16:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.902+0000 7f958effd640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 0x7f95840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.902+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7f95940ced20 con 0x7f9598100b10 2024-09-19T05:16:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.902+0000 7f959d540640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 0x7f95840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:04.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.902+0000 7f959d540640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 0x7f95840a5700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f95880315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:04.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:04.905+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9594014030 con 0x7f9598100b10 2024-09-19T05:16:05.091 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:16:04.619+0000 7fa759c25640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T05:16:05.091 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:16:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:16:04.628+0000 7fa751a45640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:16:05.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:05.091+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9598062630 con 0x7f95840a3240 2024-09-19T05:16:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi001 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:05.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi001 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:05.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi001 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T05:16:05.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349]' entity='osd.6' 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:05.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] boot 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T05:16:06.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] boot 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T05:16:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:16:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:16:06.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: osd.6 [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] boot 2024-09-19T05:16:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T05:16:06.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/331021867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]': finished 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:16:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/331021867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]': finished 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:16:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:16:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T05:16:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/331021867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]: dispatch 2024-09-19T05:16:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92e56ba4-2266-4114-ae5a-b1ad70466a80"}]': finished 2024-09-19T05:16:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:16:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:09.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:08 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/2286699382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:08 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/2286699382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:09.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:08 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/2286699382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:09.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:09 smithi001 ceph-mon[30968]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:09 smithi060 ceph-mon[35058]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:09 smithi082 ceph-mon[35195]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:11.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:11 smithi060 ceph-mon[35058]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:11 smithi082 ceph-mon[35195]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:11 smithi001 ceph-mon[30968]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:13.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:13 smithi060 ceph-mon[35058]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:13 smithi082 ceph-mon[35195]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:14.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:13 smithi001 ceph-mon[30968]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:15.919 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:15 smithi060 ceph-mon[35058]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:15.919 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:16:15.919 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:15 smithi082 ceph-mon[35195]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:16:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:15 smithi001 ceph-mon[30968]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:16.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:16:16.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.945 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:16 smithi060 ceph-mon[35058]: Deploying daemon osd.7 on smithi060 2024-09-19T05:16:17.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:16 smithi082 ceph-mon[35195]: Deploying daemon osd.7 on smithi060 2024-09-19T05:16:17.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:16 smithi001 ceph-mon[30968]: Deploying daemon osd.7 on smithi060 2024-09-19T05:16:17.903 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:17 smithi060 ceph-mon[35058]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:17 smithi082 ceph-mon[35195]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:17 smithi001 ceph-mon[30968]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:19 smithi060 ceph-mon[35058]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:19 smithi082 ceph-mon[35195]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:19 smithi001 ceph-mon[30968]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:21 smithi060 ceph-mon[35058]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:21 smithi082 ceph-mon[35195]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:21 smithi001 ceph-mon[30968]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:22.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:22.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:23.959 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:23 smithi060 ceph-mon[35058]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:23 smithi082 ceph-mon[35195]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:23 smithi001 ceph-mon[30968]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:24.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.862+0000 7f958effd640 1 -- 172.21.15.60:0/2823976332 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9598062630 con 0x7f95840a3240 2024-09-19T05:16:24.865 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 7 on host 'smithi060' 2024-09-19T05:16:24.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 msgr2=0x7f95840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 0x7f95840a5700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9588000c00 tx=0x7f95880315d0 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 msgr2=0x7f959806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f959400c970 tx=0x7f959400ce30 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 shutdown_connections 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f95840a3240 0x7f95840a5700 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95981026d0 0x7f959819f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9598101d10 0x7f959819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 --2- 172.21.15.60:0/2823976332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598100b10 0x7f959806b2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 >> 172.21.15.60:0/2823976332 conn(0x7f95980fc2a0 msgr2=0x7f95981050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 shutdown_connections 2024-09-19T05:16:24.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:16:24.866+0000 7f959ffa5640 1 -- 172.21.15.60:0/2823976332 wait complete. 2024-09-19T05:16:25.500 DEBUG:teuthology.orchestra.run.smithi060:osd.7> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T05:16:25.502 INFO:tasks.cephadm:Deploying osd.8 on smithi082 with /dev/vg_nvme/lv_2... 2024-09-19T05:16:25.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:16:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:25 smithi060 ceph-mon[35058]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:25 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:16:25.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:25 smithi082 ceph-mon[35195]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:25.876 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:25.877 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:25 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:25 smithi001 ceph-mon[30968]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:26.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:25 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:27.501 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:16:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:16:27.226+0000 7f8b9ca1e640 -1 osd.7 0 log_to_monitors true 2024-09-19T05:16:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:27 smithi082 ceph-mon[35195]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:27 smithi082 ceph-mon[35195]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:27 smithi082 ceph-mon[35195]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:27.915 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:27 smithi060 ceph-mon[35058]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:27.915 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:27 smithi060 ceph-mon[35058]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:27.915 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:27 smithi060 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:27 smithi001 ceph-mon[30968]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:27 smithi001 ceph-mon[30968]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:28.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:27 smithi001 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:16:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:16:28.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-09-19T05:16:28.719 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:16:28.944 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:16:28.944 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:16:28.944 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:28.945 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:28.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:28.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:28.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:28.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:28.946 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:28 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:16:28.675+0000 7f8b989a1640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T05:16:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:16:28.684+0000 7f8b947c9640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:29.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:29.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:28 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:29.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:29.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:28 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.232+0000 7f0c24c85640 1 -- 172.21.15.82:0/83794241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 msgr2=0x7f0c20102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.232+0000 7f0c24c85640 1 --2- 172.21.15.82:0/83794241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c20102150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009900 tx=0x7f0c1402a410 comp rx=0 tx=0).stop 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 -- 172.21.15.82:0/83794241 shutdown_connections 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 --2- 172.21.15.82:0/83794241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20102690 0x7f0c20108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 --2- 172.21.15.82:0/83794241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c20102150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 --2- 172.21.15.82:0/83794241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20100ad0 0x7f0c20100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 -- 172.21.15.82:0/83794241 >> 172.21.15.82:0/83794241 conn(0x7f0c200fc280 msgr2=0x7f0c200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:29.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 -- 172.21.15.82:0/83794241 shutdown_connections 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 -- 172.21.15.82:0/83794241 wait complete. 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 Processor -- start 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.233+0000 7f0c24c85640 1 -- start start 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102690 0x7f0c2019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2010c750 con 0x7f0c20102690 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2010c5d0 con 0x7f0c20100ad0 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c24c85640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2010c8d0 con 0x7f0c20101cd0 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47728/0 (socket says 172.21.15.82:47728) 2024-09-19T05:16:29.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.82:34692/0 (socket says 172.21.15.82:34692) 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1dd9b640 1 -- 172.21.15.82:0/1960309072 learned_addr learned my addr 172.21.15.82:0/1960309072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102690 0x7f0c2019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 -- 172.21.15.82:0/1960309072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 msgr2=0x7f0c201983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 -- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102690 msgr2=0x7f0c2019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102690 0x7f0c2019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 -- 172.21.15.82:0/1960309072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c201030e0 con 0x7f0c20100ad0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1dd9b640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c1e59c640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000e9c0 tx=0x7f0c1000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.234+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000ccc0 con 0x7f0c20100ad0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.235+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c201033d0 con 0x7f0c20100ad0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.235+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c100035f0 con 0x7f0c20100ad0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.235+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000ce60 con 0x7f0c20100ad0 2024-09-19T05:16:29.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.235+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c20103930 con 0x7f0c20100ad0 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.236+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c20103bf0 con 0x7f0c20100ad0 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.237+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0c100037a0 con 0x7f0c20100ad0 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.238+0000 7f0c0f7fe640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 0x7f0c080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.238+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7f0c100cf110 con 0x7f0c20100ad0 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.238+0000 7f0c1dd9b640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 0x7f0c080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:29.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.239+0000 7f0c1dd9b640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 0x7f0c080a5730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031440 tx=0x7f0c140315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:29.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.242+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c1009ca10 con 0x7f0c20100ad0 2024-09-19T05:16:29.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:29.422+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0c20104510 con 0x7f0c080a3270 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi060 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T05:16:29.968 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:29.969 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi060 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:29.993 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:29.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:29.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:29.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:29.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi060 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:30.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:30.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:16:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:16:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:31.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] boot 2024-09-19T05:16:31.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:16:31.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:31.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:16:31.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:16:31.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:31.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] boot 2024-09-19T05:16:31.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:16:31.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:16:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:16:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: osd.7 [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] boot 2024-09-19T05:16:31.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:16:31.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:16:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:31 smithi060 ceph-mon[35058]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:31 smithi060 ceph-mon[35058]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T05:16:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:31 smithi060 ceph-mon[35058]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T05:16:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:31 smithi082 ceph-mon[35195]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:31 smithi082 ceph-mon[35195]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T05:16:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:31 smithi082 ceph-mon[35195]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T05:16:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:31 smithi001 ceph-mon[30968]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:31 smithi001 ceph-mon[30968]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T05:16:32.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:31 smithi001 ceph-mon[30968]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T05:16:33.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/1047646903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]': finished 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:32 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/3557382666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/1047646903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]': finished 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:32 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/3557382666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T05:16:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/1047646903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]: dispatch 2024-09-19T05:16:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92651b21-a5b1-4a2c-9184-f7b0aba6d80b"}]': finished 2024-09-19T05:16:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:16:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:32 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/3557382666' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:35.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:34 smithi060 ceph-mon[35058]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:35.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:34 smithi082 ceph-mon[35195]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:35.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:34 smithi001 ceph-mon[30968]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:37.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:36 smithi082 ceph-mon[35195]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:37.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:36 smithi060 ceph-mon[35058]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:36 smithi001 ceph-mon[30968]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:38.966 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:38 smithi082 ceph-mon[35195]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:39.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:38 smithi060 ceph-mon[35058]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:38 smithi001 ceph-mon[30968]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:40 smithi082 ceph-mon[35195]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:16:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:40 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:40 smithi082 ceph-mon[35195]: Deploying daemon osd.8 on smithi082 2024-09-19T05:16:41.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:40 smithi060 ceph-mon[35058]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:41.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:16:41.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:40 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:40 smithi060 ceph-mon[35058]: Deploying daemon osd.8 on smithi082 2024-09-19T05:16:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:40 smithi001 ceph-mon[30968]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:16:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:40 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:40 smithi001 ceph-mon[30968]: Deploying daemon osd.8 on smithi082 2024-09-19T05:16:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:42 smithi082 ceph-mon[35195]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:43.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:42 smithi060 ceph-mon[35058]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:43.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:42 smithi001 ceph-mon[30968]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:45.176 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:44 smithi082 ceph-mon[35195]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:45.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:44 smithi060 ceph-mon[35058]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:45.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:44 smithi001 ceph-mon[30968]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:47.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:46 smithi082 ceph-mon[35195]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:47.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:47.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:47.127 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:47.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:46 smithi060 ceph-mon[35058]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:47.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:47.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:47.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:46 smithi001 ceph-mon[30968]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:49.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:49.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:49.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:50.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.475+0000 7f0c0f7fe640 1 -- 172.21.15.82:0/1960309072 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0c20104510 con 0x7f0c080a3270 2024-09-19T05:16:50.478 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 8 on host 'smithi082' 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 msgr2=0x7f0c080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 0x7f0c080a5730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031440 tx=0x7f0c140315b0 comp rx=0 tx=0).stop 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 msgr2=0x7f0c20197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000e9c0 tx=0x7f0c1000ee80 comp rx=0 tx=0).stop 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 shutdown_connections 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0c080a3270 0x7f0c080a5730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:50.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0c20102690 0x7f0c2019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:50.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c20101cd0 0x7f0c201983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:50.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 --2- 172.21.15.82:0/1960309072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c20100ad0 0x7f0c20197ea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:50.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 >> 172.21.15.82:0/1960309072 conn(0x7f0c200fc280 msgr2=0x7f0c200fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:50.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 shutdown_connections 2024-09-19T05:16:50.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:16:50.477+0000 7f0c24c85640 1 -- 172.21.15.82:0/1960309072 wait complete. 2024-09-19T05:16:51.066 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:50 smithi082 ceph-mon[35195]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:51.067 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:51.067 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.067 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.093 DEBUG:teuthology.orchestra.run.smithi082:osd.8> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T05:16:51.096 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-19T05:16:51.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:16:51.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:50 smithi060 ceph-mon[35058]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:51.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:51.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:50 smithi001 ceph-mon[30968]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:51.363 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:52.625 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:16:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:16:52.467+0000 7ff1eff35640 -1 osd.8 0 log_to_monitors true 2024-09-19T05:16:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:52 smithi001 ceph-mon[30968]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:52 smithi001 ceph-mon[30968]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:52 smithi001 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:53.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:52 smithi060 ceph-mon[35058]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:52 smithi060 ceph-mon[35058]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:52 smithi060 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:53.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:52 smithi082 ceph-mon[35195]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:53.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:52 smithi082 ceph-mon[35195]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:53.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:52 smithi082 ceph-mon[35195]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:16:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:53 smithi001 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:16:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:53 smithi001 ceph-mon[30968]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:16:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:54.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:53 smithi001 ceph-mon[30968]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:53 smithi001 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.200 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:16:53.925+0000 7ff1ebeb8640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T05:16:54.201 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:16:53.934+0000 7ff1e7ce0640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:16:54.201 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-mon[35195]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:16:54.203 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-mon[35195]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:16:54.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:54.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-mon[35195]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.204 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:53 smithi082 ceph-mon[35195]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.240 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:16:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:53 smithi060 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:16:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:53 smithi060 ceph-mon[35058]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:16:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:53 smithi060 ceph-mon[35058]: from='osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:53 smithi060 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:16:54.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-19T05:16:54.533 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:55.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- 172.21.15.1:0/2529816748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0104f90 msgr2=0x7f82d0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:55.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 --2- 172.21.15.1:0/2529816748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0104f90 0x7f82d0107380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009900 tx=0x7f82b802a410 comp rx=0 tx=0).stop 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- 172.21.15.1:0/2529816748 shutdown_connections 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 --2- 172.21.15.1:0/2529816748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 0x7f82d0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 --2- 172.21.15.1:0/2529816748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0104f90 0x7f82d0107380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 --2- 172.21.15.1:0/2529816748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0102660 0x7f82d0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- 172.21.15.1:0/2529816748 >> 172.21.15.1:0/2529816748 conn(0x7f82d00fc280 msgr2=0x7f82d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- 172.21.15.1:0/2529816748 shutdown_connections 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- 172.21.15.1:0/2529816748 wait complete. 2024-09-19T05:16:55.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 Processor -- start 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.009+0000 7f82d61d3640 1 -- start start 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0104f90 0x7f82d0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 0x7f82d019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d840 con 0x7f82d0102660 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d6c0 con 0x7f82d0104f90 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82d61d3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82d010d9c0 con 0x7f82d01078c0 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51958/0 (socket says 172.21.15.1:51958) 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 -- 172.21.15.1:0/978652400 learned_addr learned my addr 172.21.15.1:0/978652400 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cffff640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 0x7f82d019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:55.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82c6ffd640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0104f90 0x7f82d0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 -- 172.21.15.1:0/978652400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 msgr2=0x7f82d019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 0x7f82d019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 -- 172.21.15.1:0/978652400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0104f90 msgr2=0x7f82d0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0104f90 0x7f82d0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 -- 172.21.15.1:0/978652400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d019fb80 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.010+0000 7f82cf7fe640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d950 tx=0x7f82c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.011+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0017070 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.011+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d019fe70 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.011+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82c0009c30 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.011+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c000f6b0 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.011+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d01a02c0 con 0x7f82d0102660 2024-09-19T05:16:55.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.012+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d00fdd70 con 0x7f82d0102660 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.013+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f82c00109d0 con 0x7f82d0102660 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.014+0000 7f82cd7fa640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.014+0000 7f82c6ffd640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.014+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5862+0+0 (secure 0 0 0) 0x7f82c00cead0 con 0x7f82d0102660 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.014+0000 7f82c6ffd640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 0x7f82bc0a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005ab0 tx=0x7f82b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.018+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82c0009de0 con 0x7f82d0102660 2024-09-19T05:16:55.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:16:55.202+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f82d0062630 con 0x7f82bc0a3270 2024-09-19T05:16:55.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:55.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi082 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 5696M 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:55.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:55.207 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.207 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] boot 2024-09-19T05:16:55.207 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:16:55.207 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi082 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 5696M 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] boot 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:16:55.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi082 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 5696M 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: osd.8 [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] boot 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:16:55.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:16:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:16:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:16:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:56.305 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:57.009 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:56 smithi001 ceph-mon[30968]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:57.010 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:56 smithi001 ceph-mon[30968]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T05:16:57.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:56 smithi060 ceph-mon[35058]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:57.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:56 smithi060 ceph-mon[35058]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T05:16:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:56 smithi082 ceph-mon[35195]: pgmap v190: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:56 smithi082 ceph-mon[35195]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T05:16:58.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:57 smithi060 ceph-mon[35058]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T05:16:58.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:57 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]: dispatch 2024-09-19T05:16:58.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:57 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]': finished 2024-09-19T05:16:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:57 smithi060 ceph-mon[35058]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:16:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:16:58.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:57 smithi082 ceph-mon[35195]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T05:16:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:57 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]: dispatch 2024-09-19T05:16:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:57 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]': finished 2024-09-19T05:16:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:57 smithi082 ceph-mon[35195]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:16:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:16:58.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:57 smithi001 ceph-mon[30968]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T05:16:58.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:57 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]: dispatch 2024-09-19T05:16:58.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:57 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1017064345' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129"}]': finished 2024-09-19T05:16:58.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:57 smithi001 ceph-mon[30968]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:16:58.339 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:16:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:58 smithi060 ceph-mon[35058]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:58 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/998938704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:58 smithi060 ceph-mon[35058]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:16:59.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:16:58 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:16:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:58 smithi082 ceph-mon[35195]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:58 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/998938704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:58 smithi082 ceph-mon[35195]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:16:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:16:58 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:16:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:58 smithi001 ceph-mon[30968]: pgmap v194: 1 pgs: 1 peering; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:16:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:58 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/998938704' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:58 smithi001 ceph-mon[30968]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:16:59.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:16:58 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:00 smithi060 ceph-mon[35058]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:17:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:00 smithi082 ceph-mon[35195]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:17:01.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:00 smithi001 ceph-mon[30968]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:17:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:02 smithi060 ceph-mon[35058]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T05:17:03.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:02 smithi082 ceph-mon[35195]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T05:17:03.258 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:02 smithi001 ceph-mon[30968]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T05:17:05.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:04 smithi060 ceph-mon[35058]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:17:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:04 smithi082 ceph-mon[35195]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:17:05.301 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:04 smithi001 ceph-mon[30968]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:17:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:06 smithi001 ceph-mon[30968]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:17:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:17:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:07.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:06 smithi060 ceph-mon[35058]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:17:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:17:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:06 smithi082 ceph-mon[35195]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:17:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:17:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:08.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:07 smithi060 ceph-mon[35058]: Deploying daemon osd.9 on smithi001 2024-09-19T05:17:08.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:07 smithi082 ceph-mon[35195]: Deploying daemon osd.9 on smithi001 2024-09-19T05:17:08.259 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:07 smithi001 ceph-mon[30968]: Deploying daemon osd.9 on smithi001 2024-09-19T05:17:09.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:08 smithi060 ceph-mon[35058]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:17:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:08 smithi082 ceph-mon[35195]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:17:09.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:08 smithi001 ceph-mon[30968]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:17:11.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:10 smithi001 ceph-mon[30968]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:17:11.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:10 smithi060 ceph-mon[35058]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:17:11.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:10 smithi082 ceph-mon[35195]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:17:13.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:12 smithi060 ceph-mon[35058]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:13.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:12 smithi082 ceph-mon[35195]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:12 smithi001 ceph-mon[30968]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:15.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:14 smithi001 ceph-mon[30968]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:15.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:14 smithi060 ceph-mon[35058]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:15.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:14 smithi082 ceph-mon[35195]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:16.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.651+0000 7f82cd7fa640 1 -- 172.21.15.1:0/978652400 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82d0062630 con 0x7f82bc0a3270 2024-09-19T05:17:16.654 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.653+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 msgr2=0x7f82bc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 0x7f82bc0a5730 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005ab0 tx=0x7f82b8000bc0 comp rx=0 tx=0).stop 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 msgr2=0x7f82d0197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82c000d950 tx=0x7f82c000de10 comp rx=0 tx=0).stop 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 shutdown_connections 2024-09-19T05:17:16.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3270 0x7f82bc0a5730 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82d01078c0 0x7f82d019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82d0104f90 0x7f82d0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 --2- 172.21.15.1:0/978652400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82d0102660 0x7f82d0197f50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 >> 172.21.15.1:0/978652400 conn(0x7f82d00fc280 msgr2=0x7f82d0103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 shutdown_connections 2024-09-19T05:17:16.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:17:16.654+0000 7f82d61d3640 1 -- 172.21.15.1:0/978652400 wait complete. 2024-09-19T05:17:17.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:17.402 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T05:17:17.405 INFO:tasks.cephadm:Deploying osd.10 on smithi060 with /dev/vg_nvme/lv_1... 2024-09-19T05:17:17.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:17:17.667 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:17:19.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:18 smithi060 ceph-mon[35058]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:19.177 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:18 smithi001 ceph-mon[30968]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:18 smithi082 ceph-mon[35195]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:19.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:17:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:17:19.253+0000 7f356127a640 -1 osd.9 0 log_to_monitors true 2024-09-19T05:17:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:19 smithi001 ceph-mon[30968]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:17:20.198 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:19 smithi060 ceph-mon[35058]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:17:20.201 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-19T05:17:20.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-09-19T05:17:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:19 smithi082 ceph-mon[35195]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:17:20.486 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 -- 172.21.15.60:0/1229267110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404100ad0 msgr2=0x7fb404100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 --2- 172.21.15.60:0/1229267110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404100ad0 0x7fb404100ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009900 tx=0x7fb3f402a410 comp rx=0 tx=0).stop 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 -- 172.21.15.60:0/1229267110 shutdown_connections 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 --2- 172.21.15.60:0/1229267110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404102690 0x7fb404108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 --2- 172.21.15.60:0/1229267110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404101cd0 0x7fb404102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 --2- 172.21.15.60:0/1229267110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404100ad0 0x7fb404100ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 -- 172.21.15.60:0/1229267110 >> 172.21.15.60:0/1229267110 conn(0x7fb4040fc280 msgr2=0x7fb4040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 -- 172.21.15.60:0/1229267110 shutdown_connections 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.937+0000 7fb408e3c640 1 -- 172.21.15.60:0/1229267110 wait complete. 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 Processor -- start 2024-09-19T05:17:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 -- start start 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404100ad0 0x7fb404197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404101cd0 0x7fb404198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d8e0 con 0x7fb404101cd0 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d760 con 0x7fb404102690 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.938+0000 7fb408e3c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410da60 con 0x7fb404100ad0 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40348/0 (socket says 172.21.15.60:40348) 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 -- 172.21.15.60:0/2060944417 learned_addr learned my addr 172.21.15.60:0/2060944417 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb40259c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404100ad0 0x7fb404197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb401d9b640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404101cd0 0x7fb404198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 -- 172.21.15.60:0/2060944417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404100ad0 msgr2=0x7fb404197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404100ad0 0x7fb404197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 -- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404101cd0 msgr2=0x7fb404198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404101cd0 0x7fb404198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 -- 172.21.15.60:0/2060944417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40419fb20 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb402d9d640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00eb10 tx=0x7fb3fc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc004b20 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3fc004cc0 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419fe10 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc010760 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.939+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041a0270 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.940+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404107e80 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.941+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb3fc004fe0 con 0x7fb404102690 2024-09-19T05:17:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.942+0000 7fb3f37fe640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 0x7fb3ec0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.942+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7fb3fc0cf550 con 0x7fb404102690 2024-09-19T05:17:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.942+0000 7fb40259c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 0x7fb3ec0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.943+0000 7fb40259c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 0x7fb3ec0a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb3f402aa00 tx=0x7fb3f40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:20.947+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3fc09cb90 con 0x7fb404102690 2024-09-19T05:17:21.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:21.132+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb404062630 con 0x7fb3ec0a3270 2024-09-19T05:17:21.134 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi001 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T05:17:21.135 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.136 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:21.136 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:21.136 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi001 2024-09-19T05:17:21.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:21.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:17:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:17:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi001 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:21.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:21.841 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:17:21.351+0000 7f355d1fd640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T05:17:21.841 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:17:21.364+0000 7f355501d640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:17:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:21 smithi060 ceph-mon[35058]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:21 smithi082 ceph-mon[35195]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' 2024-09-19T05:17:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T05:17:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T05:17:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:21 smithi001 ceph-mon[30968]: from='osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925]' entity='osd.9' 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] boot 2024-09-19T05:17:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T05:17:23.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] boot 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T05:17:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:17:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:17:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:17:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: osd.9 [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] boot 2024-09-19T05:17:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T05:17:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:17:24.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:23 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/412041416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:23 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:23 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]': finished 2024-09-19T05:17:24.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:23 smithi060 ceph-mon[35058]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:17:24.160 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:23 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/412041416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:23 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:23 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]': finished 2024-09-19T05:17:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:23 smithi082 ceph-mon[35195]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:17:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:23 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/412041416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:23 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]: dispatch 2024-09-19T05:17:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:23 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d933695-bb7f-45e0-a78b-63c8c46416cb"}]': finished 2024-09-19T05:17:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:23 smithi001 ceph-mon[30968]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:17:24.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:25.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:24 smithi060 ceph-mon[35058]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:25.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:24 smithi060 ceph-mon[35058]: from='client.? 172.21.15.60:0/3306800853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:24 smithi082 ceph-mon[35195]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:24 smithi082 ceph-mon[35195]: from='client.? 172.21.15.60:0/3306800853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:25.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:24 smithi001 ceph-mon[30968]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:25.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:24 smithi001 ceph-mon[30968]: from='client.? 172.21.15.60:0/3306800853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:27.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:26 smithi060 ceph-mon[35058]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:27.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:26 smithi082 ceph-mon[35195]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:27.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:26 smithi001 ceph-mon[30968]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:29.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:28 smithi060 ceph-mon[35058]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:29.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:28 smithi082 ceph-mon[35195]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:29.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:28 smithi001 ceph-mon[30968]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:31.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:30 smithi060 ceph-mon[35058]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:30 smithi082 ceph-mon[35195]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:31.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:30 smithi001 ceph-mon[30968]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:33.229 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:32 smithi060 ceph-mon[35058]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:33.229 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:17:33.229 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:33.229 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:32 smithi060 ceph-mon[35058]: Deploying daemon osd.10 on smithi060 2024-09-19T05:17:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:32 smithi082 ceph-mon[35195]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:17:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:32 smithi082 ceph-mon[35195]: Deploying daemon osd.10 on smithi060 2024-09-19T05:17:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:32 smithi001 ceph-mon[30968]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:17:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:32 smithi001 ceph-mon[30968]: Deploying daemon osd.10 on smithi060 2024-09-19T05:17:35.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:34 smithi060 ceph-mon[35058]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:34 smithi082 ceph-mon[35195]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:35.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:34 smithi001 ceph-mon[30968]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:37.230 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:36 smithi060 ceph-mon[35058]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:37.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:36 smithi082 ceph-mon[35195]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:36 smithi001 ceph-mon[30968]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:37 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:37 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:37 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:38.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:37 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:37 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:37 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:37 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:37 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:37 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:39.234 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:38 smithi060 ceph-mon[35058]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:39.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:38 smithi082 ceph-mon[35195]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:38 smithi001 ceph-mon[30968]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.419+0000 7fb3f37fe640 1 -- 172.21.15.60:0/2060944417 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb404062630 con 0x7fb3ec0a3270 2024-09-19T05:17:41.421 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 10 on host 'smithi060' 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 msgr2=0x7fb3ec0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 0x7fb3ec0a5730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb3f402aa00 tx=0x7fb3f40315b0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 msgr2=0x7fb40419f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00eb10 tx=0x7fb3fc00c2d0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 shutdown_connections 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb3ec0a3270 0x7fb3ec0a5730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb404102690 0x7fb40419f4b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb404101cd0 0x7fb404198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 --2- 172.21.15.60:0/2060944417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb404100ad0 0x7fb404197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 >> 172.21.15.60:0/2060944417 conn(0x7fb4040fc280 msgr2=0x7fb404105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 shutdown_connections 2024-09-19T05:17:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-19T05:17:41.421+0000 7fb408e3c640 1 -- 172.21.15.60:0/2060944417 wait complete. 2024-09-19T05:17:41.741 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:41.741 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.741 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.741 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:41.741 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:41.742 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.742 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:41.742 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.742 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:41.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:42.052 DEBUG:teuthology.orchestra.run.smithi060:osd.10> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T05:17:42.054 INFO:tasks.cephadm:Deploying osd.11 on smithi082 with /dev/vg_nvme/lv_1... 2024-09-19T05:17:42.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:17:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:17:43.708 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:43 smithi082 ceph-mon[35195]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:43 smithi060 ceph-mon[35058]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:43 smithi001 ceph-mon[30968]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:17:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:17:44.124+0000 7f018bdb3640 -1 osd.10 0 log_to_monitors true 2024-09-19T05:17:44.825 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:44 smithi060 ceph-mon[35058]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:44.825 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:44 smithi060 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:45.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:44 smithi082 ceph-mon[35195]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:45.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:44 smithi082 ceph-mon[35195]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:45.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:44 smithi001 ceph-mon[30968]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:45.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:44 smithi001 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:17:45.181 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-19T05:17:45.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-09-19T05:17:45.452 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:46.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:46.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:45 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:46.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:45 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:17:46.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:46.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:46.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:45 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:17:46.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 -- 172.21.15.82:0/39629631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c101cd0 msgr2=0x7f024c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 --2- 172.21.15.82:0/39629631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c101cd0 0x7f024c102150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0234009900 tx=0x7f023402a410 comp rx=0 tx=0).stop 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 -- 172.21.15.82:0/39629631 shutdown_connections 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 --2- 172.21.15.82:0/39629631 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c102690 0x7f024c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 --2- 172.21.15.82:0/39629631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c101cd0 0x7f024c102150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 --2- 172.21.15.82:0/39629631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c100ad0 0x7f024c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 -- 172.21.15.82:0/39629631 >> 172.21.15.82:0/39629631 conn(0x7f024c0fc280 msgr2=0x7f024c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 -- 172.21.15.82:0/39629631 shutdown_connections 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 -- 172.21.15.82:0/39629631 wait complete. 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.100+0000 7f0251719640 1 Processor -- start 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 -- start start 2024-09-19T05:17:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 0x7f024c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 0x7f024c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10c7d0 con 0x7f024c100ad0 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10c650 con 0x7f024c101cd0 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0251719640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f024c10c950 con 0x7f024c102690 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0243fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 0x7f024c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36818/0 (socket says 172.21.15.82:36818) 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 -- 172.21.15.82:0/1502940676 learned_addr learned my addr 172.21.15.82:0/1502940676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024affd640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 0x7f024c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 -- 172.21.15.82:0/1502940676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 msgr2=0x7f024c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 0x7f024c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 -- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 msgr2=0x7f024c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 0x7f024c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 -- 172.21.15.82:0/1502940676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c19fbe0 con 0x7f024c102690 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024affd640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 0x7f024c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0243fff640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 0x7f024c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f024b7fe640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f024400b970 tx=0x7f024400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.101+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244019070 con 0x7f024c102690 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.102+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c19fe70 con 0x7f024c102690 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.102+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f024400cb40 con 0x7f024c102690 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.102+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244007650 con 0x7f024c102690 2024-09-19T05:17:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.102+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1a03a0 con 0x7f024c102690 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.103+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c107ea0 con 0x7f024c102690 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.104+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f024401c070 con 0x7f024c102690 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.104+0000 7f0248ff9640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 0x7f02380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.104+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f02440ce710 con 0x7f024c102690 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.105+0000 7f024affd640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 0x7f02380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.105+0000 7f024affd640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 0x7f02380a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f024c101b30 tx=0x7f023c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.109+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f024409b550 con 0x7f024c102690 2024-09-19T05:17:46.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:17:46.282+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f024c062630 con 0x7f02380a3240 2024-09-19T05:17:46.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:17:46.090+0000 7f0187d36640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T05:17:46.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:17:46.103+0000 7f017fb56640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:17:46.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi060 2024-09-19T05:17:46.936 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='osd.10 ' entity='osd.10' 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:46.937 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi060 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='osd.10 ' entity='osd.10' 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:47.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:47.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi060 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='osd.10 ' entity='osd.10' 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:17:47.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:17:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:17:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] boot 2024-09-19T05:17:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:17:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:47 smithi082 ceph-mon[35195]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T05:17:48.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] boot 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:47 smithi060 ceph-mon[35058]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T05:17:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:17:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 307 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: osd.10 [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] boot 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:17:48.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:47 smithi001 ceph-mon[30968]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/162303044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]': finished 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:17:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:48 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:17:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T05:17:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/162303044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]': finished 2024-09-19T05:17:49.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:17:49.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:48 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:17:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T05:17:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/162303044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]: dispatch 2024-09-19T05:17:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a116c52-7fb1-4b79-af77-9624f9bf686e"}]': finished 2024-09-19T05:17:49.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:17:49.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:48 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:50.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:49 smithi060 ceph-mon[35058]: from='client.? 172.21.15.82:0/3718492608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:49 smithi060 ceph-mon[35058]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:17:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:50.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:49 smithi082 ceph-mon[35195]: from='client.? 172.21.15.82:0/3718492608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:49 smithi082 ceph-mon[35195]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:17:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:49 smithi001 ceph-mon[30968]: from='client.? 172.21.15.82:0/3718492608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:17:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:49 smithi001 ceph-mon[30968]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:17:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:17:51.158 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:50 smithi082 ceph-mon[35195]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-19T05:17:51.177 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:50 smithi060 ceph-mon[35058]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-19T05:17:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:50 smithi001 ceph-mon[30968]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-19T05:17:53.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:52 smithi060 ceph-mon[35058]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T05:17:53.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:52 smithi082 ceph-mon[35195]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T05:17:53.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:52 smithi001 ceph-mon[30968]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-19T05:17:55.215 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:54 smithi082 ceph-mon[35195]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:17:55.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:54 smithi060 ceph-mon[35058]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:17:55.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:54 smithi001 ceph-mon[30968]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:17:57.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:56 smithi060 ceph-mon[35058]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T05:17:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:56 smithi082 ceph-mon[35195]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T05:17:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:56 smithi001 ceph-mon[30968]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T05:17:58.040 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:17:58.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:58.041 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:57 smithi082 ceph-mon[35195]: Deploying daemon osd.11 on smithi082 2024-09-19T05:17:58.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:17:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:57 smithi060 ceph-mon[35058]: Deploying daemon osd.11 on smithi082 2024-09-19T05:17:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:17:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:57 smithi001 ceph-mon[30968]: Deploying daemon osd.11 on smithi082 2024-09-19T05:17:59.101 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:17:58 smithi082 ceph-mon[35195]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T05:17:59.242 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:17:58 smithi001 ceph-mon[30968]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T05:17:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:17:58 smithi060 ceph-mon[35058]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T05:18:01.174 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:00 smithi082 ceph-mon[35195]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:00 smithi060 ceph-mon[35058]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:00 smithi001 ceph-mon[30968]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:02 smithi060 ceph-mon[35058]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:03.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:02 smithi082 ceph-mon[35195]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:02 smithi001 ceph-mon[30968]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:04.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:03 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:03 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:04.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:03 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:04.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:03 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:03 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:03 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:04.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:03 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:03 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:04.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:03 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:05 smithi001 ceph-mon[30968]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:06.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:05 smithi060 ceph-mon[35058]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:05 smithi082 ceph-mon[35195]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:07.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.551+0000 7f0248ff9640 1 -- 172.21.15.82:0/1502940676 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f024c062630 con 0x7f02380a3240 2024-09-19T05:18:07.553 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 11 on host 'smithi082' 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 msgr2=0x7f02380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 0x7f02380a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f024c101b30 tx=0x7f023c005f90 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 msgr2=0x7f024c19f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f024400b970 tx=0x7f024400be30 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 shutdown_connections 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02380a3240 0x7f02380a5700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c102690 0x7f024c19f2d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f024c101cd0 0x7f024c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 --2- 172.21.15.82:0/1502940676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f024c100ad0 0x7f024c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 >> 172.21.15.82:0/1502940676 conn(0x7f024c0fc280 msgr2=0x7f024c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:07.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 shutdown_connections 2024-09-19T05:18:07.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:07.553+0000 7f0251719640 1 -- 172.21.15.82:0/1502940676 wait complete. 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:07.907 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:07.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:07.908 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:08.260 DEBUG:teuthology.orchestra.run.smithi082:osd.11> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T05:18:08.262 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T05:18:08.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T05:18:08.531 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.013+0000 7f5b3089e640 1 -- 172.21.15.1:0/787075975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c1026d0 msgr2=0x7f5b2c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.013+0000 7f5b3089e640 1 --2- 172.21.15.1:0/787075975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c108f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009be0 tx=0x7f5b2402a6c0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 -- 172.21.15.1:0/787075975 shutdown_connections 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 --2- 172.21.15.1:0/787075975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c108f60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 --2- 172.21.15.1:0/787075975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c101d10 0x7f5b2c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 --2- 172.21.15.1:0/787075975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c100b10 0x7f5b2c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 -- 172.21.15.1:0/787075975 >> 172.21.15.1:0/787075975 conn(0x7f5b2c0fc2a0 msgr2=0x7f5b2c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:09.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 -- 172.21.15.1:0/787075975 shutdown_connections 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 -- 172.21.15.1:0/787075975 wait complete. 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 Processor -- start 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 -- start start 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.014+0000 7f5b3089e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 0x7f5b2c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c19f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10c720 con 0x7f5b2c100b10 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10c5a0 con 0x7f5b2c1026d0 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10c8a0 con 0x7f5b2c101d10 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57996/0 (socket says 172.21.15.1:57996) 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 -- 172.21.15.1:0/2417619267 learned_addr learned my addr 172.21.15.1:0/2417619267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:09.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b29d9b640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 0x7f5b2c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2ad9d640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c19f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 -- 172.21.15.1:0/2417619267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 msgr2=0x7f5b2c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 0x7f5b2c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 -- 172.21.15.1:0/2417619267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c1026d0 msgr2=0x7f5b2c19f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c19f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 -- 172.21.15.1:0/2417619267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c19fb30 con 0x7f5b2c100b10 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b29d9b640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 0x7f5b2c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b2a59c640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e9f0 tx=0x7f5b1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00ccc0 con 0x7f5b2c100b10 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b1c0035f0 con 0x7f5b2c100b10 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c19fdc0 con 0x7f5b2c100b10 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00ce60 con 0x7f5b2c100b10 2024-09-19T05:18:09.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.015+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c1a0280 con 0x7f5b2c100b10 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.017+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c107f60 con 0x7f5b2c100b10 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.018+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5b1c0037a0 con 0x7f5b2c100b10 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.019+0000 7f5b1b7fe640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 0x7f5b140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.019+0000 7f5b29d9b640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 0x7f5b140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.019+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f5b1c0cf580 con 0x7f5b2c100b10 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.019+0000 7f5b29d9b640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 0x7f5b140a5780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06b870 tx=0x7f5b2000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:09.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.023+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b1c09c880 con 0x7f5b2c100b10 2024-09-19T05:18:09.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.198+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5b2c02da70 con 0x7f5b2c100b10 2024-09-19T05:18:09.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.198+0000 7f5b1b7fe640 1 -- 172.21.15.1:0/2417619267 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f5b1c09c180 con 0x7f5b2c100b10 2024-09-19T05:18:09.200 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 msgr2=0x7f5b140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 0x7f5b140a5780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06b870 tx=0x7f5b2000a2d0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 msgr2=0x7f5b2c06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00e9f0 tx=0x7f5b1c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 shutdown_connections 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5b140a32c0 0x7f5b140a5780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b2c1026d0 0x7f5b2c19f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2c101d10 0x7f5b2c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 --2- 172.21.15.1:0/2417619267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b2c100b10 0x7f5b2c06b2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 >> 172.21.15.1:0/2417619267 conn(0x7f5b2c0fc2a0 msgr2=0x7f5b2c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 shutdown_connections 2024-09-19T05:18:09.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:09.200+0000 7f5b3089e640 1 -- 172.21.15.1:0/2417619267 wait complete. 2024-09-19T05:18:09.670 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:18:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:18:09.361+0000 7faea2ed4640 -1 osd.11 0 log_to_monitors true 2024-09-19T05:18:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:09 smithi001 ceph-mon[30968]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:09 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2417619267' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:09.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:09 smithi001 ceph-mon[30968]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:09.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:09 smithi001 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:09.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:09 smithi082 ceph-mon[35195]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:09.960 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:09 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2417619267' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:09.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:09 smithi082 ceph-mon[35195]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:09.961 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:09 smithi082 ceph-mon[35195]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:09.969 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726723066,"num_in_osds":12,"osd_in_since":1726723068,"num_remapped_pgs":0} 2024-09-19T05:18:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:09 smithi060 ceph-mon[35058]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:09 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2417619267' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:09 smithi060 ceph-mon[35058]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:09 smithi060 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:18:10.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:18:10.674+0000 7fae9ee57640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T05:18:10.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:18:10.687+0000 7fae9ac7f640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:18:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-mon[35195]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:18:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-mon[35195]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:18:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-mon[35195]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:10.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:10 smithi082 ceph-mon[35195]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:10.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T05:18:11.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:10 smithi001 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:18:11.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:10 smithi001 ceph-mon[30968]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:18:11.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:10 smithi001 ceph-mon[30968]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:10 smithi001 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:10 smithi060 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:10 smithi060 ceph-mon[35058]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:10 smithi060 ceph-mon[35058]: from='osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:10 smithi060 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-19T05:18:11.244 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.715+0000 7fd41b663640 1 -- 172.21.15.1:0/4050376131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4141037c0 msgr2=0x7fd41410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.715+0000 7fd41b663640 1 --2- 172.21.15.1:0/4050376131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4141037c0 0x7fd41410a050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009ca0 tx=0x7fd40c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 -- 172.21.15.1:0/4050376131 shutdown_connections 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 --2- 172.21.15.1:0/4050376131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4141037c0 0x7fd41410a050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 --2- 172.21.15.1:0/4050376131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 0x7fd414103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 --2- 172.21.15.1:0/4050376131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd414101c00 0x7fd414102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 -- 172.21.15.1:0/4050376131 >> 172.21.15.1:0/4050376131 conn(0x7fd4140fd390 msgr2=0x7fd4140ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 -- 172.21.15.1:0/4050376131 shutdown_connections 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 -- 172.21.15.1:0/4050376131 wait complete. 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 Processor -- start 2024-09-19T05:18:11.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.716+0000 7fd41b663640 1 -- start start 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 0x7fd4141983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4141037c0 0x7fd41419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd41410d860 con 0x7fd414101c00 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd41410d6e0 con 0x7fd414102e00 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd41410d9e0 con 0x7fd4141037c0 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58024/0 (socket says 172.21.15.1:58024) 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 -- 172.21.15.1:0/399624925 learned_addr learned my addr 172.21.15.1:0/399624925 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:11.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd418bfe640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 0x7fd4141983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd419c00640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4141037c0 0x7fd41419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 -- 172.21.15.1:0/399624925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4141037c0 msgr2=0x7fd41419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4141037c0 0x7fd41419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 -- 172.21.15.1:0/399624925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 msgr2=0x7fd4141983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 0x7fd4141983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 -- 172.21.15.1:0/399624925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41419fab0 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd4193ff640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c970 tx=0x7fd41000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410004220 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41419fda0 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4100043c0 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.717+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41000f450 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.718+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141a0200 con 0x7fd414101c00 2024-09-19T05:18:11.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.719+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd414109000 con 0x7fd414101c00 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.720+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd4100079b0 con 0x7fd414101c00 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.720+0000 7fd40a7fc640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 0x7fd4000a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.721+0000 7fd418bfe640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 0x7fd4000a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.721+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd4100cf100 con 0x7fd414101c00 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.721+0000 7fd418bfe640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 0x7fd4000a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4141993a0 tx=0x7fd40400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:11.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.725+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd410014030 con 0x7fd414101c00 2024-09-19T05:18:11.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.902+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd41402da70 con 0x7fd414101c00 2024-09-19T05:18:11.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:11.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:18:11.904 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:11.905 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:11.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.903+0000 7fd40a7fc640 1 -- 172.21.15.1:0/399624925 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fd41009bc70 con 0x7fd414101c00 2024-09-19T05:18:11.906 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 msgr2=0x7fd4000a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 0x7fd4000a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4141993a0 tx=0x7fd40400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 msgr2=0x7fd414197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c970 tx=0x7fd41000ce30 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 shutdown_connections 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd4000a3270 0x7fd4000a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4141037c0 0x7fd41419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd414102e00 0x7fd4141983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 --2- 172.21.15.1:0/399624925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd414101c00 0x7fd414197e80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 >> 172.21.15.1:0/399624925 conn(0x7fd4140fd390 msgr2=0x7fd4141061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 shutdown_connections 2024-09-19T05:18:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:11.906+0000 7fd41b663640 1 -- 172.21.15.1:0/399624925 wait complete. 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:18:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:12.630 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726723091,"num_in_osds":12,"osd_in_since":1726723068,"num_remapped_pgs":0} 2024-09-19T05:18:12.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:18:12.932 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:13.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: purged_snaps scrub starts 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: purged_snaps scrub ok 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: Detected new or changed devices on smithi082 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 4272M 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] boot 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:12 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/399624925' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: purged_snaps scrub starts 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: purged_snaps scrub ok 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: Detected new or changed devices on smithi082 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 4272M 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] boot 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:12 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/399624925' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: purged_snaps scrub starts 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: purged_snaps scrub ok 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: Detected new or changed devices on smithi082 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 4272M 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: osd.11 [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] boot 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:18:13.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:12 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/399624925' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 -- 172.21.15.1:0/3687987521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc106f30 msgr2=0x7fd7dc10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/3687987521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc106f30 0x7fd7dc10eab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009ca0 tx=0x7fd7d402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 -- 172.21.15.1:0/3687987521 shutdown_connections 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/3687987521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc106f30 0x7fd7dc10eab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/3687987521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 0x7fd7dc106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/3687987521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc100310 0x7fd7dc1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 -- 172.21.15.1:0/3687987521 >> 172.21.15.1:0/3687987521 conn(0x7fd7dc077210 msgr2=0x7fd7dc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 -- 172.21.15.1:0/3687987521 shutdown_connections 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.407+0000 7fd7e1b39640 1 -- 172.21.15.1:0/3687987521 wait complete. 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 Processor -- start 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 -- start start 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 0x7fd7dc1017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc106f30 0x7fd7dc101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc111f90 con 0x7fd7dc100310 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc111e10 con 0x7fd7dc100cc0 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7e1b39640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7dc112110 con 0x7fd7dc106f30 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58042/0 (socket says 172.21.15.1:58042) 2024-09-19T05:18:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 -- 172.21.15.1:0/1599463713 learned_addr learned my addr 172.21.15.1:0/1599463713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7dbfff640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc106f30 0x7fd7dc101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7daffd640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 0x7fd7dc1017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 -- 172.21.15.1:0/1599463713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc106f30 msgr2=0x7fd7dc101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc106f30 0x7fd7dc101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 -- 172.21.15.1:0/1599463713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 msgr2=0x7fd7dc1017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 0x7fd7dc1017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.408+0000 7fd7db7fe640 1 -- 172.21.15.1:0/1599463713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7dc1a6940 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7db7fe640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c970 tx=0x7fd7cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc007bb0 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7cc007d50 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7dc1a6c30 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00f450 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.409+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7dc1a7120 con 0x7fd7dc100310 2024-09-19T05:18:13.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.410+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7dc1006f0 con 0x7fd7dc100310 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.411+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd7cc004fe0 con 0x7fd7dc100310 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.412+0000 7fd7d8ff9640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 0x7fd7c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.412+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd7cc0cf5f0 con 0x7fd7dc100310 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.412+0000 7fd7daffd640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 0x7fd7c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.412+0000 7fd7daffd640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 0x7fd7c40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc1047e0 tx=0x7fd7d0005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.415+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7cc014030 con 0x7fd7dc100310 2024-09-19T05:18:13.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.595+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7dc1027c0 con 0x7fd7dc100310 2024-09-19T05:18:13.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.596+0000 7fd7d8ff9640 1 -- 172.21.15.1:0/1599463713 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18336 (secure 0 0 0) 0x7fd7dc1027c0 con 0x7fd7dc100310 2024-09-19T05:18:13.599 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:13.599 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:18:12.679507+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 msgr2=0x7fd7c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 0x7fd7c40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc1047e0 tx=0x7fd7d0005be0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 msgr2=0x7fd7dc101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c970 tx=0x7fd7cc00ce30 comp rx=0 tx=0).stop 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 shutdown_connections 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7c40a3240 0x7fd7c40a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7dc106f30 0x7fd7dc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7dc100cc0 0x7fd7dc1017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 --2- 172.21.15.1:0/1599463713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7dc100310 0x7fd7dc101290 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 >> 172.21.15.1:0/1599463713 conn(0x7fd7dc077210 msgr2=0x7fd7dc105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:13.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 shutdown_connections 2024-09-19T05:18:13.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:13.598+0000 7fd7e1b39640 1 -- 172.21.15.1:0/1599463713 wait complete. 2024-09-19T05:18:13.914 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:13 smithi001 ceph-mon[30968]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:13.914 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:13 smithi001 ceph-mon[30968]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:18:13.914 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:13 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1599463713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:14.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:13 smithi060 ceph-mon[35058]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:13 smithi060 ceph-mon[35058]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:18:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:13 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1599463713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:13 smithi082 ceph-mon[35195]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:18:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:13 smithi082 ceph-mon[35195]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:18:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:13 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1599463713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:14.261 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:14:26.275871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:18:14.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T05:18:14.515 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 -- 172.21.15.1:0/3513644618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 msgr2=0x7fcb381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/3513644618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb381029b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009900 tx=0x7fcb2002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 -- 172.21.15.1:0/3513644618 shutdown_connections 2024-09-19T05:18:14.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/3513644618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38102ef0 0x7fcb3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/3513644618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb381029b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/3513644618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38100e20 0x7fcb38101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 -- 172.21.15.1:0/3513644618 >> 172.21.15.1:0/3513644618 conn(0x7fcb380fc7d0 msgr2=0x7fcb380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 -- 172.21.15.1:0/3513644618 shutdown_connections 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 -- 172.21.15.1:0/3513644618 wait complete. 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.977+0000 7fcb3c9de640 1 Processor -- start 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 -- start start 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 0x7fcb380fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 0x7fcb380fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38110f50 con 0x7fcb38102570 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38110dd0 con 0x7fcb38100e20 2024-09-19T05:18:14.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3c9de640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb381110d0 con 0x7fcb38102ef0 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55954/0 (socket says 172.21.15.1:55954) 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 -- 172.21.15.1:0/1678677067 learned_addr learned my addr 172.21.15.1:0/1678677067 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 0x7fcb380fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 0x7fcb380fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 -- 172.21.15.1:0/1678677067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 msgr2=0x7fcb380fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 0x7fcb380fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 -- 172.21.15.1:0/1678677067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 msgr2=0x7fcb380fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 0x7fcb380fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb2dd9b640 1 -- 172.21.15.1:0/1678677067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb381a6a60 con 0x7fcb38102570 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb36d9d640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 0x7fcb380fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.978+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 0x7fcb380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:14.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb2dd9b640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006010 tx=0x7fcb20003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2003f070 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb381a6cf0 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb20031c30 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20035030 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.979+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381a71c0 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.980+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38101200 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.981+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcb20042070 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.982+0000 7fcb2ffff640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.982+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.982+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcb200f0180 con 0x7fcb38102570 2024-09-19T05:18:14.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.982+0000 7fcb3659c640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 0x7fcb240a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009b40 tx=0x7fcb28005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:14.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:14.985+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb20031de0 con 0x7fcb38102570 2024-09-19T05:18:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.161+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb3810a0a0 con 0x7fcb38102570 2024-09-19T05:18:15.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.161+0000 7fcb2ffff640 1 -- 172.21.15.1:0/1678677067 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fcb200bd400 con 0x7fcb38102570 2024-09-19T05:18:15.164 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 msgr2=0x7fcb240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 0x7fcb240a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009b40 tx=0x7fcb28005e50 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 msgr2=0x7fcb380fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006010 tx=0x7fcb20003c10 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 shutdown_connections 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb38102ef0 0x7fcb380fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb38102570 0x7fcb380fd1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 --2- 172.21.15.1:0/1678677067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb38100e20 0x7fcb380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.163+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 >> 172.21.15.1:0/1678677067 conn(0x7fcb380fc7d0 msgr2=0x7fcb3806a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.164+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 shutdown_connections 2024-09-19T05:18:15.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:15.164+0000 7fcb3c9de640 1 -- 172.21.15.1:0/1678677067 wait complete. 2024-09-19T05:18:15.805 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:15 smithi001 ceph-mon[30968]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:15.805 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:15 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1678677067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.b on smithi060 2024-09-19T05:18:15.836 INFO:tasks.cephadm:Adding mds.e on smithi060 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.h on smithi060 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.k on smithi060 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.c on smithi082 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.f on smithi082 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.i on smithi082 2024-09-19T05:18:15.837 INFO:tasks.cephadm:Adding mds.l on smithi082 2024-09-19T05:18:15.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l' 2024-09-19T05:18:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:15 smithi060 ceph-mon[35058]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:15 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1678677067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:18:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:15 smithi082 ceph-mon[35195]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:15 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1678677067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:18:16.097 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:18:16.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 -- 172.21.15.82:0/2011705457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 msgr2=0x7f14f0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 --2- 172.21.15.82:0/2011705457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0100f10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f14e0009900 tx=0x7f14e002a410 comp rx=0 tx=0).stop 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 -- 172.21.15.82:0/2011705457 shutdown_connections 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 --2- 172.21.15.82:0/2011705457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f01026d0 0x7f14f0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 --2- 172.21.15.82:0/2011705457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f0101d10 0x7f14f0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 --2- 172.21.15.82:0/2011705457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0100f10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 -- 172.21.15.82:0/2011705457 >> 172.21.15.82:0/2011705457 conn(0x7f14f00fc2a0 msgr2=0x7f14f00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 -- 172.21.15.82:0/2011705457 shutdown_connections 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.814+0000 7f14f567e640 1 -- 172.21.15.82:0/2011705457 wait complete. 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 Processor -- start 2024-09-19T05:18:16.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 -- start start 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f0101d10 0x7f14f0103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 0x7f14f01037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14f010c7f0 con 0x7f14f01026d0 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14f010c670 con 0x7f14f0101d10 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14f567e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f14f010c970 con 0x7f14f0100b10 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:16.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14eeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41818/0 (socket says 172.21.15.82:41818) 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14eeffd640 1 -- 172.21.15.82:0/460793454 learned_addr learned my addr 172.21.15.82:0/460793454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.815+0000 7f14ee7fc640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f0101d10 0x7f14f0103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14ef7fe640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 0x7f14f01037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 -- 172.21.15.82:0/460793454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f0101d10 msgr2=0x7f14f0103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f0101d10 0x7f14f0103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 -- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 msgr2=0x7f14f01037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 0x7f14f01037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 -- 172.21.15.82:0/460793454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f0104060 con 0x7f14f0100b10 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14ef7fe640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 0x7f14f01037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14eeffd640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14e0031610 tx=0x7f14e00043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e003f030 con 0x7f14f0100b10 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f01a1fe0 con 0x7f14f0100b10 2024-09-19T05:18:16.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e0003ce0 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0035070 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.816+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f01a2450 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.817+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f0100f10 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.818+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f14e0042030 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.819+0000 7f14d7fff640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 0x7f14d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.819+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f14e00efb10 con 0x7f14f0100b10 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.819+0000 7f14ee7fc640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 0x7f14d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.820+0000 7f14ee7fc640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 0x7f14d80a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f14f0104990 tx=0x7f14e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:16.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:16.823+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14e00bccd0 con 0x7f14f0100b10 2024-09-19T05:18:17.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.007+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}) -- 0x7f14f006afa0 con 0x7f14d80a3240 2024-09-19T05:18:17.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.014+0000 7f14d7fff640 1 -- 172.21.15.82:0/460793454 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f14f006afa0 con 0x7f14d80a3240 2024-09-19T05:18:17.016 INFO:teuthology.orchestra.run.smithi082.stdout:Scheduled mds.all update... 2024-09-19T05:18:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 msgr2=0x7f14d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 0x7f14d80a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f14f0104990 tx=0x7f14e400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 msgr2=0x7f14f0104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14e0031610 tx=0x7f14e00043b0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 shutdown_connections 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f14d80a3240 0x7f14d80a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14f01026d0 0x7f14f01037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14f0101d10 0x7f14f0103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 --2- 172.21.15.82:0/460793454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14f0100b10 0x7f14f0104c10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.016+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 >> 172.21.15.82:0/460793454 conn(0x7f14f00fc2a0 msgr2=0x7f14f006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.017+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 shutdown_connections 2024-09-19T05:18:17.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-19T05:18:17.017+0000 7f14f567e640 1 -- 172.21.15.82:0/460793454 wait complete. 2024-09-19T05:18:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:17.727 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:17.728 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:17.761 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T05:18:17.764 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T05:18:17.807 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T05:18:17.850 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T05:18:17.893 DEBUG:teuthology.orchestra.run.smithi060:mds.b> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T05:18:17.896 DEBUG:teuthology.orchestra.run.smithi060:mds.e> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T05:18:17.940 DEBUG:teuthology.orchestra.run.smithi060:mds.h> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T05:18:17.959 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:17.960 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:17.961 DEBUG:teuthology.orchestra.run.smithi060:mds.k> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T05:18:18.003 DEBUG:teuthology.orchestra.run.smithi082:mds.c> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T05:18:18.006 DEBUG:teuthology.orchestra.run.smithi082:mds.f> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T05:18:18.049 DEBUG:teuthology.orchestra.run.smithi082:mds.i> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T05:18:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:18.096 DEBUG:teuthology.orchestra.run.smithi082:mds.l> sudo journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T05:18:18.138 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T05:18:18.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:18 smithi001 ceph-mon[30968]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:18.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:18 smithi001 ceph-mon[30968]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2024-09-19T05:18:18.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:18 smithi001 ceph-mon[30968]: Deploying daemon mds.l on smithi082 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 -- 172.21.15.1:0/660155638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0103780 msgr2=0x7fa4d0107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/660155638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0103780 0x7fa4d0107bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009930 tx=0x7fa4c002a420 comp rx=0 tx=0).stop 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 -- 172.21.15.1:0/660155638 shutdown_connections 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/660155638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0108300 0x7fa4d010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/660155638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0103780 0x7fa4d0107bc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/660155638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0102dd0 0x7fa4d01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 -- 172.21.15.1:0/660155638 >> 172.21.15.1:0/660155638 conn(0x7fa4d00fc7d0 msgr2=0x7fa4d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:18.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 -- 172.21.15.1:0/660155638 shutdown_connections 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.874+0000 7fa4d80cc640 1 -- 172.21.15.1:0/660155638 wait complete. 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 Processor -- start 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 -- start start 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0103780 0x7fa4d0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0108300 0x7fa4d019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0112070 con 0x7fa4d0102dd0 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d0111ef0 con 0x7fa4d0108300 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d80cc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d01121f0 con 0x7fa4d0103780 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55966/0 (socket says 172.21.15.1:55966) 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 -- 172.21.15.1:0/3708679633 learned_addr learned my addr 172.21.15.1:0/3708679633 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:18.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5667640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0103780 0x7fa4d0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d6669640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0108300 0x7fa4d019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 -- 172.21.15.1:0/3708679633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0103780 msgr2=0x7fa4d0198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0103780 0x7fa4d0198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 -- 172.21.15.1:0/3708679633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0108300 msgr2=0x7fa4d019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0108300 0x7fa4d019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 -- 172.21.15.1:0/3708679633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d019d4e0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.875+0000 7fa4d5e68640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00cce0 tx=0x7fa4cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.876+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00f650 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.876+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4cc00fcd0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.876+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d019d7d0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.876+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc018c70 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.876+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d01a50b0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.877+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d01031b0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.878+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa4cc00f7f0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.878+0000 7fa4c6ffd640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 0x7fa4bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.879+0000 7fa4d5667640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 0x7fa4bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.879+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa4cc0cf8b0 con 0x7fa4d0102dd0 2024-09-19T05:18:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.879+0000 7fa4d5667640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 0x7fa4bc0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0005940 tx=0x7fa4c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:18.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:18.883+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4cc014030 con 0x7fa4d0102dd0 2024-09-19T05:18:18.952 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:18 smithi082 ceph-mon[35195]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:18.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:18 smithi082 ceph-mon[35195]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2024-09-19T05:18:18.953 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:18 smithi082 ceph-mon[35195]: Deploying daemon mds.l on smithi082 2024-09-19T05:18:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:18 smithi060 ceph-mon[35058]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:18 smithi060 ceph-mon[35058]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2024-09-19T05:18:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:18 smithi060 ceph-mon[35058]: Deploying daemon mds.l on smithi082 2024-09-19T05:18:19.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.093+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4d010a290 con 0x7fa4d0102dd0 2024-09-19T05:18:19.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.093+0000 7fa4c6ffd640 1 -- 172.21.15.1:0/3708679633 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa4cc09ca70 con 0x7fa4d0102dd0 2024-09-19T05:18:19.096 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:19.096 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-19T05:11:21:229522+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T05:18:19.096 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 msgr2=0x7fa4bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 0x7fa4bc0a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0005940 tx=0x7fa4c00058d0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 msgr2=0x7fa4d0198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00cce0 tx=0x7fa4cc00a620 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 shutdown_connections 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa4bc0a32c0 0x7fa4bc0a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4d0108300 0x7fa4d019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d0103780 0x7fa4d0198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 --2- 172.21.15.1:0/3708679633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4d0102dd0 0x7fa4d0198530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 >> 172.21.15.1:0/3708679633 conn(0x7fa4d00fc7d0 msgr2=0x7fa4d0105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 shutdown_connections 2024-09-19T05:18:19.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:19.095+0000 7fa4d80cc640 1 -- 172.21.15.1:0/3708679633 wait complete. 2024-09-19T05:18:19.508 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 systemd[1]: Starting Ceph mds.l for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:19.824 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:19 smithi001 ceph-mon[30968]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:19.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:19 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3708679633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:19.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:19 smithi082 ceph-mon[35195]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:19.898 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:19 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3708679633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:19.898 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 podman[65156]: 2024-09-19 05:18:19.535379534 +0000 UTC m=+0.015765366 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:19.898 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 podman[65156]: 2024-09-19 05:18:19.652798492 +0000 UTC m=+0.133184325 container create 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:18:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:19 smithi060 ceph-mon[35058]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:19 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3708679633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:20.258 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 podman[65156]: 2024-09-19 05:18:19.897132882 +0000 UTC m=+0.377518713 container init 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:18:20.258 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 podman[65156]: 2024-09-19 05:18:19.900069198 +0000 UTC m=+0.380455033 container start 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T05:18:20.258 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 ceph-mds[65175]: -- 172.21.15.82:0/3682597674 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cae0307860 con 0x55cae02e4800 2024-09-19T05:18:20.258 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l[65171]: starting mds.l at 2024-09-19T05:18:20.259 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:20 smithi082 bash[65156]: 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 2024-09-19T05:18:20.259 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:18:20 smithi082 systemd[1]: Started Ceph mds.l for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6832/4115388228,v1:172.21.15.82:6833/4115388228] up:boot 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: fsmap 1 up:standby 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:21.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:21.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:21.183 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:20 smithi082 ceph-mon[35195]: Deploying daemon mds.k on smithi060 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6832/4115388228,v1:172.21.15.82:6833/4115388228] up:boot 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: fsmap 1 up:standby 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:20 smithi060 ceph-mon[35058]: Deploying daemon mds.k on smithi060 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6832/4115388228,v1:172.21.15.82:6833/4115388228] up:boot 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: fsmap 1 up:standby 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:21.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:20 smithi001 ceph-mon[30968]: Deploying daemon mds.k on smithi060 2024-09-19T05:18:21.857 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:22.130 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:22.407 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 podman[63590]: 2024-09-19 05:18:22.368598815 +0000 UTC m=+0.124600447 container create edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:18:22.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.642+0000 7f3864e7d640 1 -- 172.21.15.1:0/435459524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860106a80 msgr2=0x7f3860106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.642+0000 7f3864e7d640 1 --2- 172.21.15.1:0/435459524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860106a80 0x7f3860106e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3850009cd0 tx=0x7f385002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 -- 172.21.15.1:0/435459524 shutdown_connections 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 --2- 172.21.15.1:0/435459524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f386010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 --2- 172.21.15.1:0/435459524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860100a80 0x7f3860100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 --2- 172.21.15.1:0/435459524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860106a80 0x7f3860106e60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 -- 172.21.15.1:0/435459524 >> 172.21.15.1:0/435459524 conn(0x7f38600fc7a0 msgr2=0x7f38600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 -- 172.21.15.1:0/435459524 shutdown_connections 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 -- 172.21.15.1:0/435459524 wait complete. 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 Processor -- start 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.643+0000 7f3864e7d640 1 -- start start 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f38600fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860106a80 0x7f38600fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3860110e80 con 0x7f3860100a80 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3860110d00 con 0x7f3860101420 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f3864e7d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3860111000 con 0x7f3860106a80 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55984/0 (socket says 172.21.15.1:55984) 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 -- 172.21.15.1:0/3057383560 learned_addr learned my addr 172.21.15.1:0/3057383560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385dd9b640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f38600fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385ed9d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860106a80 0x7f38600fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 -- 172.21.15.1:0/3057383560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860106a80 msgr2=0x7f38600fd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860106a80 0x7f38600fd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 -- 172.21.15.1:0/3057383560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 msgr2=0x7f38600fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f38600fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 -- 172.21.15.1:0/3057383560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38601a69b0 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385dd9b640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f38600fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.644+0000 7f385e59c640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f385002ae00 tx=0x7f3850003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.645+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850004040 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.645+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38500046c0 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.645+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38601a6c40 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.645+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850046480 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.645+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38601a7180 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.646+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3860100ee0 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.647+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f38500305a0 con 0x7f3860100a80 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.648+0000 7f38577fe640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 0x7f384c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.648+0000 7f385dd9b640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 0x7f384c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.648+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f385002e030 con 0x7f3860100a80 2024-09-19T05:18:22.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.648+0000 7f385dd9b640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 0x7f384c0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38600fe860 tx=0x7f384800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:22.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.653+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f385004b060 con 0x7f3860100a80 2024-09-19T05:18:22.666 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 podman[63590]: 2024-09-19 05:18:22.638352098 +0000 UTC m=+0.394353731 container init edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:18:22.666 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 podman[63590]: 2024-09-19 05:18:22.641538252 +0000 UTC m=+0.397539885 container start edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T05:18:22.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.864+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38600fe300 con 0x7f3860100a80 2024-09-19T05:18:22.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.865+0000 7f38577fe640 1 -- 172.21.15.1:0/3057383560 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f3850030890 con 0x7f3860100a80 2024-09-19T05:18:22.868 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:22.868 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-19T05:18:19:927952+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:18:22.868 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-19T05:18:22.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 msgr2=0x7f384c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 0x7f384c0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38600fe860 tx=0x7f384800b390 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 msgr2=0x7f38600fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f385002ae00 tx=0x7f3850003970 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 shutdown_connections 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f384c0a3240 0x7f384c0a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3860106a80 0x7f38600fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3860101420 0x7f38600fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 --2- 172.21.15.1:0/3057383560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3860100a80 0x7f38600fcdd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 >> 172.21.15.1:0/3057383560 conn(0x7f38600fc7a0 msgr2=0x7f386006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 shutdown_connections 2024-09-19T05:18:22.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:22.867+0000 7f3864e7d640 1 -- 172.21.15.1:0/3057383560 wait complete. 2024-09-19T05:18:22.939 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mds[63617]: -- 172.21.15.60:0/474014523 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b98c239860 con 0x55b98c216800 2024-09-19T05:18:22.939 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k[63605]: starting mds.k at 2024-09-19T05:18:22.940 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 bash[63590]: edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 2024-09-19T05:18:22.940 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:18:22 smithi060 systemd[1]: Started Ceph mds.k for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3057383560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:23.233 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:22 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3057383560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:23.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:22 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3057383560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:22 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:24.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:23 smithi001 ceph-mon[30968]: Deploying daemon mds.j on smithi001 2024-09-19T05:18:24.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:23 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.60:6832/3384631993,v1:172.21.15.60:6833/3384631993] up:boot 2024-09-19T05:18:24.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:23 smithi001 ceph-mon[30968]: fsmap 2 up:standby 2024-09-19T05:18:24.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:23 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:18:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:23 smithi060 ceph-mon[35058]: Deploying daemon mds.j on smithi001 2024-09-19T05:18:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:23 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.60:6832/3384631993,v1:172.21.15.60:6833/3384631993] up:boot 2024-09-19T05:18:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:23 smithi060 ceph-mon[35058]: fsmap 2 up:standby 2024-09-19T05:18:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:23 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:18:24.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:23 smithi082 ceph-mon[35195]: Deploying daemon mds.j on smithi001 2024-09-19T05:18:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:23 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.60:6832/3384631993,v1:172.21.15.60:6833/3384631993] up:boot 2024-09-19T05:18:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:23 smithi082 ceph-mon[35195]: fsmap 2 up:standby 2024-09-19T05:18:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:23 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:18:25.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:24 smithi060 ceph-mon[35058]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:24 smithi082 ceph-mon[35195]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:25.295 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:24 smithi001 ceph-mon[30968]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:25.591 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 systemd[1]: Starting Ceph mds.j for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:25.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:25.957 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 podman[70344]: 2024-09-19 05:18:25.602551961 +0000 UTC m=+0.016214043 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:25.957 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 podman[70344]: 2024-09-19 05:18:25.728987594 +0000 UTC m=+0.142649666 container create abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T05:18:25.958 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 podman[70344]: 2024-09-19 05:18:25.95613857 +0000 UTC m=+0.369800643 container init abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:18:26.167 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:26.289 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 podman[70344]: 2024-09-19 05:18:25.959568137 +0000 UTC m=+0.373230218 container start abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:18:26.290 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 ceph-mds[70393]: -- 172.21.15.1:0/4203042470 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a21c597860 con 0x55a21c574800 2024-09-19T05:18:26.290 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j[70377]: starting mds.j at 2024-09-19T05:18:26.290 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:26 smithi001 bash[70344]: abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 2024-09-19T05:18:26.290 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:18:26 smithi001 systemd[1]: Started Ceph mds.j for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- 172.21.15.1:0/141361164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 msgr2=0x7f9ccc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/141361164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc10da40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009ca0 tx=0x7f9cc402a950 comp rx=0 tx=0).stop 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- 172.21.15.1:0/141361164 shutdown_connections 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/141361164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc10da40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/141361164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 0x7f9ccc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/141361164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 0x7f9ccc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- 172.21.15.1:0/141361164 >> 172.21.15.1:0/141361164 conn(0x7f9ccc0fc7d0 msgr2=0x7f9ccc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- 172.21.15.1:0/141361164 shutdown_connections 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- 172.21.15.1:0/141361164 wait complete. 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 Processor -- start 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.678+0000 7f9cd3aae640 1 -- start start 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 0x7f9ccc198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 0x7f9ccc198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc110fa0 con 0x7f9ccc102ef0 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc110e20 con 0x7f9ccc100e20 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd3aae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc111120 con 0x7f9ccc102570 2024-09-19T05:18:26.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50106/0 (socket says 172.21.15.1:50106) 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 -- 172.21.15.1:0/245843100 learned_addr learned my addr 172.21.15.1:0/245843100 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd1049640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 0x7f9ccc198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd184a640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 0x7f9ccc198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 -- 172.21.15.1:0/245843100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 msgr2=0x7f9ccc198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 0x7f9ccc198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 -- 172.21.15.1:0/245843100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 msgr2=0x7f9ccc198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 0x7f9ccc198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 -- 172.21.15.1:0/245843100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc19d540 con 0x7f9ccc102ef0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.679+0000 7f9cd204b640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4006010 tx=0x7f9cc402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.680+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4034040 con 0x7f9ccc102ef0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.680+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc19d7d0 con 0x7f9ccc102ef0 2024-09-19T05:18:26.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.680+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cc4003e00 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.680+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4045480 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.680+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc1a5110 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.681+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc101200 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.682+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9cc4037020 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.682+0000 7f9cc2ffd640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 0x7f9cb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.683+0000 7f9cd184a640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 0x7f9cb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.683+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9cc40f05b0 con 0x7f9ccc102ef0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.683+0000 7f9cd184a640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 0x7f9cb80a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80058c0 tx=0x7f9cc800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:26.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.687+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9cc40bd770 con 0x7f9ccc102ef0 2024-09-19T05:18:26.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.902+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ccc10a0a0 con 0x7f9ccc102ef0 2024-09-19T05:18:26.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.902+0000 7f9cc2ffd640 1 -- 172.21.15.1:0/245843100 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f9cc40bd070 con 0x7f9ccc102ef0 2024-09-19T05:18:26.905 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:26.905 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"btime":"2024-09-19T05:18:22:931525+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:18:26.906 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2024-09-19T05:18:26.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 msgr2=0x7f9cb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 0x7f9cb80a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80058c0 tx=0x7f9cc800a4c0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 msgr2=0x7f9ccc19ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4006010 tx=0x7f9cc402f6f0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 shutdown_connections 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9cb80a3240 0x7f9cb80a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ccc102ef0 0x7f9ccc19ce60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc102570 0x7f9ccc198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 --2- 172.21.15.1:0/245843100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ccc100e20 0x7f9ccc198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 >> 172.21.15.1:0/245843100 conn(0x7f9ccc0fc7d0 msgr2=0x7f9ccc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 shutdown_connections 2024-09-19T05:18:26.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:26.905+0000 7f9cd3aae640 1 -- 172.21.15.1:0/245843100 wait complete. 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: Deploying daemon mds.d on smithi001 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/245843100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.1:6834/499392248,v1:172.21.15.1:6835/499392248] up:boot 2024-09-19T05:18:27.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: fsmap 3 up:standby 2024-09-19T05:18:27.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:27 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:27.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: Deploying daemon mds.d on smithi001 2024-09-19T05:18:27.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/245843100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.1:6834/499392248,v1:172.21.15.1:6835/499392248] up:boot 2024-09-19T05:18:27.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: fsmap 3 up:standby 2024-09-19T05:18:27.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:27 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:18:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: Deploying daemon mds.d on smithi001 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/245843100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.1:6834/499392248,v1:172.21.15.1:6835/499392248] up:boot 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: fsmap 3 up:standby 2024-09-19T05:18:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:27 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:18:29.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:29 smithi001 ceph-mon[30968]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:29.342 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 systemd[1]: Starting Ceph mds.d for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:29.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:29 smithi060 ceph-mon[35058]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:29 smithi082 ceph-mon[35195]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:29.675 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 podman[70761]: 2024-09-19 05:18:29.259386371 +0000 UTC m=+0.016855750 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:29.675 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 podman[70761]: 2024-09-19 05:18:29.387864724 +0000 UTC m=+0.145334092 container create 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T05:18:29.675 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 podman[70761]: 2024-09-19 05:18:29.673935555 +0000 UTC m=+0.431404922 container init 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:18:29.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:30.044 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:30.091 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 podman[70761]: 2024-09-19 05:18:29.676959539 +0000 UTC m=+0.434428907 container start 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T05:18:30.091 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 ceph-mds[70780]: -- 172.21.15.1:0/2429268161 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d221b69860 con 0x55d221b47400 2024-09-19T05:18:30.091 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d[70776]: starting mds.d at 2024-09-19T05:18:30.091 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 bash[70761]: 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a 2024-09-19T05:18:30.092 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:18:29 smithi001 systemd[1]: Started Ceph mds.d for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:30.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 -- 172.21.15.1:0/1203276202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101240 msgr2=0x7f419c101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 --2- 172.21.15.1:0/1203276202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101240 0x7f419c101680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4190009900 tx=0x7f419002a410 comp rx=0 tx=0).stop 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 -- 172.21.15.1:0/1203276202 shutdown_connections 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 --2- 172.21.15.1:0/1203276202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c101bc0 0x7f419c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 --2- 172.21.15.1:0/1203276202 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101240 0x7f419c101680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 --2- 172.21.15.1:0/1203276202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c105a90 0x7f419c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 -- 172.21.15.1:0/1203276202 >> 172.21.15.1:0/1203276202 conn(0x7f419c077210 msgr2=0x7f419c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 -- 172.21.15.1:0/1203276202 shutdown_connections 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.560+0000 7f41a1304640 1 -- 172.21.15.1:0/1203276202 wait complete. 2024-09-19T05:18:30.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 Processor -- start 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 -- start start 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c101240 0x7f419c10e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 0x7f419c10eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f419c112090 con 0x7f419c101bc0 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f419c111f10 con 0x7f419c105a90 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.561+0000 7f41a1304640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f419c112210 con 0x7f419c101240 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50144/0 (socket says 172.21.15.1:50144) 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 -- 172.21.15.1:0/3797167612 learned_addr learned my addr 172.21.15.1:0/3797167612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419b7fe640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 0x7f419c10eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 -- 172.21.15.1:0/3797167612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c101240 msgr2=0x7f419c10e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419affd640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c101240 0x7f419c10e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c101240 0x7f419c10e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 -- 172.21.15.1:0/3797167612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 msgr2=0x7f419c10eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 0x7f419c10eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 -- 172.21.15.1:0/3797167612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c1a69b0 con 0x7f419c101bc0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419b7fe640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 0x7f419c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f419a7fc640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4190006010 tx=0x7f4190003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419003f070 con 0x7f419c101bc0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c1a6c40 con 0x7f419c101bc0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4190031c30 con 0x7f419c101bc0 2024-09-19T05:18:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190035030 con 0x7f419c101bc0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.562+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c1a7120 con 0x7f419c101bc0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.563+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c101680 con 0x7f419c101bc0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.565+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4190042070 con 0x7f419c101bc0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.565+0000 7f4183fff640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 0x7f41840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.565+0000 7f419affd640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 0x7f41840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.565+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f41900f0170 con 0x7f419c101bc0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.566+0000 7f419affd640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 0x7f41840a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f418c005d80 tx=0x7f418c005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.569+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4190031de0 con 0x7f419c101bc0 2024-09-19T05:18:30.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.780+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f419c1a7320 con 0x7f419c101bc0 2024-09-19T05:18:30.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.781+0000 7f4183fff640 1 -- 172.21.15.1:0/3797167612 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3901 (secure 0 0 0) 0x7f41900bd330 con 0x7f419c101bc0 2024-09-19T05:18:30.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:30.784 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"btime":"2024-09-19T05:18:30:109791+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:18:30.784 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 5 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 msgr2=0x7f41840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 0x7f41840a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f418c005d80 tx=0x7f418c005c90 comp rx=0 tx=0).stop 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 msgr2=0x7f419c10e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4190006010 tx=0x7f4190003c10 comp rx=0 tx=0).stop 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 shutdown_connections 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f41840a3240 0x7f41840a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f419c105a90 0x7f419c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f419c101bc0 0x7f419c10e960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 --2- 172.21.15.1:0/3797167612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f419c101240 0x7f419c10e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:30.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 >> 172.21.15.1:0/3797167612 conn(0x7f419c077210 msgr2=0x7f419c103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:30.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 shutdown_connections 2024-09-19T05:18:30.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:30.783+0000 7f41a1304640 1 -- 172.21.15.1:0/3797167612 wait complete. 2024-09-19T05:18:31.081 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:31.081 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.081 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.081 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: Deploying daemon mds.e on smithi060 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.1:6836/4202429907,v1:172.21.15.1:6837/4202429907] up:boot 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: fsmap 4 up:standby 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:18:31.082 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:30 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3797167612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: Deploying daemon mds.e on smithi060 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.1:6836/4202429907,v1:172.21.15.1:6837/4202429907] up:boot 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: fsmap 4 up:standby 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:18:31.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:30 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3797167612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:31.209 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: Deploying daemon mds.e on smithi060 2024-09-19T05:18:31.210 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.1:6836/4202429907,v1:172.21.15.1:6837/4202429907] up:boot 2024-09-19T05:18:31.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: fsmap 4 up:standby 2024-09-19T05:18:31.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:18:31.211 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:30 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3797167612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:32.001 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:31 smithi060 systemd[1]: Starting Ceph mds.e for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:32.354 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 podman[63904]: 2024-09-19 05:18:31.951249282 +0000 UTC m=+0.016229577 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:32.354 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 podman[63904]: 2024-09-19 05:18:32.11666404 +0000 UTC m=+0.181644325 container create d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T05:18:32.354 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 podman[63904]: 2024-09-19 05:18:32.352873251 +0000 UTC m=+0.417853544 container init d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T05:18:32.751 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 podman[63904]: 2024-09-19 05:18:32.356133248 +0000 UTC m=+0.421113541 container start d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T05:18:32.751 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 ceph-mds[63923]: -- 172.21.15.60:0/937306714 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe62abb860 con 0x55fe62a98800 2024-09-19T05:18:32.751 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e[63919]: starting mds.e at 2024-09-19T05:18:32.751 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 bash[63904]: d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 2024-09-19T05:18:32.751 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:18:32 smithi060 systemd[1]: Started Ceph mds.e for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:33.615 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: Deploying daemon mds.f on smithi082 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.60:6834/2252846405,v1:172.21.15.60:6835/2252846405] up:boot 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: fsmap 5 up:standby 2024-09-19T05:18:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: Deploying daemon mds.f on smithi082 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.60:6834/2252846405,v1:172.21.15.60:6835/2252846405] up:boot 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: fsmap 5 up:standby 2024-09-19T05:18:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:18:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: Deploying daemon mds.f on smithi082 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.60:6834/2252846405,v1:172.21.15.60:6835/2252846405] up:boot 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: fsmap 5 up:standby 2024-09-19T05:18:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:18:33.889 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.445+0000 7fd744943640 1 -- 172.21.15.1:0/2916193059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 msgr2=0x7fd740100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.445+0000 7fd744943640 1 --2- 172.21.15.1:0/2916193059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd740100ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd734009930 tx=0x7fd73402a420 comp rx=0 tx=0).stop 2024-09-19T05:18:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 -- 172.21.15.1:0/2916193059 shutdown_connections 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 --2- 172.21.15.1:0/2916193059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740101420 0x7fd74010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 --2- 172.21.15.1:0/2916193059 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd740100ee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 --2- 172.21.15.1:0/2916193059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740106a80 0x7fd740106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 -- 172.21.15.1:0/2916193059 >> 172.21.15.1:0/2916193059 conn(0x7fd7400fc7a0 msgr2=0x7fd7400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 -- 172.21.15.1:0/2916193059 shutdown_connections 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 -- 172.21.15.1:0/2916193059 wait complete. 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.446+0000 7fd744943640 1 Processor -- start 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 -- start start 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 0x7fd7401978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740106a80 0x7fd74019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd740110e80 con 0x7fd740100a80 2024-09-19T05:18:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd740110d00 con 0x7fd740106a80 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd744943640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd740111000 con 0x7fd740101420 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60214/0 (socket says 172.21.15.1:60214) 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73e59c640 1 -- 172.21.15.1:0/2026222531 learned_addr learned my addr 172.21.15.1:0/2026222531 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 0x7fd7401978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73ed9d640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740106a80 0x7fd74019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 -- 172.21.15.1:0/2026222531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740106a80 msgr2=0x7fd74019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740106a80 0x7fd74019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 -- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 msgr2=0x7fd7401973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73dd9b640 1 -- 172.21.15.1:0/2026222531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74019c350 con 0x7fd740101420 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.447+0000 7fd73e59c640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:34.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd73dd9b640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 0x7fd7401978e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd734005940 tx=0x7fd7340040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73403f070 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74019c5e0 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7340044c0 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734035070 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.448+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401a3f20 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.449+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7401021c0 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.450+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd73403b460 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.451+0000 7fd72f7fe640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 0x7fd7280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.451+0000 7fd73e59c640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 0x7fd7280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.451+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd7340ef980 con 0x7fd740101420 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.451+0000 7fd73e59c640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 0x7fd7280a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd730011490 tx=0x7fd730005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:34.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.456+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7340bc450 con 0x7fd740101420 2024-09-19T05:18:34.508 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 systemd[1]: Starting Ceph mds.f for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:34.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.671+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd740108ff0 con 0x7fd740101420 2024-09-19T05:18:34.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.672+0000 7fd72f7fe640 1 -- 172.21.15.1:0/2026222531 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7fd7340c0750 con 0x7fd740101420 2024-09-19T05:18:34.674 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:34.674 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-19T05:18:32:827206+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:18:34.675 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-19T05:18:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 msgr2=0x7fd7280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 0x7fd7280a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd730011490 tx=0x7fd730005f90 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 msgr2=0x7fd7401978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 0x7fd7401978e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd734005940 tx=0x7fd7340040c0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 shutdown_connections 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7280a3240 0x7fd7280a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd740106a80 0x7fd74019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd740101420 0x7fd7401978e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 --2- 172.21.15.1:0/2026222531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd740100a80 0x7fd7401973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 >> 172.21.15.1:0/2026222531 conn(0x7fd7400fc7a0 msgr2=0x7fd7400fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 shutdown_connections 2024-09-19T05:18:34.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:34.674+0000 7fd744943640 1 -- 172.21.15.1:0/2026222531 wait complete. 2024-09-19T05:18:34.903 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 podman[65453]: 2024-09-19 05:18:34.532889186 +0000 UTC m=+0.015827229 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:34.903 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 podman[65453]: 2024-09-19 05:18:34.639845691 +0000 UTC m=+0.122783723 container create 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:18:34.904 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 podman[65453]: 2024-09-19 05:18:34.875857269 +0000 UTC m=+0.358795296 container init 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:18:34.904 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 podman[65453]: 2024-09-19 05:18:34.87888727 +0000 UTC m=+0.361825294 container start 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:18:35.258 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 ceph-mds[65473]: -- 172.21.15.82:0/3643572319 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7b5a13860 con 0x55a7b59f1000 2024-09-19T05:18:35.258 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f[65469]: starting mds.f at 2024-09-19T05:18:35.258 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 bash[65453]: 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff 2024-09-19T05:18:35.258 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:18:34 smithi082 systemd[1]: Started Ceph mds.f for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2026222531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:35 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2026222531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:35 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2026222531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:35 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:36.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:36 smithi082 ceph-mon[35195]: Deploying daemon mds.c on smithi082 2024-09-19T05:18:36.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:36 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6834/3661072126,v1:172.21.15.82:6835/3661072126] up:boot 2024-09-19T05:18:36.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:36 smithi082 ceph-mon[35195]: fsmap 6 up:standby 2024-09-19T05:18:36.586 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:36 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:18:36.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:36 smithi060 ceph-mon[35058]: Deploying daemon mds.c on smithi082 2024-09-19T05:18:36.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:36 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6834/3661072126,v1:172.21.15.82:6835/3661072126] up:boot 2024-09-19T05:18:36.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:36 smithi060 ceph-mon[35058]: fsmap 6 up:standby 2024-09-19T05:18:36.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:36 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:18:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:36 smithi001 ceph-mon[30968]: Deploying daemon mds.c on smithi082 2024-09-19T05:18:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:36 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6834/3661072126,v1:172.21.15.82:6835/3661072126] up:boot 2024-09-19T05:18:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:36 smithi001 ceph-mon[30968]: fsmap 6 up:standby 2024-09-19T05:18:36.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:36 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:18:37.258 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 systemd[1]: Starting Ceph mds.c for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:37.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:37.566 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:37 smithi082 ceph-mon[35195]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:37.566 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 podman[65756]: 2024-09-19 05:18:37.173248043 +0000 UTC m=+0.015607372 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:37.566 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 podman[65756]: 2024-09-19 05:18:37.303935015 +0000 UTC m=+0.146294334 container create e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T05:18:37.567 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 podman[65756]: 2024-09-19 05:18:37.565553101 +0000 UTC m=+0.407912420 container init e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T05:18:37.738 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:37.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:37 smithi060 ceph-mon[35058]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:37 smithi001 ceph-mon[30968]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:38.008 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 podman[65756]: 2024-09-19 05:18:37.568614236 +0000 UTC m=+0.410973556 container start e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:18:38.008 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 ceph-mds[65775]: -- 172.21.15.82:0/1021521811 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d73697860 con 0x563d73675000 2024-09-19T05:18:38.009 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c[65771]: starting mds.c at 2024-09-19T05:18:38.009 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 bash[65756]: e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea 2024-09-19T05:18:38.009 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:18:37 smithi082 systemd[1]: Started Ceph mds.c for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/2355222283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24102790 msgr2=0x7f9e241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/2355222283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24102790 0x7f9e241067e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009900 tx=0x7f9e1802a410 comp rx=0 tx=0).stop 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/2355222283 shutdown_connections 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/2355222283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 0x7f9e2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/2355222283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24102790 0x7f9e241067e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/2355222283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24101de0 0x7f9e241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/2355222283 >> 172.21.15.1:0/2355222283 conn(0x7f9e240fd8c0 msgr2=0x7f9e240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:38.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/2355222283 shutdown_connections 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.212+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/2355222283 wait complete. 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 Processor -- start 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 -- start start 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24102790 0x7f9e24198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 0x7f9e2419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24111f80 con 0x7f9e24101de0 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24111e00 con 0x7f9e24106f10 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e2a9bf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24112100 con 0x7f9e24102790 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e23fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60244/0 (socket says 172.21.15.1:60244) 2024-09-19T05:18:38.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e23fff640 1 -- 172.21.15.1:0/1397640286 learned_addr learned my addr 172.21.15.1:0/1397640286 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e28f5c640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 0x7f9e2419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.213+0000 7f9e237fe640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24102790 0x7f9e24198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 -- 172.21.15.1:0/1397640286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24102790 msgr2=0x7f9e24198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24102790 0x7f9e24198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 -- 172.21.15.1:0/1397640286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 msgr2=0x7f9e2419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 0x7f9e2419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 -- 172.21.15.1:0/1397640286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2419d3d0 con 0x7f9e24101de0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e23fff640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d950 tx=0x7f9e1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14017070 con 0x7f9e24101de0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2419d6c0 con 0x7f9e24101de0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e14009c30 con 0x7f9e24101de0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400f6b0 con 0x7f9e24101de0 2024-09-19T05:18:38.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.214+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e241a4fa0 con 0x7f9e24101de0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.215+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e241021c0 con 0x7f9e24101de0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.216+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9e140109d0 con 0x7f9e24101de0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.217+0000 7f9e217fa640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 0x7f9e0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.217+0000 7f9e237fe640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 0x7f9e0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.217+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9e140cefd0 con 0x7f9e24101de0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.217+0000 7f9e237fe640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 0x7f9e0c0a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000c00 tx=0x7f9e18005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:38.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.221+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e14009de0 con 0x7f9e24101de0 2024-09-19T05:18:38.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.435+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e2410a0f0 con 0x7f9e24101de0 2024-09-19T05:18:38.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.435+0000 7f9e217fa640 1 -- 172.21.15.1:0/1397640286 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5551 (secure 0 0 0) 0x7f9e1409bb40 con 0x7f9e24101de0 2024-09-19T05:18:38.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:38.437 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"btime":"2024-09-19T05:18:35:476356+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T05:18:38.437 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-09-19T05:18:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 msgr2=0x7f9e0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 0x7f9e0c0a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000c00 tx=0x7f9e18005b50 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 msgr2=0x7f9e24198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d950 tx=0x7f9e1400de10 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 shutdown_connections 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9e0c0a3240 0x7f9e0c0a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e24106f10 0x7f9e2419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24102790 0x7f9e24198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 --2- 172.21.15.1:0/1397640286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e24101de0 0x7f9e24198420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 >> 172.21.15.1:0/1397640286 conn(0x7f9e240fd8c0 msgr2=0x7f9e240fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 shutdown_connections 2024-09-19T05:18:38.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:38.438+0000 7f9e2a9bf640 1 -- 172.21.15.1:0/1397640286 wait complete. 2024-09-19T05:18:39.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: Deploying daemon mds.h on smithi060 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1397640286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6836/3379829204,v1:172.21.15.82:6837/3379829204] up:boot 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: fsmap 7 up:standby 2024-09-19T05:18:39.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:38 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: Deploying daemon mds.h on smithi060 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1397640286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6836/3379829204,v1:172.21.15.82:6837/3379829204] up:boot 2024-09-19T05:18:39.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: fsmap 7 up:standby 2024-09-19T05:18:39.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:38 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:18:39.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: Deploying daemon mds.h on smithi060 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1397640286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6836/3379829204,v1:172.21.15.82:6837/3379829204] up:boot 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: fsmap 7 up:standby 2024-09-19T05:18:39.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:38 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:18:39.751 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:39 smithi060 systemd[1]: Starting Ceph mds.h for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:39 smithi082 ceph-mon[35195]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:40.010 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:39 smithi060 ceph-mon[35058]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:40.010 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:39 smithi060 podman[64207]: 2024-09-19 05:18:39.763171683 +0000 UTC m=+0.016687740 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:40.010 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:39 smithi060 podman[64207]: 2024-09-19 05:18:39.881262632 +0000 UTC m=+0.134778707 container create 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T05:18:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:39 smithi001 ceph-mon[30968]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:40.500 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 podman[64207]: 2024-09-19 05:18:40.125780922 +0000 UTC m=+0.379296964 container init 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T05:18:40.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 podman[64207]: 2024-09-19 05:18:40.128583506 +0000 UTC m=+0.382099547 container start 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:18:40.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 ceph-mds[64226]: -- 172.21.15.60:0/1339607892 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5576f7c65860 con 0x5576f7c43000 2024-09-19T05:18:40.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h[64222]: starting mds.h at 2024-09-19T05:18:40.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 bash[64207]: 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 2024-09-19T05:18:40.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:18:40 smithi060 systemd[1]: Started Ceph mds.h for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:41.129 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:41.400 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: Deploying daemon mds.i on smithi082 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.60:6836/1092440333,v1:172.21.15.60:6837/1092440333] up:boot 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: fsmap 8 up:standby 2024-09-19T05:18:41.522 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:41 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:18:41.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:41.732 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: Deploying daemon mds.i on smithi082 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.60:6836/1092440333,v1:172.21.15.60:6837/1092440333] up:boot 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: fsmap 8 up:standby 2024-09-19T05:18:41.733 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:41 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: Deploying daemon mds.i on smithi082 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.60:6836/1092440333,v1:172.21.15.60:6837/1092440333] up:boot 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: fsmap 8 up:standby 2024-09-19T05:18:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:41 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:18:41.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 -- 172.21.15.1:0/1549660848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 msgr2=0x7f3a60103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 --2- 172.21.15.1:0/1549660848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60103120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009900 tx=0x7f3a5002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:41.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 -- 172.21.15.1:0/1549660848 shutdown_connections 2024-09-19T05:18:41.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 --2- 172.21.15.1:0/1549660848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a6010c170 0x7f3a6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 --2- 172.21.15.1:0/1549660848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a60103660 0x7f3a6010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 --2- 172.21.15.1:0/1549660848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60103120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 -- 172.21.15.1:0/1549660848 >> 172.21.15.1:0/1549660848 conn(0x7f3a600fc7a0 msgr2=0x7f3a600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 -- 172.21.15.1:0/1549660848 shutdown_connections 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.904+0000 7f3a65257640 1 -- 172.21.15.1:0/1549660848 wait complete. 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 Processor -- start 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 -- start start 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a60103660 0x7f3a60198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a6010c170 0x7f3a6019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60111f70 con 0x7f3a60102d40 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a60111df0 con 0x7f3a60103660 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a65257640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3a601120f0 con 0x7f3a6010c170 2024-09-19T05:18:41.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a5ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a5ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60250/0 (socket says 172.21.15.1:60250) 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.905+0000 7f3a5ed9d640 1 -- 172.21.15.1:0/2173228931 learned_addr learned my addr 172.21.15.1:0/2173228931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5f59e640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a6010c170 0x7f3a6019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5e59c640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a60103660 0x7f3a60198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 -- 172.21.15.1:0/2173228931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a6010c170 msgr2=0x7f3a6019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a6010c170 0x7f3a6019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 -- 172.21.15.1:0/2173228931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a60103660 msgr2=0x7f3a60198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a60103660 0x7f3a60198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 -- 172.21.15.1:0/2173228931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6019d400 con 0x7f3a60102d40 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a5ed9d640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006010 tx=0x7f3a500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5003f030 con 0x7f3a60102d40 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a50003ce0 con 0x7f3a60102d40 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6019d690 con 0x7f3a60102d40 2024-09-19T05:18:41.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50035070 con 0x7f3a60102d40 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.906+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a601a4fd0 con 0x7f3a60102d40 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.907+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6006b070 con 0x7f3a60102d40 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.908+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3a50042030 con 0x7f3a60102d40 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.909+0000 7f3a47fff640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 0x7f3a480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.909+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3a500efa00 con 0x7f3a60102d40 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.909+0000 7f3a5e59c640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 0x7f3a480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.910+0000 7f3a5e59c640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 0x7f3a480a5780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a6010d4d0 tx=0x7f3a54005eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:41.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:41.913+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a500bcc80 con 0x7f3a60102d40 2024-09-19T05:18:42.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.128+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a601071e0 con 0x7f3a60102d40 2024-09-19T05:18:42.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.128+0000 7f3a47fff640 1 -- 172.21.15.1:0/2173228931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7201 (secure 0 0 0) 0x7f3a500bc580 con 0x7f3a60102d40 2024-09-19T05:18:42.130 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:42.130 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-09-19T05:18:40:755202+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T05:18:42.131 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.130+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 msgr2=0x7f3a480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.130+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 0x7f3a480a5780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a6010d4d0 tx=0x7f3a54005eb0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.130+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 msgr2=0x7f3a60198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.130+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006010 tx=0x7f3a500042f0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 shutdown_connections 2024-09-19T05:18:42.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3a480a32c0 0x7f3a480a5780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a6010c170 0x7f3a6019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a60103660 0x7f3a60198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 --2- 172.21.15.1:0/2173228931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a60102d40 0x7f3a60198450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 >> 172.21.15.1:0/2173228931 conn(0x7f3a600fc7a0 msgr2=0x7f3a600fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 shutdown_connections 2024-09-19T05:18:42.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:42.131+0000 7f3a65257640 1 -- 172.21.15.1:0/2173228931 wait complete. 2024-09-19T05:18:42.457 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:42 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2173228931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:42.574 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:42 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2173228931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:42.709 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 podman[66055]: 2024-09-19 05:18:42.705557544 +0000 UTC m=+0.361784938 container init 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-19T05:18:42.710 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 podman[66055]: 2024-09-19 05:18:42.708441976 +0000 UTC m=+0.364669369 container start 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T05:18:42.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:42 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2173228931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:43.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 ceph-mds[66075]: -- 172.21.15.82:0/2007833077 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596afcf7860 con 0x5596afcd5400 2024-09-19T05:18:43.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: starting mds.i at 2024-09-19T05:18:43.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 bash[66055]: 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 2024-09-19T05:18:43.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:18:42 smithi082 systemd[1]: Started Ceph mds.i for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:43.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:43.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:43 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:43 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:43 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:44 smithi001 ceph-mon[30968]: Deploying daemon mds.g on smithi001 2024-09-19T05:18:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:44 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:boot 2024-09-19T05:18:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:44 smithi001 ceph-mon[30968]: fsmap 9 up:standby 2024-09-19T05:18:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:44 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:18:44.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:44 smithi060 ceph-mon[35058]: Deploying daemon mds.g on smithi001 2024-09-19T05:18:44.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:44 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:boot 2024-09-19T05:18:44.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:44 smithi060 ceph-mon[35058]: fsmap 9 up:standby 2024-09-19T05:18:44.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:44 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:18:44.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:44 smithi082 ceph-mon[35195]: Deploying daemon mds.g on smithi001 2024-09-19T05:18:44.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:44 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:boot 2024-09-19T05:18:44.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:44 smithi082 ceph-mon[35195]: fsmap 9 up:standby 2024-09-19T05:18:44.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:44 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:18:44.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:45.091 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:44 smithi001 systemd[1]: Starting Ceph mds.g for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:45.435 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:45 smithi001 ceph-mon[30968]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:45.436 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 podman[71557]: 2024-09-19 05:18:45.029380692 +0000 UTC m=+0.017336231 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:45.436 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 podman[71557]: 2024-09-19 05:18:45.165270405 +0000 UTC m=+0.153225946 container create 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T05:18:45.436 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 podman[71557]: 2024-09-19 05:18:45.435014911 +0000 UTC m=+0.422970449 container init 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:18:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:45.724 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 podman[71557]: 2024-09-19 05:18:45.438053308 +0000 UTC m=+0.426008847 container start 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T05:18:45.724 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 ceph-mds[71601]: -- 172.21.15.1:0/4071161565 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1a97f5860 con 0x55f1a97d3000 2024-09-19T05:18:45.724 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g[71585]: starting mds.g at 2024-09-19T05:18:45.724 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 bash[71557]: 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff 2024-09-19T05:18:45.724 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:18:45 smithi001 systemd[1]: Started Ceph mds.g for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:45 smithi060 ceph-mon[35058]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:45 smithi082 ceph-mon[35195]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- 172.21.15.1:0/1988192109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c100a80 msgr2=0x7ff12c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 --2- 172.21.15.1:0/1988192109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c100a80 0x7ff12c100ee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff120009930 tx=0x7ff12002a420 comp rx=0 tx=0).stop 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- 172.21.15.1:0/1988192109 shutdown_connections 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 --2- 172.21.15.1:0/1988192109 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c101420 0x7ff12c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 --2- 172.21.15.1:0/1988192109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c100a80 0x7ff12c100ee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 --2- 172.21.15.1:0/1988192109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c106a80 0x7ff12c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- 172.21.15.1:0/1988192109 >> 172.21.15.1:0/1988192109 conn(0x7ff12c0fc7a0 msgr2=0x7ff12c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- 172.21.15.1:0/1988192109 shutdown_connections 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- 172.21.15.1:0/1988192109 wait complete. 2024-09-19T05:18:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 Processor -- start 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.098+0000 7ff132266640 1 -- start start 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c100a80 0x7ff12c0fce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c101420 0x7ff12c0fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c110e80 con 0x7ff12c106a80 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c110d00 con 0x7ff12c100a80 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff132266640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c111000 con 0x7ff12c101420 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff12bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c100a80 0x7ff12c0fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34594/0 (socket says 172.21.15.1:34594) 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 -- 172.21.15.1:0/1182220676 learned_addr learned my addr 172.21.15.1:0/1182220676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff12b7fe640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c101420 0x7ff12c0fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 -- 172.21.15.1:0/1182220676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c101420 msgr2=0x7ff12c0fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c101420 0x7ff12c0fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 -- 172.21.15.1:0/1182220676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c100a80 msgr2=0x7ff12c0fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c100a80 0x7ff12c0fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.099+0000 7ff130803640 1 -- 172.21.15.1:0/1182220676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c1a6940 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff130803640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff12400efd0 tx=0x7ff12400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124003b70 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c1a6c30 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124003d10 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1240109f0 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.100+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a7140 con 0x7ff12c106a80 2024-09-19T05:18:46.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.101+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c100ee0 con 0x7ff12c106a80 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.102+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff124004020 con 0x7ff12c106a80 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.103+0000 7ff1297fa640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 0x7ff1140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.103+0000 7ff12bfff640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 0x7ff1140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.103+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff1240cf930 con 0x7ff12c106a80 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.103+0000 7ff12bfff640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 0x7ff1140a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.107+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff12409ca50 con 0x7ff12c106a80 2024-09-19T05:18:46.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.326+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff12c10a000 con 0x7ff12c106a80 2024-09-19T05:18:46.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.326+0000 7ff1297fa640 1 -- 172.21.15.1:0/1182220676 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8851 (secure 0 0 0) 0x7ff12409c350 con 0x7ff12c106a80 2024-09-19T05:18:46.328 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:46.328 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"btime":"2024-09-19T05:18:46:285488+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:18:46.329 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 11 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 msgr2=0x7ff1140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 0x7ff1140a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005d00 tx=0x7ff11c00b410 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 msgr2=0x7ff12c0fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff12400efd0 tx=0x7ff12400c6a0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 shutdown_connections 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1140a3240 0x7ff1140a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff12c106a80 0x7ff12c0fd8a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff12c101420 0x7ff12c0fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 --2- 172.21.15.1:0/1182220676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff12c100a80 0x7ff12c0fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.328+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 >> 172.21.15.1:0/1182220676 conn(0x7ff12c0fc7a0 msgr2=0x7ff12c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.329+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 shutdown_connections 2024-09-19T05:18:46.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:46.329+0000 7ff132266640 1 -- 172.21.15.1:0/1182220676 wait complete. 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:46.855 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: Deploying daemon mds.a on smithi001 2024-09-19T05:18:46.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.1:6838/3689811065,v1:172.21.15.1:6839/3689811065] up:boot 2024-09-19T05:18:46.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: fsmap 10 up:standby 2024-09-19T05:18:46.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:18:46.856 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:46 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1182220676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: Deploying daemon mds.a on smithi001 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.1:6838/3689811065,v1:172.21.15.1:6839/3689811065] up:boot 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: fsmap 10 up:standby 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:18:47.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:46 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1182220676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:47.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: Deploying daemon mds.a on smithi001 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.1:6838/3689811065,v1:172.21.15.1:6839/3689811065] up:boot 2024-09-19T05:18:47.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: fsmap 10 up:standby 2024-09-19T05:18:47.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:18:47.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:46 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1182220676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:47 smithi001 ceph-mon[30968]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:48.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:47 smithi060 ceph-mon[35058]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:48.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:47 smithi082 ceph-mon[35195]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:48.842 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:48 smithi001 podman[71952]: 2024-09-19 05:18:48.723095254 +0000 UTC m=+0.134153401 container create 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T05:18:49.341 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:48 smithi001 podman[71952]: 2024-09-19 05:18:48.984193342 +0000 UTC m=+0.395251499 container init 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:18:49.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:48 smithi001 podman[71952]: 2024-09-19 05:18:48.98702436 +0000 UTC m=+0.398082507 container start 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:18:49.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mds[71971]: -- 172.21.15.1:0/4182657754 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c4adc1860 con 0x559c4ad9f000 2024-09-19T05:18:49.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a[71967]: starting mds.a at 2024-09-19T05:18:49.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:49 smithi001 bash[71952]: 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 2024-09-19T05:18:49.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:18:49 smithi001 systemd[1]: Started Ceph mds.a for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:49.531 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:49.797 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:49.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:49 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:49.881 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:49.881 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:49.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:49.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:49.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:49 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:18:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:18:50.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:49 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.280+0000 7f7c60da0640 1 -- 172.21.15.1:0/2229236440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 msgr2=0x7f7c5c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.280+0000 7f7c60da0640 1 --2- 172.21.15.1:0/2229236440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c10d7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009cd0 tx=0x7f7c5402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.280+0000 7f7c60da0640 1 -- 172.21.15.1:0/2229236440 shutdown_connections 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.280+0000 7f7c60da0640 1 --2- 172.21.15.1:0/2229236440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c10d7a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 --2- 172.21.15.1:0/2229236440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 --2- 172.21.15.1:0/2229236440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- 172.21.15.1:0/2229236440 >> 172.21.15.1:0/2229236440 conn(0x7f7c5c0fc630 msgr2=0x7f7c5c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- 172.21.15.1:0/2229236440 shutdown_connections 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- 172.21.15.1:0/2229236440 wait complete. 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 Processor -- start 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- start start 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c110cf0 con 0x7f7c5c101270 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c110b70 con 0x7f7c5c1068d0 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.281+0000 7f7c60da0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c110e70 con 0x7f7c5c1008d0 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34642/0 (socket says 172.21.15.1:34642) 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 -- 172.21.15.1:0/1754277921 learned_addr learned my addr 172.21.15.1:0/1754277921 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c5bfff640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c5b7fe640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 -- 172.21.15.1:0/1754277921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 msgr2=0x7f7c5c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 -- 172.21.15.1:0/1754277921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 msgr2=0x7f7c5c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 -- 172.21.15.1:0/1754277921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c19d2a0 con 0x7f7c5c101270 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c5b7fe640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c5bfff640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c53fff640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d950 tx=0x7f7c4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:50.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c44017070 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c44009c30 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c19d590 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400f6b0 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.282+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c1a4e70 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.283+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c100d30 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.285+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7c440109d0 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.285+0000 7f7c597fa640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 0x7f7c480a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.285+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f7c440cf0f0 con 0x7f7c5c101270 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.285+0000 7f7c5b7fe640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 0x7f7c480a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.286+0000 7f7c5b7fe640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 0x7f7c480a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:50.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.288+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c44009de0 con 0x7f7c5c101270 2024-09-19T05:18:50.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.498+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c5c199650 con 0x7f7c5c101270 2024-09-19T05:18:50.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.498+0000 7f7c597fa640 1 -- 172.21.15.1:0/1754277921 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9674 (secure 0 0 0) 0x7f7c5c199650 con 0x7f7c5c101270 2024-09-19T05:18:50.500 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:50.500 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-09-19T05:18:49:619419+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:18:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 msgr2=0x7f7c480a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 0x7f7c480a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c008040 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 msgr2=0x7f7c5c198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400d950 tx=0x7f7c4400de10 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 shutdown_connections 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7c480a32c0 0x7f7c480a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c5c1068d0 0x7f7c5c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7c5c101270 0x7f7c5c198830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 --2- 172.21.15.1:0/1754277921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5c1008d0 0x7f7c5c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 >> 172.21.15.1:0/1754277921 conn(0x7f7c5c0fc630 msgr2=0x7f7c5c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 shutdown_connections 2024-09-19T05:18:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:50.501+0000 7f7c60da0640 1 -- 172.21.15.1:0/1754277921 wait complete. 2024-09-19T05:18:50.819 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:50 smithi060 ceph-mon[35058]: Deploying daemon mds.b on smithi060 2024-09-19T05:18:50.819 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:50 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.1:6840/3860921021,v1:172.21.15.1:6841/3860921021] up:boot 2024-09-19T05:18:50.819 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:50 smithi060 ceph-mon[35058]: fsmap 11 up:standby 2024-09-19T05:18:50.819 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:50 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:18:50.819 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:50 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1754277921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:50.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:50 smithi001 ceph-mon[30968]: Deploying daemon mds.b on smithi060 2024-09-19T05:18:50.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:50 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.1:6840/3860921021,v1:172.21.15.1:6841/3860921021] up:boot 2024-09-19T05:18:50.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:50 smithi001 ceph-mon[30968]: fsmap 11 up:standby 2024-09-19T05:18:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:50 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:18:50.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:50 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1754277921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:50 smithi082 ceph-mon[35195]: Deploying daemon mds.b on smithi060 2024-09-19T05:18:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:50 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.1:6840/3860921021,v1:172.21.15.1:6841/3860921021] up:boot 2024-09-19T05:18:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:50 smithi082 ceph-mon[35195]: fsmap 11 up:standby 2024-09-19T05:18:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:50 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:18:51.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:50 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1754277921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:51.219 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 systemd[1]: Starting Ceph mds.b for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:18:51.475 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 podman[64509]: 2024-09-19 05:18:51.120669055 +0000 UTC m=+0.015838060 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:18:51.475 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 podman[64509]: 2024-09-19 05:18:51.245818586 +0000 UTC m=+0.140987581 container create 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T05:18:51.475 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 podman[64509]: 2024-09-19 05:18:51.474191174 +0000 UTC m=+0.369360167 container init 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T05:18:51.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:51 smithi060 ceph-mon[35058]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:51 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 podman[64509]: 2024-09-19 05:18:51.477290231 +0000 UTC m=+0.372459226 container start 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 ceph-mds[64529]: -- 172.21.15.60:0/313395163 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aff4e33860 con 0x55aff4e11000 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: starting mds.b at 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 bash[64509]: 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 2024-09-19T05:18:51.751 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:18:51 smithi060 systemd[1]: Started Ceph mds.b for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:18:51.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:51 smithi082 ceph-mon[35195]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:51.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:51 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:51 smithi001 ceph-mon[30968]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:51 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.60:6838/1625002585,v1:172.21.15.60:6839/1625002585] up:boot 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: fsmap 12 up:standby 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:52 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.60:6838/1625002585,v1:172.21.15.60:6839/1625002585] up:boot 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: fsmap 12 up:standby 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:52 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.60:6838/1625002585,v1:172.21.15.60:6839/1625002585] up:boot 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: fsmap 12 up:standby 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:52 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:53.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:53.490 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:53.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:53 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:54.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:53 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:54.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:54.010 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:53 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 -- 172.21.15.1:0/4088269865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4102790 msgr2=0x7f07d41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 --2- 172.21.15.1:0/4088269865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4102790 0x7f07d41067e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009900 tx=0x7f07bc02a410 comp rx=0 tx=0).stop 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 -- 172.21.15.1:0/4088269865 shutdown_connections 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 --2- 172.21.15.1:0/4088269865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4106f10 0x7f07d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 --2- 172.21.15.1:0/4088269865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4102790 0x7f07d41067e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 --2- 172.21.15.1:0/4088269865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4101de0 0x7f07d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 -- 172.21.15.1:0/4088269865 >> 172.21.15.1:0/4088269865 conn(0x7f07d40fd8c0 msgr2=0x7f07d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 -- 172.21.15.1:0/4088269865 shutdown_connections 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.029+0000 7f07d9732640 1 -- 172.21.15.1:0/4088269865 wait complete. 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 Processor -- start 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 -- start start 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4102790 0x7f07d41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 0x7f07d419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f07d4111f70 con 0x7f07d4101de0 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07d4111df0 con 0x7f07d4106f10 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d9732640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07d41120f0 con 0x7f07d4102790 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32826/0 (socket says 172.21.15.1:32826) 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 -- 172.21.15.1:0/58970227 learned_addr learned my addr 172.21.15.1:0/58970227 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d37fe640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 0x7f07d419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d27fc640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4102790 0x7f07d41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 -- 172.21.15.1:0/58970227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4102790 msgr2=0x7f07d41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4102790 0x7f07d41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 -- 172.21.15.1:0/58970227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 msgr2=0x7f07d419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 0x7f07d419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d2ffd640 1 -- 172.21.15.1:0/58970227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d419d440 con 0x7f07d4101de0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.030+0000 7f07d37fe640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 0x7f07d419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07d2ffd640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9f0 tx=0x7f07c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c400cd80 con 0x7f07d4101de0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07c4010910 con 0x7f07d4101de0 2024-09-19T05:18:54.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d419d730 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4018990 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.031+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d41a5010 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.032+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d41021c0 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.033+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f07c4010ac0 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.034+0000 7f07cbfff640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 0x7f07c00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.034+0000 7f07d27fc640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 0x7f07c00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.034+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f07c40cfb00 con 0x7f07d4101de0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.034+0000 7f07d27fc640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 0x7f07c00a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009230 tx=0x7f07bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:54.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.037+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07c409c670 con 0x7f07d4101de0 2024-09-19T05:18:54.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.267+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07d410a0f0 con 0x7f07d4101de0 2024-09-19T05:18:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.268+0000 7f07cbfff640 1 -- 172.21.15.1:0/58970227 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10500 (secure 0 0 0) 0x7f07c40a0970 con 0x7f07d4101de0 2024-09-19T05:18:54.269 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:54.270 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-19T05:18:51:630411+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:18:54.270 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 msgr2=0x7f07c00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 0x7f07c00a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009230 tx=0x7f07bc0058d0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 msgr2=0x7f07d4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07c400e9f0 tx=0x7f07c400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 shutdown_connections 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f07c00a32c0 0x7f07c00a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07d4106f10 0x7f07d419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07d4102790 0x7f07d41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 --2- 172.21.15.1:0/58970227 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f07d4101de0 0x7f07d4198490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 >> 172.21.15.1:0/58970227 conn(0x7f07d40fd8c0 msgr2=0x7f07d40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 shutdown_connections 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:54.270+0000 7f07d9732640 1 -- 172.21.15.1:0/58970227 wait complete. 2024-09-19T05:18:54.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:54 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:54.752 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:54 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/58970227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:54.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:54 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:54.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:54 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/58970227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:55.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:54 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:55.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:54 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/58970227' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:55.581 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T05:18:55.861 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:55 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:55 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:55 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 -- 172.21.15.1:0/1247046640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 msgr2=0x7f66b81063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 --2- 172.21.15.1:0/1247046640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b81063d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009ca0 tx=0x7f66a802a940 comp rx=0 tx=0).stop 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 -- 172.21.15.1:0/1247046640 shutdown_connections 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 --2- 172.21.15.1:0/1247046640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b81063d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 --2- 172.21.15.1:0/1247046640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8101450 0x7f66b8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 --2- 172.21.15.1:0/1247046640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8100b30 0x7f66b8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 -- 172.21.15.1:0/1247046640 >> 172.21.15.1:0/1247046640 conn(0x7f66b80fc7a0 msgr2=0x7f66b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:56.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 -- 172.21.15.1:0/1247046640 shutdown_connections 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.364+0000 7f66bf871640 1 -- 172.21.15.1:0/1247046640 wait complete. 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 Processor -- start 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 -- start start 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8100b30 0x7f66b81a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8101450 0x7f66b81a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8118580 con 0x7f66b8105f40 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8118400 con 0x7f66b8101450 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bf871640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66b8118700 con 0x7f66b8100b30 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bde0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:56.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bde0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32842/0 (socket says 172.21.15.1:32842) 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bde0e640 1 -- 172.21.15.1:0/3550607350 learned_addr learned my addr 172.21.15.1:0/3550607350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bd60d640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8100b30 0x7f66b81a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.365+0000 7f66bce0c640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8101450 0x7f66b81a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 -- 172.21.15.1:0/3550607350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8100b30 msgr2=0x7f66b81a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8100b30 0x7f66b81a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 -- 172.21.15.1:0/3550607350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8101450 msgr2=0x7f66b81a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8101450 0x7f66b81a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 -- 172.21.15.1:0/3550607350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b819eff0 con 0x7f66b8105f40 2024-09-19T05:18:56.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bde0e640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66a8006010 tx=0x7f66a802f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8034040 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66a8003e50 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b819f280 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8004800 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.366+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b81ab530 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.367+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b806b070 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.368+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f66a8037020 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.369+0000 7f66b67fc640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 0x7f66a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.369+0000 7f66bd60d640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 0x7f66a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.369+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f66a80f0380 con 0x7f66b8105f40 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.369+0000 7f66bd60d640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 0x7f66a00a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005d00 tx=0x7f66b000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:56.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.373+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66a80098b0 con 0x7f66b8105f40 2024-09-19T05:18:56.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.556+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f66b81ab700 con 0x7f66b8105f40 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.556+0000 7f66b67fc640 1 -- 172.21.15.1:0/3550607350 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f66a80bd5d0 con 0x7f66b8105f40 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:18:56.558 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 msgr2=0x7f66a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 0x7f66a00a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66b0005d00 tx=0x7f66b000b410 comp rx=0 tx=0).stop 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 msgr2=0x7f66b819e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66a8006010 tx=0x7f66a802f700 comp rx=0 tx=0).stop 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 shutdown_connections 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66a00a3240 0x7f66a00a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66b8105f40 0x7f66b819e850 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66b8101450 0x7f66b81a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 --2- 172.21.15.1:0/3550607350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66b8100b30 0x7f66b81a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:56.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.558+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 >> 172.21.15.1:0/3550607350 conn(0x7f66b80fc7a0 msgr2=0x7f66b81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:56.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.559+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 shutdown_connections 2024-09-19T05:18:56.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:56.559+0000 7f66bf871640 1 -- 172.21.15.1:0/3550607350 wait complete. 2024-09-19T05:18:57.264 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:18:57.264 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:18:57.524 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:57.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:57 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3550607350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:57 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3550607350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:18:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:57 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3550607350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:18:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 -- 172.21.15.1:0/2142771234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925410e500 msgr2=0x7f9254110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2142771234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925410e500 0x7f9254110910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f924c009ca0 tx=0x7f924c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 -- 172.21.15.1:0/2142771234 shutdown_connections 2024-09-19T05:18:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2142771234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f925410e500 0x7f9254110910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2142771234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2142771234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9254100b20 0x7f9254100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 -- 172.21.15.1:0/2142771234 >> 172.21.15.1:0/2142771234 conn(0x7f92540fc7d0 msgr2=0x7f92540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 -- 172.21.15.1:0/2142771234 shutdown_connections 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.011+0000 7f925bb3e640 1 -- 172.21.15.1:0/2142771234 wait complete. 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 Processor -- start 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 -- start start 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 0x7f925419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9254114230 con 0x7f9254100b20 2024-09-19T05:18:58.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92541140b0 con 0x7f9254101440 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f925bb3e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92541143b0 con 0x7f925410e500 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f92598da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f92598da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32860/0 (socket says 172.21.15.1:32860) 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.012+0000 7f92598da640 1 -- 172.21.15.1:0/2315727032 learned_addr learned my addr 172.21.15.1:0/2315727032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 -- 172.21.15.1:0/2315727032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 msgr2=0x7f925419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92590d9640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f925a0db640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 0x7f925419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 0x7f925419efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 -- 172.21.15.1:0/2315727032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 msgr2=0x7f925419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 -- 172.21.15.1:0/2315727032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925419f6a0 con 0x7f9254100b20 2024-09-19T05:18:58.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f925a0db640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 0x7f925419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92590d9640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f92598da640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f925000c920 tx=0x7f925000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250007c70 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925419f990 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9250007e10 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250018890 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.013+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92541a7270 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.014+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9254100f00 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.015+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9250018a50 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.016+0000 7f924affd640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.016+0000 7f92590d9640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.016+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f92500cf9b0 con 0x7f9254100b20 2024-09-19T05:18:58.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.016+0000 7f92590d9640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 0x7f92400a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f92541027b0 tx=0x7f9244005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:58.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.019+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9250014030 con 0x7f9254100b20 2024-09-19T05:18:58.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.194+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f925419ba50 con 0x7f9254100b20 2024-09-19T05:18:58.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.678+0000 7f924affd640 1 -- 172.21.15.1:0/2315727032 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f925009cb60 con 0x7f9254100b20 2024-09-19T05:18:58.679 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-19T05:18:58.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 msgr2=0x7f92400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 0x7f92400a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f92541027b0 tx=0x7f9244005e50 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 msgr2=0x7f925419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f925000c920 tx=0x7f925000cde0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 shutdown_connections 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92400a3240 0x7f92400a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f925410e500 0x7f925419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9254101440 0x7f925419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 --2- 172.21.15.1:0/2315727032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9254100b20 0x7f925419a6f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 >> 172.21.15.1:0/2315727032 conn(0x7f92540fc7d0 msgr2=0x7f92540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 shutdown_connections 2024-09-19T05:18:58.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:18:58.680+0000 7f925bb3e640 1 -- 172.21.15.1:0/2315727032 wait complete. 2024-09-19T05:18:59.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:58 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:18:59.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:58 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:18:59.040 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:58 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:18:59.405 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T05:18:59.671 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:59 smithi001 ceph-mon[30968]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:18:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:59 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:18:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:59 smithi001 ceph-mon[30968]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:18:59.691 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:18:59 smithi001 ceph-mon[30968]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:19:00.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:59 smithi060 ceph-mon[35058]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:59 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:19:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:59 smithi060 ceph-mon[35058]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:19:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:18:59 smithi060 ceph-mon[35058]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:19:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:59 smithi082 ceph-mon[35195]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:59 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2315727032' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:19:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:59 smithi082 ceph-mon[35195]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:19:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:18:59 smithi082 ceph-mon[35195]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:19:00.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 -- 172.21.15.1:0/26216213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 msgr2=0x7f8138101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 --2- 172.21.15.1:0/26216213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138101200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8128009ca0 tx=0x7f812802a950 comp rx=0 tx=0).stop 2024-09-19T05:19:00.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 -- 172.21.15.1:0/26216213 shutdown_connections 2024-09-19T05:19:00.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 --2- 172.21.15.1:0/26216213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102ef0 0x7f813810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 --2- 172.21.15.1:0/26216213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102570 0x7f81381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 --2- 172.21.15.1:0/26216213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138101200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 -- 172.21.15.1:0/26216213 >> 172.21.15.1:0/26216213 conn(0x7f81380fc7d0 msgr2=0x7f81380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 -- 172.21.15.1:0/26216213 shutdown_connections 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.291+0000 7f81407cc640 1 -- 172.21.15.1:0/26216213 wait complete. 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 Processor -- start 2024-09-19T05:19:00.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 -- start start 2024-09-19T05:19:00.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102570 0x7f8138198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 0x7f813819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110f80 con 0x7f8138100e20 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110e00 con 0x7f8138102570 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f81407cc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8138111100 con 0x7f8138102ef0 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f813e568640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f813e568640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32886/0 (socket says 172.21.15.1:32886) 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f813e568640 1 -- 172.21.15.1:0/1201276537 learned_addr learned my addr 172.21.15.1:0/1201276537 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.292+0000 7f813dd67640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102570 0x7f8138198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813ed69640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 0x7f813819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 -- 172.21.15.1:0/1201276537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 msgr2=0x7f813819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 0x7f813819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 -- 172.21.15.1:0/1201276537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102570 msgr2=0x7f8138198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102570 0x7f8138198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 -- 172.21.15.1:0/1201276537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813819d4b0 con 0x7f8138100e20 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813ed69640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 0x7f813819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f813e568640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8128005cc0 tx=0x7f812802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128034040 con 0x7f8138100e20 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8128030920 con 0x7f8138100e20 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813819d740 con 0x7f8138100e20 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280046e0 con 0x7f8138100e20 2024-09-19T05:19:00.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.293+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a5080 con 0x7f8138100e20 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.294+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81381021b0 con 0x7f8138100e20 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.296+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8128037020 con 0x7f8138100e20 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.296+0000 7f81377fe640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 0x7f81200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.297+0000 7f813dd67640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 0x7f81200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.297+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f81280f0520 con 0x7f8138100e20 2024-09-19T05:19:00.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.297+0000 7f813dd67640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 0x7f81200a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81380fff40 tx=0x7f812c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:00.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.300+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81280bd600 con 0x7f8138100e20 2024-09-19T05:19:00.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.481+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f81381a5250 con 0x7f8138100e20 2024-09-19T05:19:00.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.920+0000 7f81377fe640 1 -- 172.21.15.1:0/1201276537 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) ==== 171+0+0 (secure 0 0 0) 0x7f81280bcf00 con 0x7f8138100e20 2024-09-19T05:19:00.922 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-19T05:19:00.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 msgr2=0x7f81200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 0x7f81200a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81380fff40 tx=0x7f812c005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:00.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 msgr2=0x7f8138198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8128005cc0 tx=0x7f812802f420 comp rx=0 tx=0).stop 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 shutdown_connections 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f81200a3240 0x7f81200a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8138102ef0 0x7f813819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138102570 0x7f8138198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 --2- 172.21.15.1:0/1201276537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8138100e20 0x7f8138198500 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 >> 172.21.15.1:0/1201276537 conn(0x7f81380fc7d0 msgr2=0x7f813806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.923+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 shutdown_connections 2024-09-19T05:19:00.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:00.924+0000 7f81407cc640 1 -- 172.21.15.1:0/1201276537 wait complete. 2024-09-19T05:19:01.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:00 smithi001 ceph-mon[30968]: pgmap v273: 33 pgs: 1 creating+activating, 3 active+clean, 29 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:01.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T05:19:01.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:00 smithi001 ceph-mon[30968]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:01.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T05:19:01.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:00 smithi001 ceph-mon[30968]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:19:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:00 smithi060 ceph-mon[35058]: pgmap v273: 33 pgs: 1 creating+activating, 3 active+clean, 29 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:00 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T05:19:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:00 smithi060 ceph-mon[35058]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:00 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T05:19:01.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:00 smithi060 ceph-mon[35058]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:19:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:00 smithi082 ceph-mon[35195]: pgmap v273: 33 pgs: 1 creating+activating, 3 active+clean, 29 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:00 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T05:19:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:00 smithi082 ceph-mon[35195]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:00 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1201276537' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T05:19:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:00 smithi082 ceph-mon[35195]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:19:01.578 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:19:01.837 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:02.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 -- 172.21.15.1:0/7501957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4106a60 msgr2=0x7ff1b4106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/7501957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4106a60 0x7ff1b4106e40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009930 tx=0x7ff1a402a420 comp rx=0 tx=0).stop 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 -- 172.21.15.1:0/7501957 shutdown_connections 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/7501957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4101400 0x7ff1b410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/7501957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b4100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/7501957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4106a60 0x7ff1b4106e40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 -- 172.21.15.1:0/7501957 >> 172.21.15.1:0/7501957 conn(0x7ff1b40fc780 msgr2=0x7ff1b40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 -- 172.21.15.1:0/7501957 shutdown_connections 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.355+0000 7ff1b8c00640 1 -- 172.21.15.1:0/7501957 wait complete. 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 Processor -- start 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 -- start start 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4106a60 0x7ff1b419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:02.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4110e20 con 0x7ff1b4101400 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4110ca0 con 0x7ff1b4100a60 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b8c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b4110fa0 con 0x7ff1b4106a60 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32910/0 (socket says 172.21.15.1:32910) 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.356+0000 7ff1b1d9b640 1 -- 172.21.15.1:0/2415634873 learned_addr learned my addr 172.21.15.1:0/2415634873 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b259c640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 -- 172.21.15.1:0/2415634873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4106a60 msgr2=0x7ff1b419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b2d9d640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4106a60 0x7ff1b419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4106a60 0x7ff1b419eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 -- 172.21.15.1:0/2415634873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 msgr2=0x7ff1b419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 -- 172.21.15.1:0/2415634873 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b419f5b0 con 0x7ff1b4101400 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b259c640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:02.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b1d9b640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c920 tx=0x7ff1a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8007c70 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1a8007e10 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b419f8a0 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8018890 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.357+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b41a7180 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.358+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b4100ec0 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.359+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff1a8018a50 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.360+0000 7ff1a37fe640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 0x7ff19c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.361+0000 7ff1b259c640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 0x7ff19c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.361+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7ff1a80cfca0 con 0x7ff1b4101400 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.361+0000 7ff1b259c640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 0x7ff19c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000c00 tx=0x7ff1a4032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:02.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.364+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff1a8014030 con 0x7ff1b4101400 2024-09-19T05:19:02.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.577+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff1b419b960 con 0x7ff1b4101400 2024-09-19T05:19:02.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.969+0000 7ff1a37fe640 1 -- 172.21.15.1:0/2415634873 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff1a809cb60 con 0x7ff1b4101400 2024-09-19T05:19:02.971 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T05:19:02.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 msgr2=0x7ff19c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 0x7ff19c0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000c00 tx=0x7ff1a4032d50 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 msgr2=0x7ff1b419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800c920 tx=0x7ff1a800cde0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 shutdown_connections 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff19c0a3240 0x7ff19c0a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1b4106a60 0x7ff1b419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1b4101400 0x7ff1b419ab40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 --2- 172.21.15.1:0/2415634873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b4100a60 0x7ff1b419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 >> 172.21.15.1:0/2415634873 conn(0x7ff1b40fc780 msgr2=0x7ff1b410c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 shutdown_connections 2024-09-19T05:19:02.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:02.973+0000 7ff1b8c00640 1 -- 172.21.15.1:0/2415634873 wait complete. 2024-09-19T05:19:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:02 smithi060 ceph-mon[35058]: pgmap v275: 97 pgs: 27 creating+peering, 2 creating+activating, 25 active+clean, 43 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:03.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:02 smithi060 ceph-mon[35058]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:19:03.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:02 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:19:03.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:02 smithi060 ceph-mon[35058]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:19:03.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:02 smithi082 ceph-mon[35195]: pgmap v275: 97 pgs: 27 creating+peering, 2 creating+activating, 25 active+clean, 43 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:03.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:02 smithi082 ceph-mon[35195]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:19:03.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:02 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:19:03.252 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:02 smithi082 ceph-mon[35195]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:19:03.308 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:02 smithi001 ceph-mon[30968]: pgmap v275: 97 pgs: 27 creating+peering, 2 creating+activating, 25 active+clean, 43 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:03.308 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:02 smithi001 ceph-mon[30968]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:19:03.309 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:02 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:19:03.309 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:02 smithi001 ceph-mon[30968]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:19:03.695 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T05:19:03.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T05:19:03.960 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:04.212 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:03 smithi060 ceph-mon[35058]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:19:04.212 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:03 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:19:04.212 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:03 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:19:04.212 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:03 smithi060 ceph-mon[35058]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:19:04.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:03 smithi001 ceph-mon[30968]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:19:04.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:03 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:19:04.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:03 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:19:04.230 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:03 smithi001 ceph-mon[30968]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:19:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:03 smithi082 ceph-mon[35195]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:19:04.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:03 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2415634873' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:19:04.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:03 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:19:04.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:03 smithi082 ceph-mon[35195]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:19:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2771745729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8101de0 msgr2=0x7fbfa81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2771745729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8101de0 0x7fbfa81021c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009900 tx=0x7fbfa402a410 comp rx=0 tx=0).stop 2024-09-19T05:19:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2771745729 shutdown_connections 2024-09-19T05:19:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2771745729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 0x7fbfa810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2771745729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8102790 0x7fbfa81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2771745729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8101de0 0x7fbfa81021c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2771745729 >> 172.21.15.1:0/2771745729 conn(0x7fbfa80fd8c0 msgr2=0x7fbfa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2771745729 shutdown_connections 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.457+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2771745729 wait complete. 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 Processor -- start 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 -- start start 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8101de0 0x7fbfa80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 0x7fbfa8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa8111f70 con 0x7fbfa8102790 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa8111df0 con 0x7fbfa8106f10 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfafb6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa81120f0 con 0x7fbfa8101de0 2024-09-19T05:19:04.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58252/0 (socket says 172.21.15.1:58252) 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 -- 172.21.15.1:0/2249916537 learned_addr learned my addr 172.21.15.1:0/2249916537 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfae108640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 0x7fbfa8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad907640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8101de0 0x7fbfa80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 -- 172.21.15.1:0/2249916537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8101de0 msgr2=0x7fbfa80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8101de0 0x7fbfa80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 -- 172.21.15.1:0/2249916537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 msgr2=0x7fbfa8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 0x7fbfa8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 -- 172.21.15.1:0/2249916537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa81a6890 con 0x7fbfa8102790 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.458+0000 7fbfad106640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c920 tx=0x7fbf9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.459+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98007c70 con 0x7fbfa8102790 2024-09-19T05:19:04.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.459+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf98007e10 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.459+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa81a6b80 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.459+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf98018890 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.459+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa81a7110 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.460+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa81021c0 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.461+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbf98018a50 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.462+0000 7fbf9effd640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 0x7fbf940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.462+0000 7fbfad907640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 0x7fbf940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.462+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fbf980cfb30 con 0x7fbfa8102790 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.462+0000 7fbfad907640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 0x7fbf940a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005ab0 tx=0x7fbfa4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:04.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.465+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf98014030 con 0x7fbfa8102790 2024-09-19T05:19:04.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.649+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fbfa8075a20 con 0x7fbfa8102790 2024-09-19T05:19:04.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.979+0000 7fbf9effd640 1 -- 172.21.15.1:0/2249916537 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7fbf9809cab0 con 0x7fbfa8102790 2024-09-19T05:19:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 msgr2=0x7fbf940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 0x7fbf940a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4005ab0 tx=0x7fbfa4005a20 comp rx=0 tx=0).stop 2024-09-19T05:19:04.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 msgr2=0x7fbfa8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c920 tx=0x7fbf9800cde0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 shutdown_connections 2024-09-19T05:19:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf940a32c0 0x7fbf940a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfa8106f10 0x7fbfa8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbfa8102790 0x7fbfa8074a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 --2- 172.21.15.1:0/2249916537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfa8101de0 0x7fbfa80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:04.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 >> 172.21.15.1:0/2249916537 conn(0x7fbfa80fd8c0 msgr2=0x7fbfa80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:04.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 shutdown_connections 2024-09-19T05:19:04.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:04.982+0000 7fbfafb6b640 1 -- 172.21.15.1:0/2249916537 wait complete. 2024-09-19T05:19:05.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: pgmap v278: 97 pgs: 27 creating+peering, 2 creating+activating, 44 active+clean, 24 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: Cluster is now healthy 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:active 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:04 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: pgmap v278: 97 pgs: 27 creating+peering, 2 creating+activating, 44 active+clean, 24 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: Cluster is now healthy 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:active 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:04 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T05:19:05.310 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: pgmap v278: 97 pgs: 27 creating+peering, 2 creating+activating, 44 active+clean, 24 unknown; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: Cluster is now healthy 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] up:active 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:05.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:04 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T05:19:05.663 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:19:05.927 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:05 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T05:19:06.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:05 smithi060 ceph-mon[35058]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:19:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:05 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T05:19:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:05 smithi082 ceph-mon[35195]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:19:06.314 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:05 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2249916537' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T05:19:06.314 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:05 smithi001 ceph-mon[30968]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:19:06.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.402+0000 7ff388b33640 1 -- 172.21.15.1:0/2095307457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384108290 msgr2=0x7ff38410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.402+0000 7ff388b33640 1 --2- 172.21.15.1:0/2095307457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384108290 0x7ff38410ec30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009cd0 tx=0x7ff37c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 -- 172.21.15.1:0/2095307457 shutdown_connections 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 --2- 172.21.15.1:0/2095307457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384108290 0x7ff38410ec30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 --2- 172.21.15.1:0/2095307457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384103740 0x7ff384107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 --2- 172.21.15.1:0/2095307457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384102d90 0x7ff384103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 -- 172.21.15.1:0/2095307457 >> 172.21.15.1:0/2095307457 conn(0x7ff3840fc7d0 msgr2=0x7ff3840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 -- 172.21.15.1:0/2095307457 shutdown_connections 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 -- 172.21.15.1:0/2095307457 wait complete. 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.403+0000 7ff388b33640 1 Processor -- start 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 -- start start 2024-09-19T05:19:06.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384103740 0x7ff3841a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384108290 0x7ff38419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841120d0 con 0x7ff384102d90 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff384111f50 con 0x7ff384108290 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff388b33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff384112250 con 0x7ff384103740 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58256/0 (socket says 172.21.15.1:58256) 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 -- 172.21.15.1:0/3935225529 learned_addr learned my addr 172.21.15.1:0/3935225529 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff382d9d640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384108290 0x7ff38419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff379d9b640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384103740 0x7ff3841a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 -- 172.21.15.1:0/3935225529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384103740 msgr2=0x7ff3841a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384103740 0x7ff3841a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 -- 172.21.15.1:0/3935225529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384108290 msgr2=0x7ff38419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384108290 0x7ff38419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 -- 172.21.15.1:0/3935225529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38419acd0 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.404+0000 7ff38259c640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c890 tx=0x7ff37400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.405+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374004220 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.405+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38419afc0 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.405+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3740043c0 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.405+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374004a00 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.405+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3841a72b0 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.406+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384103170 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.407+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff3740079b0 con 0x7ff384102d90 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.407+0000 7ff37bfff640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 0x7ff3700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.408+0000 7ff379d9b640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 0x7ff3700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.408+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7ff3740cf5d0 con 0x7ff384102d90 2024-09-19T05:19:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.408+0000 7ff379d9b640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 0x7ff3700a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3840fde60 tx=0x7ff36c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.412+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff374014030 con 0x7ff384102d90 2024-09-19T05:19:06.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:06.587+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff38419bad0 con 0x7ff384102d90 2024-09-19T05:19:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:06 smithi060 ceph-mon[35058]: pgmap v280: 97 pgs: 27 creating+peering, 70 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T05:19:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:06 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:19:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:06 smithi082 ceph-mon[35195]: pgmap v280: 97 pgs: 27 creating+peering, 70 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T05:19:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:06 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:19:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:06 smithi001 ceph-mon[30968]: pgmap v280: 97 pgs: 27 creating+peering, 70 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-19T05:19:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:06 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:19:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:07.995+0000 7ff37bfff640 1 -- 172.21.15.1:0/3935225529 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7ff37409c260 con 0x7ff384102d90 2024-09-19T05:19:07.997 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data_ec' created 2024-09-19T05:19:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:07.999+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 msgr2=0x7ff3700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:07.999+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 0x7ff3700a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3840fde60 tx=0x7ff36c009110 comp rx=0 tx=0).stop 2024-09-19T05:19:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:07.999+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 msgr2=0x7ff3841a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:08.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:07.999+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c890 tx=0x7ff37400cc90 comp rx=0 tx=0).stop 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 shutdown_connections 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff3700a3240 0x7ff3700a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff384108290 0x7ff38419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384103740 0x7ff3841a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 --2- 172.21.15.1:0/3935225529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff384102d90 0x7ff3841a03e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 >> 172.21.15.1:0/3935225529 conn(0x7ff3840fc7d0 msgr2=0x7ff384100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 shutdown_connections 2024-09-19T05:19:08.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:08.000+0000 7ff388b33640 1 -- 172.21.15.1:0/3935225529 wait complete. 2024-09-19T05:19:08.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:07 smithi060 ceph-mon[35058]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:19:08.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:07 smithi082 ceph-mon[35195]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:19:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:07 smithi001 ceph-mon[30968]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:19:08.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T05:19:08.758 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:19:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: 2024-09-19T05:19:08.282+0000 7fdef2686640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:19:08.996 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:09.012 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:09 smithi001 ceph-mon[30968]: pgmap v282: 97 pgs: 97 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T05:19:09.012 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:09 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:19:09.012 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:09 smithi001 ceph-mon[30968]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:19:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:09 smithi082 ceph-mon[35195]: pgmap v282: 97 pgs: 97 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T05:19:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:09 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:19:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:09 smithi082 ceph-mon[35195]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:19:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:09 smithi060 ceph-mon[35058]: pgmap v282: 97 pgs: 97 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T05:19:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:09 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3935225529' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:19:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:09 smithi060 ceph-mon[35058]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:19:09.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- 172.21.15.1:0/803505321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe534101270 msgr2=0x7fe53410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 --2- 172.21.15.1:0/803505321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe534101270 0x7fe53410df30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe51c009900 tx=0x7fe51c02a410 comp rx=0 tx=0).stop 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- 172.21.15.1:0/803505321 shutdown_connections 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 --2- 172.21.15.1:0/803505321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53410e470 0x7fe534110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 --2- 172.21.15.1:0/803505321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe534101270 0x7fe53410df30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 --2- 172.21.15.1:0/803505321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe534100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- 172.21.15.1:0/803505321 >> 172.21.15.1:0/803505321 conn(0x7fe5340fc7d0 msgr2=0x7fe5340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- 172.21.15.1:0/803505321 shutdown_connections 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- 172.21.15.1:0/803505321 wait complete. 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 Processor -- start 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.524+0000 7fe5399d7640 1 -- start start 2024-09-19T05:19:09.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe53419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe534101270 0x7fe53419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5341141a0 con 0x7fe53410e470 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe534114020 con 0x7fe534101270 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5399d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe534114320 con 0x7fe5341008c0 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58268/0 (socket says 172.21.15.1:58268) 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 -- 172.21.15.1:0/3014155178 learned_addr learned my addr 172.21.15.1:0/3014155178 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe532ffd640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe53419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5327fc640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe534101270 0x7fe53419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 -- 172.21.15.1:0/3014155178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 msgr2=0x7fe53419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:09.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe53419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 -- 172.21.15.1:0/3014155178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe534101270 msgr2=0x7fe53419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe534101270 0x7fe53419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 -- 172.21.15.1:0/3014155178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53419f6f0 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe532ffd640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe53419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.525+0000 7fe5337fe640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe52400cab0 tx=0x7fe52400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.526+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524007e10 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.526+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe52400f930 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.526+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53419f9e0 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.526+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524018b80 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.526+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341a72c0 con 0x7fe53410e470 2024-09-19T05:19:09.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.527+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe534100ca0 con 0x7fe53410e470 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.528+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe52400fae0 con 0x7fe53410e470 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.529+0000 7fe5389d5640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 0x7fe5200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.529+0000 7fe532ffd640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 0x7fe5200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.529+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7fe5240cfd80 con 0x7fe53410e470 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.530+0000 7fe532ffd640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 0x7fe5200a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:09.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.533+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe524014030 con 0x7fe53410e470 2024-09-19T05:19:09.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:09.709+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe534109070 con 0x7fe53410e470 2024-09-19T05:19:10.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.008+0000 7fe5389d5640 1 -- 172.21.15.1:0/3014155178 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7fe52409c880 con 0x7fe53410e470 2024-09-19T05:19:10.010 INFO:teuthology.orchestra.run.smithi001.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 msgr2=0x7fe5200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 0x7fe5200a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c00b390 comp rx=0 tx=0).stop 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 msgr2=0x7fe53419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe52400cab0 tx=0x7fe52400cf70 comp rx=0 tx=0).stop 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 shutdown_connections 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe5200a3240 0x7fe5200a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe53410e470 0x7fe53419f010 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe534101270 0x7fe53419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 --2- 172.21.15.1:0/3014155178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5341008c0 0x7fe53419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 >> 172.21.15.1:0/3014155178 conn(0x7fe5340fc7d0 msgr2=0x7fe5340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 shutdown_connections 2024-09-19T05:19:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:10.011+0000 7fe5399d7640 1 -- 172.21.15.1:0/3014155178 wait complete. 2024-09-19T05:19:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:10 smithi001 ceph-mon[30968]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:10 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T05:19:10.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:10 smithi060 ceph-mon[35058]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:10 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T05:19:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:10 smithi082 ceph-mon[35195]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:10 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T05:19:10.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T05:19:11.026 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:11.301 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:11 smithi001 ceph-mon[30968]: pgmap v285: 129 pgs: 31 unknown, 98 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-09-19T05:19:11.302 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:11 smithi001 ceph-mon[30968]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:11.302 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:11 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T05:19:11.302 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:11 smithi001 ceph-mon[30968]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:19:11.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:11 smithi060 ceph-mon[35058]: pgmap v285: 129 pgs: 31 unknown, 98 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-09-19T05:19:11.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:11 smithi060 ceph-mon[35058]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:11.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:11 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T05:19:11.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:11 smithi060 ceph-mon[35058]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:19:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:11 smithi082 ceph-mon[35195]: pgmap v285: 129 pgs: 31 unknown, 98 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 5 op/s 2024-09-19T05:19:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:11 smithi082 ceph-mon[35195]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:19:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:11 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3014155178' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T05:19:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:11 smithi082 ceph-mon[35195]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:19:11.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- 172.21.15.1:0/4016141674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8101420 msgr2=0x7ff2d810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:11.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/4016141674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8101420 0x7ff2d810d950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009cd0 tx=0x7ff2d002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- 172.21.15.1:0/4016141674 shutdown_connections 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/4016141674 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8101420 0x7ff2d810d950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/4016141674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/4016141674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8106a80 0x7ff2d8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- 172.21.15.1:0/4016141674 >> 172.21.15.1:0/4016141674 conn(0x7ff2d80fc7a0 msgr2=0x7ff2d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- 172.21.15.1:0/4016141674 shutdown_connections 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- 172.21.15.1:0/4016141674 wait complete. 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 Processor -- start 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.533+0000 7ff2dd6af640 1 -- start start 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8101420 0x7ff2d8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8110e80 con 0x7ff2d8106a80 2024-09-19T05:19:11.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8110d00 con 0x7ff2d8101420 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2dd6af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8111000 con 0x7ff2d8100a80 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58278/0 (socket says 172.21.15.1:58278) 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 -- 172.21.15.1:0/1162322979 learned_addr learned my addr 172.21.15.1:0/1162322979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2cffff640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8101420 0x7ff2d8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d6ffd640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 -- 172.21.15.1:0/1162322979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 msgr2=0x7ff2d8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 -- 172.21.15.1:0/1162322979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8101420 msgr2=0x7ff2d8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8101420 0x7ff2d8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 -- 172.21.15.1:0/1162322979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d81a47f0 con 0x7ff2d8106a80 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d6ffd640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:11.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.534+0000 7ff2d77fe640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0006010 tx=0x7ff2d0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.535+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0004450 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.535+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d81a49c0 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.535+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2d0003e10 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.535+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0046480 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.535+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d81a4ea0 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.536+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d8100ee0 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.537+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff2d00045f0 con 0x7ff2d8106a80 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.537+0000 7ff2d4ff9640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 0x7ff2c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.538+0000 7ff2d6ffd640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 0x7ff2c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:11.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.538+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7ff2d002e030 con 0x7ff2d8106a80 2024-09-19T05:19:11.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.538+0000 7ff2d6ffd640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 0x7ff2c40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005d90 tx=0x7ff2c8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:11.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.542+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2d004b060 con 0x7ff2d8106a80 2024-09-19T05:19:11.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:11.755+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ff2d81a50d0 con 0x7ff2d8106a80 2024-09-19T05:19:12.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.016+0000 7ff2d4ff9640 1 -- 172.21.15.1:0/1162322979 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7ff2d00bdfe0 con 0x7ff2d8106a80 2024-09-19T05:19:12.018 INFO:teuthology.orchestra.run.smithi001.stderr:added data pool 4 to fsmap 2024-09-19T05:19:12.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.019+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 msgr2=0x7ff2c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:12.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.019+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 0x7ff2c40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005d90 tx=0x7ff2c8005d20 comp rx=0 tx=0).stop 2024-09-19T05:19:12.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.019+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 msgr2=0x7ff2d81a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:12.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.019+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0006010 tx=0x7ff2d0003c20 comp rx=0 tx=0).stop 2024-09-19T05:19:12.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 shutdown_connections 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2c40a3240 0x7ff2c40a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d8106a80 0x7ff2d81a42b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d8101420 0x7ff2d8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 --2- 172.21.15.1:0/1162322979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d8100a80 0x7ff2d8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 >> 172.21.15.1:0/1162322979 conn(0x7ff2d80fc7a0 msgr2=0x7ff2d80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 shutdown_connections 2024-09-19T05:19:12.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:12.020+0000 7ff2dd6af640 1 -- 172.21.15.1:0/1162322979 wait complete. 2024-09-19T05:19:12.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:12 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T05:19:12.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:12 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T05:19:12.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:12 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T05:19:12.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:12.997 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:13.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:13 smithi001 ceph-mon[30968]: pgmap v287: 129 pgs: 7 unknown, 122 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 846 B/s wr, 2 op/s 2024-09-19T05:19:13.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:13 smithi001 ceph-mon[30968]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:19:13.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:13 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T05:19:13.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:13 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:13.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:13 smithi060 ceph-mon[35058]: pgmap v287: 129 pgs: 7 unknown, 122 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 846 B/s wr, 2 op/s 2024-09-19T05:19:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:13 smithi060 ceph-mon[35058]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:19:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:13 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T05:19:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:13 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:13 smithi082 ceph-mon[35195]: pgmap v287: 129 pgs: 7 unknown, 122 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 846 B/s wr, 2 op/s 2024-09-19T05:19:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:13 smithi082 ceph-mon[35195]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:19:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:13 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1162322979' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T05:19:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:13 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- 172.21.15.1:0/2413499637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49041082e0 msgr2=0x7f490410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 --2- 172.21.15.1:0/2413499637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49041082e0 0x7f490410ec50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009930 tx=0x7f48fc02a420 comp rx=0 tx=0).stop 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- 172.21.15.1:0/2413499637 shutdown_connections 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 --2- 172.21.15.1:0/2413499637 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49041082e0 0x7f490410ec50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 --2- 172.21.15.1:0/2413499637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904103760 0x7f4904107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 --2- 172.21.15.1:0/2413499637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4904102db0 0x7f4904103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- 172.21.15.1:0/2413499637 >> 172.21.15.1:0/2413499637 conn(0x7f49040fc7d0 msgr2=0x7f49040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- 172.21.15.1:0/2413499637 shutdown_connections 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- 172.21.15.1:0/2413499637 wait complete. 2024-09-19T05:19:13.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 Processor -- start 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.540+0000 7f490b7ab640 1 -- start start 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904102db0 0x7f4904198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49041082e0 0x7f490419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f49041120b0 con 0x7f4904103760 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4904111f30 con 0x7f49041082e0 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f490b7ab640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4904112230 con 0x7f4904102db0 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58294/0 (socket says 172.21.15.1:58294) 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 -- 172.21.15.1:0/1215829596 learned_addr learned my addr 172.21.15.1:0/1215829596 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4909d48640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49041082e0 0x7f490419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4909547640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904102db0 0x7f4904198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:13.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 -- 172.21.15.1:0/1215829596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904102db0 msgr2=0x7f4904198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904102db0 0x7f4904198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 -- 172.21.15.1:0/1215829596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49041082e0 msgr2=0x7f490419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49041082e0 0x7f490419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 -- 172.21.15.1:0/1215829596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490419d520 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f4908d46640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c8c0 tx=0x7f48f800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.541+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8007bb0 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.542+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48f8007d50 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.542+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490419d810 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.542+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f8018830 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.542+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49041a50f0 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.543+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4904103190 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.544+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f48f8018a10 con 0x7f4904103760 2024-09-19T05:19:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.545+0000 7f49027fc640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 0x7f48ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:13.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.545+0000 7f4909547640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 0x7f48ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:13.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.545+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f48f80cfa70 con 0x7f4904103760 2024-09-19T05:19:13.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.545+0000 7f4909547640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 0x7f48ec0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:13.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.549+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48f8014030 con 0x7f4904103760 2024-09-19T05:19:13.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.764+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f490410a2c0 con 0x7f4904103760 2024-09-19T05:19:13.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.764+0000 7f49027fc640 1 -- 172.21.15.1:0/1215829596 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11818 (secure 0 0 0) 0x7f48f809c550 con 0x7f4904103760 2024-09-19T05:19:13.766 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:13.766 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-19T05:19:12:010840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:11.756814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:19:13.767 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 msgr2=0x7f48ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 0x7f48ec0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f4009680 comp rx=0 tx=0).stop 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 msgr2=0x7f4904198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c8c0 tx=0x7f48f800cd80 comp rx=0 tx=0).stop 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 shutdown_connections 2024-09-19T05:19:13.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f48ec0a32c0 0x7f48ec0a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49041082e0 0x7f490419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4904103760 0x7f4904198ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 --2- 172.21.15.1:0/1215829596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4904102db0 0x7f4904198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 >> 172.21.15.1:0/1215829596 conn(0x7f49040fc7d0 msgr2=0x7f49040fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 shutdown_connections 2024-09-19T05:19:13.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:13.767+0000 7f490b7ab640 1 -- 172.21.15.1:0/1215829596 wait complete. 2024-09-19T05:19:14.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:14 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1215829596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:14.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:14.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:14 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1215829596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:14.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:14 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1215829596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:14.736 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:15.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:15 smithi001 ceph-mon[30968]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:15.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:15 smithi001 ceph-mon[30968]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T05:19:15.143 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:15 smithi001 ceph-mon[30968]: Cluster is now healthy 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 -- 172.21.15.1:0/4130222742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390101420 msgr2=0x7f739010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 --2- 172.21.15.1:0/4130222742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390101420 0x7f739010d950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7388009cd0 tx=0x7f738802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 -- 172.21.15.1:0/4130222742 shutdown_connections 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 --2- 172.21.15.1:0/4130222742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390101420 0x7f739010d950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 --2- 172.21.15.1:0/4130222742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390100a80 0x7f7390100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 --2- 172.21.15.1:0/4130222742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390106a80 0x7f7390106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 -- 172.21.15.1:0/4130222742 >> 172.21.15.1:0/4130222742 conn(0x7f73900fc7a0 msgr2=0x7f73900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 -- 172.21.15.1:0/4130222742 shutdown_connections 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 -- 172.21.15.1:0/4130222742 wait complete. 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.224+0000 7f7395530640 1 Processor -- start 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 -- start start 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390100a80 0x7f739019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 0x7f739019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7390110ea0 con 0x7f7390106a80 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7390110d20 con 0x7f7390100a80 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f7395530640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111020 con 0x7f7390101420 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35038/0 (socket says 172.21.15.1:35038) 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 -- 172.21.15.1:0/895342497 learned_addr learned my addr 172.21.15.1:0/895342497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738effd640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390100a80 0x7f739019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738e7fc640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 0x7f739019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 -- 172.21.15.1:0/895342497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 msgr2=0x7f739019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 0x7f739019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 -- 172.21.15.1:0/895342497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390100a80 msgr2=0x7f739019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390100a80 0x7f739019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738f7fe640 1 -- 172.21.15.1:0/895342497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019f5f0 con 0x7f7390106a80 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.225+0000 7f738e7fc640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 0x7f739019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f738f7fe640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7388005cc0 tx=0x7f7388003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388004040 con 0x7f7390106a80 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73880046c0 con 0x7f7390106a80 2024-09-19T05:19:15.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019f880 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388046480 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.226+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a71c0 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.227+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7390100ee0 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.229+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f73880305a0 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.229+0000 7f7377fff640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.230+0000 7f738effd640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.230+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f738802e030 con 0x7f7390106a80 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.230+0000 7f738effd640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 0x7f73780a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f738000bbe0 tx=0x7f738000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:15.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.233+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f738804b060 con 0x7f7390106a80 2024-09-19T05:19:15.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.410+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73901a7420 con 0x7f7390106a80 2024-09-19T05:19:15.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.411+0000 7f7377fff640 1 -- 172.21.15.1:0/895342497 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7f73880bded0 con 0x7f7390106a80 2024-09-19T05:19:15.413 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:15.413 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.413+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 msgr2=0x7f73780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.413+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 0x7f73780a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f738000bbe0 tx=0x7f738000b390 comp rx=0 tx=0).stop 2024-09-19T05:19:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.413+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 msgr2=0x7f739019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.413+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7388005cc0 tx=0x7f7388003970 comp rx=0 tx=0).stop 2024-09-19T05:19:15.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 shutdown_connections 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7390106a80 0x7f739019ef10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7390101420 0x7f739019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 --2- 172.21.15.1:0/895342497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7390100a80 0x7f739019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 >> 172.21.15.1:0/895342497 conn(0x7f73900fc7a0 msgr2=0x7f739010c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 shutdown_connections 2024-09-19T05:19:15.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:15.414+0000 7f7395530640 1 -- 172.21.15.1:0/895342497 wait complete. 2024-09-19T05:19:15.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:15 smithi060 ceph-mon[35058]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:15 smithi060 ceph-mon[35058]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T05:19:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:15 smithi060 ceph-mon[35058]: Cluster is now healthy 2024-09-19T05:19:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:15 smithi082 ceph-mon[35195]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:15 smithi082 ceph-mon[35195]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T05:19:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:15 smithi082 ceph-mon[35195]: Cluster is now healthy 2024-09-19T05:19:16.116 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:16 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/895342497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:16.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:16 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/895342497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:16.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:16 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/895342497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:16.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/2285763551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8104dd0 msgr2=0x7fd7b8105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/2285763551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8104dd0 0x7fd7b8105280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009ca0 tx=0x7fd7b002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/2285763551 shutdown_connections 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/2285763551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8104dd0 0x7fd7b8105280 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/2285763551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 0x7fd7b8100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/2285763551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8069f00 0x7fd7b81002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/2285763551 >> 172.21.15.1:0/2285763551 conn(0x7fd7b8077010 msgr2=0x7fd7b80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:16.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/2285763551 shutdown_connections 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/2285763551 wait complete. 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.827+0000 7fd7bf1a0640 1 Processor -- start 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 -- start start 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 0x7fd7b8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 0x7fd7b819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8110e00 con 0x7fd7b8069f00 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8110c80 con 0x7fd7b8104dd0 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bf1a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8110f80 con 0x7fd7b806a370 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35056/0 (socket says 172.21.15.1:35056) 2024-09-19T05:19:16.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 -- 172.21.15.1:0/1796464041 learned_addr learned my addr 172.21.15.1:0/1796464041 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7bd99d640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 0x7fd7b8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be99f640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 0x7fd7b819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 -- 172.21.15.1:0/1796464041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 msgr2=0x7fd7b8198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 0x7fd7b8198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 -- 172.21.15.1:0/1796464041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 msgr2=0x7fd7b819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 0x7fd7b819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 -- 172.21.15.1:0/1796464041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b819d2a0 con 0x7fd7b8069f00 2024-09-19T05:19:16.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be99f640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 0x7fd7b819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.828+0000 7fd7be19e640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d950 tx=0x7fd7b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.829+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4017070 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.829+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7b4009c30 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.829+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b819d590 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.829+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400f6b0 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.829+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b81a4e70 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.830+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b81017a0 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.831+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd7b40109d0 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.832+0000 7fd7af7fe640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 0x7fd7a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.832+0000 7fd7bd99d640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 0x7fd7a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.832+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fd7b40cf6e0 con 0x7fd7b8069f00 2024-09-19T05:19:16.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.832+0000 7fd7bd99d640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 0x7fd7a40a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8104290 tx=0x7fd7a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:16.836+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7b4009de0 con 0x7fd7b8069f00 2024-09-19T05:19:17.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.013+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7b810a770 con 0x7fd7b8069f00 2024-09-19T05:19:17.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.015+0000 7fd7af7fe640 1 -- 172.21.15.1:0/1796464041 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7fd7b409c1c0 con 0x7fd7b8069f00 2024-09-19T05:19:17.017 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:17.017 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 msgr2=0x7fd7a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 0x7fd7a40a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8104290 tx=0x7fd7a800a2d0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 msgr2=0x7fd7b81982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d950 tx=0x7fd7b400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 shutdown_connections 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7a40a32c0 0x7fd7a40a5780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.017+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b8104dd0 0x7fd7b819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.018+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7b806a370 0x7fd7b8198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.018+0000 7fd7bf1a0640 1 --2- 172.21.15.1:0/1796464041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b8069f00 0x7fd7b81982f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.018+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 >> 172.21.15.1:0/1796464041 conn(0x7fd7b8077010 msgr2=0x7fd7b80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.018+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 shutdown_connections 2024-09-19T05:19:17.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:17.018+0000 7fd7bf1a0640 1 -- 172.21.15.1:0/1796464041 wait complete. 2024-09-19T05:19:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:17 smithi001 ceph-mon[30968]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:17 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1796464041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:17 smithi060 ceph-mon[35058]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:17 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1796464041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:17 smithi082 ceph-mon[35195]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:17 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1796464041' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.764 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:18.023 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 -- 172.21.15.1:0/261498653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 msgr2=0x7f82e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/261498653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e810ea90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009ca0 tx=0x7f82e002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 -- 172.21.15.1:0/261498653 shutdown_connections 2024-09-19T05:19:18.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/261498653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e810ea90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/261498653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8102790 0x7f82e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/261498653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8101de0 0x7f82e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 -- 172.21.15.1:0/261498653 >> 172.21.15.1:0/261498653 conn(0x7f82e80fd8c0 msgr2=0x7f82e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 -- 172.21.15.1:0/261498653 shutdown_connections 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.493+0000 7f82ee6ef640 1 -- 172.21.15.1:0/261498653 wait complete. 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 Processor -- start 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 -- start start 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 0x7f82e819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 0x7f82e819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8111f70 con 0x7f82e8106f10 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82e8111df0 con 0x7f82e8101de0 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ee6ef640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81120f0 con 0x7f82e8102790 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ecc8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ecc8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35070/0 (socket says 172.21.15.1:35070) 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82ecc8c640 1 -- 172.21.15.1:0/3001277999 learned_addr learned my addr 172.21.15.1:0/3001277999 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82e7fff640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 0x7f82e819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.494+0000 7f82e77fe640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 0x7f82e819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 -- 172.21.15.1:0/3001277999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 msgr2=0x7f82e819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 0x7f82e819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 -- 172.21.15.1:0/3001277999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 msgr2=0x7f82e819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 0x7f82e819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 -- 172.21.15.1:0/3001277999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e819f620 con 0x7f82e8106f10 2024-09-19T05:19:18.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82e77fe640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 0x7f82e819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82e7fff640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 0x7f82e819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ecc8c640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f82e0031a20 tx=0x7f82e0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0003c30 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82e0003dd0 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e819f8b0 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e002fcf0 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.495+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81a71f0 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.496+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e81021c0 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.498+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f82e0004050 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.499+0000 7f82e57fa640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 0x7f82d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.499+0000 7f82e7fff640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 0x7f82d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.499+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f82e00f1100 con 0x7f82e8106f10 2024-09-19T05:19:18.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.499+0000 7f82e7fff640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 0x7f82d00a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009b40 tx=0x7f82d8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:18.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.503+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82e00bdc70 con 0x7f82e8106f10 2024-09-19T05:19:18.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.720+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82e81a73c0 con 0x7f82e8106f10 2024-09-19T05:19:18.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.721+0000 7f82e57fa640 1 -- 172.21.15.1:0/3001277999 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11818 (secure 0 0 0) 0x7f82e002fe90 con 0x7f82e8106f10 2024-09-19T05:19:18.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:18.722 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-19T05:19:12:010840+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:11.756814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:19:18.723 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-19T05:19:18.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 msgr2=0x7f82d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 0x7f82d00a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009b40 tx=0x7f82d8005e50 comp rx=0 tx=0).stop 2024-09-19T05:19:18.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 msgr2=0x7f82e819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f82e0031a20 tx=0x7f82e0031a50 comp rx=0 tx=0).stop 2024-09-19T05:19:18.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 shutdown_connections 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82d00a3240 0x7f82d00a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82e8106f10 0x7f82e819ef40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82e8102790 0x7f82e819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 --2- 172.21.15.1:0/3001277999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101de0 0x7f82e819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.724+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 >> 172.21.15.1:0/3001277999 conn(0x7f82e80fd8c0 msgr2=0x7f82e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.725+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 shutdown_connections 2024-09-19T05:19:18.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:18.725+0000 7f82ee6ef640 1 -- 172.21.15.1:0/3001277999 wait complete. 2024-09-19T05:19:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:19 smithi001 ceph-mon[30968]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:19 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3001277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:19.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:19 smithi060 ceph-mon[35058]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:19 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3001277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:19 smithi082 ceph-mon[35195]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:19 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3001277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/1912708886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c0410c180 msgr2=0x7f5c0410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/1912708886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c0410c180 0x7f5c0410e600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009ca0 tx=0x7f5bfc02a950 comp rx=0 tx=0).stop 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/1912708886 shutdown_connections 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/1912708886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c0410c180 0x7f5c0410e600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/1912708886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c041036c0 0x7f5c0410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/1912708886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 0x7f5c04103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/1912708886 >> 172.21.15.1:0/1912708886 conn(0x7f5c040fc7a0 msgr2=0x7f5c040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/1912708886 shutdown_connections 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.234+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/1912708886 wait complete. 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 Processor -- start 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 -- start start 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 0x7f5c04198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0410c180 0x7f5c0419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04111fa0 con 0x7f5c041036c0 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04111e20 con 0x7f5c04102da0 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0b4b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04112120 con 0x7f5c0410c180 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c08a4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c08a4e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35082/0 (socket says 172.21.15.1:35082) 2024-09-19T05:19:20.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c08a4e640 1 -- 172.21.15.1:0/3875171003 learned_addr learned my addr 172.21.15.1:0/3875171003 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c0924f640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 0x7f5c04198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.235+0000 7f5c09a50640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0410c180 0x7f5c0419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 -- 172.21.15.1:0/3875171003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0410c180 msgr2=0x7f5c0419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0410c180 0x7f5c0419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 -- 172.21.15.1:0/3875171003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 msgr2=0x7f5c04198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 0x7f5c04198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 -- 172.21.15.1:0/3875171003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0419d3f0 con 0x7f5c041036c0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c08a4e640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b4a0 tx=0x7f5bf400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4014070 con 0x7f5c041036c0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0419d6e0 con 0x7f5c041036c0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf4010af0 con 0x7f5c041036c0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4017d10 con 0x7f5c041036c0 2024-09-19T05:19:20.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.236+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a4fc0 con 0x7f5c041036c0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.237+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c04103180 con 0x7f5c041036c0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.238+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5bf4017070 con 0x7f5c041036c0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.239+0000 7f5bfa7fc640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 0x7f5bf00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.239+0000 7f5c0924f640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 0x7f5bf00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.239+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5bf40cee70 con 0x7f5c041036c0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.239+0000 7f5c0924f640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 0x7f5bf00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000bbe0 tx=0x7f5c0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.243+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bf409b300 con 0x7f5c041036c0 2024-09-19T05:19:20.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.420+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c0402d7c0 con 0x7f5c041036c0 2024-09-19T05:19:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.421+0000 7f5bfa7fc640 1 -- 172.21.15.1:0/3875171003 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7f5bf409f600 con 0x7f5c041036c0 2024-09-19T05:19:20.423 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:20.423 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:20.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 msgr2=0x7f5bf00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 0x7f5bf00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000bbe0 tx=0x7f5c0000b390 comp rx=0 tx=0).stop 2024-09-19T05:19:20.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 msgr2=0x7f5c04198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400b4a0 tx=0x7f5bf400b960 comp rx=0 tx=0).stop 2024-09-19T05:19:20.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 shutdown_connections 2024-09-19T05:19:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5bf00a3240 0x7f5bf00a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c0410c180 0x7f5c0419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5c041036c0 0x7f5c04198980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 --2- 172.21.15.1:0/3875171003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c04102da0 0x7f5c04198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 >> 172.21.15.1:0/3875171003 conn(0x7f5c040fc7a0 msgr2=0x7f5c040fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 shutdown_connections 2024-09-19T05:19:20.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:20.424+0000 7f5c0b4b3640 1 -- 172.21.15.1:0/3875171003 wait complete. 2024-09-19T05:19:21.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T05:19:02.579382+0000', 'modified': '2024-09-19T05:19:11.756814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6839/1656123730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1656123730}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1656123730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T05:19:21.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:19:21.138 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:19:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:21 smithi001 ceph-mon[30968]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:21 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3875171003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:21.399 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:21.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:21 smithi060 ceph-mon[35058]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:21.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:21 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3875171003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:21.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:21 smithi082 ceph-mon[35195]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:21.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:21 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3875171003' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.904+0000 7f9aa3185640 1 -- 172.21.15.1:0/1642336149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1036e0 msgr2=0x7f9a9c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.904+0000 7f9aa3185640 1 --2- 172.21.15.1:0/1642336149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c107b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009930 tx=0x7f9a9002a420 comp rx=0 tx=0).stop 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- 172.21.15.1:0/1642336149 shutdown_connections 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- 172.21.15.1:0/1642336149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- 172.21.15.1:0/1642336149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c107b90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- 172.21.15.1:0/1642336149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c102d30 0x7f9a9c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- 172.21.15.1:0/1642336149 >> 172.21.15.1:0/1642336149 conn(0x7f9a9c0fc7d0 msgr2=0x7f9a9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- 172.21.15.1:0/1642336149 shutdown_connections 2024-09-19T05:19:21.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- 172.21.15.1:0/1642336149 wait complete. 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 Processor -- start 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- start start 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c102d30 0x7f9a9c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c112060 con 0x7f9a9c1082a0 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c111ee0 con 0x7f9a9c1036e0 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.905+0000 7f9aa3185640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1121e0 con 0x7f9a9c102d30 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35110/0 (socket says 172.21.15.1:35110) 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 -- 172.21.15.1:0/3187001390 learned_addr learned my addr 172.21.15.1:0/3187001390 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c102d30 0x7f9a9c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 -- 172.21.15.1:0/3187001390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c102d30 msgr2=0x7f9a9c198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c102d30 0x7f9a9c198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 -- 172.21.15.1:0/3187001390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c1036e0 msgr2=0x7f9a9c198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 -- 172.21.15.1:0/3187001390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c19d610 con 0x7f9a9c1082a0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa1722640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400eaa0 tx=0x7f9a9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9a99ffb640 1 -- 172.21.15.1:0/3187001390 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400cdb0 con 0x7f9a9c1082a0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c19d900 con 0x7f9a9c1082a0 2024-09-19T05:19:21.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9a99ffb640 1 -- 172.21.15.1:0/3187001390 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a94005020 con 0x7f9a9c1082a0 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.906+0000 7f9a99ffb640 1 -- 172.21.15.1:0/3187001390 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a940116b0 con 0x7f9a9c1082a0 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.907+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c1a51e0 con 0x7f9a9c1082a0 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9a99ffb640 1 -- 172.21.15.1:0/3187001390 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9a94005560 con 0x7f9a9c1082a0 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 Processor -- start 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 -- start start 2024-09-19T05:19:21.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cbff0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 0x55d6cbffdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbf57090 con 0x55d6cbff12f0 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbefea70 con 0x55d6cbff09d0 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa555e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbf53050 con 0x55d6cbffbbb0 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa0f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9a99ffb640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa0f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35118/0 (socket says 172.21.15.1:35118) 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2180526670 learned_addr learned my addr 172.21.15.1:0/2180526670 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:21.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.909+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cbff0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa1722640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 0x55d6cbffdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2180526670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 msgr2=0x55d6cbffdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 0x55d6cbffdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2180526670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 msgr2=0x55d6cbff0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cbff0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2180526670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6cbf0b130 con 0x55d6cbff12f0 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 0x55d6cbffdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:21.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a99ffb640 1 -- 172.21.15.1:0/3187001390 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f9a940cfcf0 con 0x7f9a9c1082a0 2024-09-19T05:19:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00bcd0 tx=0x7f9a8c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b6ec0db9ac7ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9aa1722640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 0x7f9a840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a94096bc0 tx=0x7f9a940c6e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a82ffd640 1 -- 172.21.15.1:0/2180526670 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c005220 con 0x55d6cbff12f0 2024-09-19T05:19:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a82ffd640 1 -- 172.21.15.1:0/2180526670 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c004c80 con 0x55d6cbff12f0 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.910+0000 7f9a82ffd640 1 -- 172.21.15.1:0/2180526670 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0117a0 con 0x55d6cbff12f0 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- 172.21.15.1:0/2180526670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 msgr2=0x55d6cbffb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00bcd0 tx=0x7f9a8c0107a0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- 172.21.15.1:0/2180526670 shutdown_connections 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbffbbb0 0x55d6cbffdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbffb670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2180526670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cbff0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- 172.21.15.1:0/2180526670 >> 172.21.15.1:0/2180526670 conn(0x55d6cbfecf60 msgr2=0x55d6cbfed340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- 172.21.15.1:0/2180526670 shutdown_connections 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- 172.21.15.1:0/2180526670 wait complete. 2024-09-19T05:19:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 -- start start 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.911+0000 7f9aa555e740 1 Processor -- start 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbffb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff12f0 0x55d6cbff87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbffe780 con 0x55d6cbffbbb0 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbf11f20 con 0x55d6cbff12f0 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6cbffe900 con 0x55d6cbff09d0 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa555e740 10 client.0 _ll_register_callbacks cb 0x55d6cbedb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35124/0 (socket says 172.21.15.1:35124) 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 -- 172.21.15.1:0/991575636 learned_addr learned my addr 172.21.15.1:0/991575636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff12f0 0x55d6cbff87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbffb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 -- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 msgr2=0x55d6cbffb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbffb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 -- 172.21.15.1:0/991575636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff12f0 msgr2=0x55d6cbff87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff12f0 0x55d6cbff87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 -- 172.21.15.1:0/991575636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6cbcc82b0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9a90000c00 tx=0x7f9a90040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfff8063be911b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.912+0000 7f9a7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90035030 con 0x55d6cbffbbb0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f9a9003e8b0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8c004c80 con 0x55d6cbffbbb0 2024-09-19T05:19:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9a9003eab0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 10 client.14712 fetch_fsmap learned FSMap version 17 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d6cc00a010 con 0x55d6cbffbbb0 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c004c80 con 0x55d6cbffbbb0 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9a900483a0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 10 client.14712 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 10 client.14712 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 20 client.14712 populate_metadata read hostname 'smithi001' 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc00c5b0 0x55d6cc00da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 4 client.14712 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.913+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6cbf64600 con 0x55d6cc00c5b0 2024-09-19T05:19:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.914+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc00c5b0 0x55d6cc00da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.914+0000 7f9a7bfff640 10 client.14712 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.914+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc00c5b0 0x55d6cc00da20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae82f02a72c1ebfb server_cookie=6d1fd98ed78e1e0 in_seq=0 out_seq=0 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9a7bfff640 1 -- 172.21.15.1:0/991575636 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6cbf64600 con 0x55d6cc00c5b0 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9a7bfff640 10 client.14712 handle_command_reply: tid=0 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 client.14712 shutdown 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 msgr2=0x55d6cbff8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9a90000c00 tx=0x7f9a90040040 comp rx=0 tx=0).stop 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 shutdown_connections 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff8ce0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff12f0 0x55d6cbff87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc00c5b0 0x55d6cc00da20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 --2- 172.21.15.1:0/991575636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbffb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9a7bfff640 0 client.14712 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:19:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 >> 172.21.15.1:0/991575636 conn(0x55d6cbfecf60 msgr2=0x55d6cbff2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 shutdown_connections 2024-09-19T05:19:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 1 -- 172.21.15.1:0/991575636 wait complete. 2024-09-19T05:19:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.915+0000 7f9aa555e740 20 client.14712 trim_cache size 0 max 16384 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 Processor -- start 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 -- start start 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbff8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00bd60 con 0x55d6cbff12f0 2024-09-19T05:19:21.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00c430 con 0x55d6cbffbbb0 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa555e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00cb00 con 0x55d6cbff09d0 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa0f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa0f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35136/0 (socket says 172.21.15.1:35136) 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2930180816 learned_addr learned my addr 172.21.15.1:0/2930180816 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.935+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbff8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2930180816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 msgr2=0x55d6cbff8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbff8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2930180816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbffbbb0 msgr2=0x55d6cbff7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 -- 172.21.15.1:0/2930180816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6cbff0800 con 0x55d6cbff12f0 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55d6cbfeddc0 tx=0x7f9a8c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6caddcd266209c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9a827fc640 1 -- 172.21.15.1:0/2930180816 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c004020 con 0x55d6cbff12f0 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9a827fc640 1 -- 172.21.15.1:0/2930180816 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0041c0 con 0x55d6cbff12f0 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.936+0000 7f9a827fc640 1 -- 172.21.15.1:0/2930180816 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c029690 con 0x55d6cbff12f0 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- 172.21.15.1:0/2930180816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 msgr2=0x55d6cbff8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55d6cbfeddc0 tx=0x7f9a8c0056e0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- 172.21.15.1:0/2930180816 shutdown_connections 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbffbbb0 0x55d6cbff7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbff12f0 0x55d6cbff8ca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 --2- 172.21.15.1:0/2930180816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff09d0 0x55d6cbff8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- 172.21.15.1:0/2930180816 >> 172.21.15.1:0/2930180816 conn(0x55d6cbfecf60 msgr2=0x55d6cbfed340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- 172.21.15.1:0/2930180816 shutdown_connections 2024-09-19T05:19:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- 172.21.15.1:0/2930180816 wait complete. 2024-09-19T05:19:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 -- start start 2024-09-19T05:19:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.937+0000 7f9aa555e740 1 Processor -- start 2024-09-19T05:19:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cc015fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff12f0 0x55d6cc0164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00d8a0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00d1d0 con 0x55d6cbff09d0 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6cc00df70 con 0x55d6cbff12f0 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa555e740 10 client.0 _ll_register_callbacks cb 0x7f9a90009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35148/0 (socket says 172.21.15.1:35148) 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 -- 172.21.15.1:0/1284229857 learned_addr learned my addr 172.21.15.1:0/1284229857 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:21.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9aa0f21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff12f0 0x55d6cc0164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cc015fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 -- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff12f0 msgr2=0x55d6cc0164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff12f0 0x55d6cc0164e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 -- 172.21.15.1:0/1284229857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 msgr2=0x55d6cc015fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cc015fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 -- 172.21.15.1:0/1284229857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6cc011bb0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a9bfff640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a90005940 tx=0x7f9a9002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea353150ebc8365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.938+0000 7f9a7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90035040 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f9a9003e260 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8c0041c0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9a90004020 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 10 client.14718 fetch_fsmap learned FSMap version 17 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d6cc076840 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c0041c0 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f9a9005e040 con 0x55d6cbffbbb0 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 10 client.14718 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 10 client.14718 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:19:21.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 20 client.14718 populate_metadata read hostname 'smithi001' 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc07b410 0x55d6cc07a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 4 client.14718 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.939+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "status"}) -- 0x55d6cbf5eb10 con 0x55d6cc07b410 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc07b410 0x55d6cc07a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa0f21640 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc07b410 0x55d6cc07a120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25176d2f35a545ee server_cookie=7c44e0bb2aeab06a in_seq=0 out_seq=0 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9a7bfff640 10 client.14718 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9a7bfff640 1 -- 172.21.15.1:0/1284229857 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d6cbf5eb10 con 0x55d6cc07b410 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9a7bfff640 10 client.14718 handle_command_reply: tid=0 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 client.14718 shutdown 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 msgr2=0x55d6cc011380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a90005940 tx=0x7f9a9002a420 comp rx=0 tx=0).stop 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 shutdown_connections 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6cbffbbb0 0x55d6cc011380 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6cc07b410 0x55d6cc07a120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6cbff12f0 0x55d6cc0164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9a7bfff640 0 client.14718 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 --2- 172.21.15.1:0/1284229857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6cbff09d0 0x55d6cc015fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.940+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 >> 172.21.15.1:0/1284229857 conn(0x55d6cbfecf60 msgr2=0x55d6cbff8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 shutdown_connections 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa555e740 1 -- 172.21.15.1:0/1284229857 wait complete. 2024-09-19T05:19:21.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa555e740 20 client.14718 trim_cache size 0 max 16384 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24472, 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T05:19:21.951 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 18.969768386999998, 2024-09-19T05:19:21.952 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 17, 2024-09-19T05:19:21.952 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 87, 2024-09-19T05:19:21.952 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T05:19:21.952 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 39.207187333999997 2024-09-19T05:19:21.952 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:19:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 msgr2=0x7f9a840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 0x7f9a840a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a94096bc0 tx=0x7f9a940c6e40 comp rx=0 tx=0).stop 2024-09-19T05:19:21.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 msgr2=0x7f9a9c19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400eaa0 tx=0x7f9a9400ef60 comp rx=0 tx=0).stop 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 shutdown_connections 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9a9c1082a0 0x7f9a9c19cf30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a9c1036e0 0x7f9a9c198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 --2- 172.21.15.1:0/3187001390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9c102d30 0x7f9a9c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.941+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 >> 172.21.15.1:0/3187001390 conn(0x7f9a9c0fc7d0 msgr2=0x7f9a9c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.942+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 shutdown_connections 2024-09-19T05:19:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:21.942+0000 7f9aa3185640 1 -- 172.21.15.1:0/3187001390 wait complete. 2024-09-19T05:19:22.758 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:19:22.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:22.759 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T05:19:23.015 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:23.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:23 smithi001 ceph-mon[30968]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:23.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:23 smithi060 ceph-mon[35058]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:23.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:23 smithi082 ceph-mon[35195]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:23.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.563+0000 7f898d294640 1 -- 172.21.15.1:0/3883740989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 msgr2=0x7f8988101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.563+0000 7f898d294640 1 --2- 172.21.15.1:0/3883740989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f8988101200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8980009ca0 tx=0x7f898002a950 comp rx=0 tx=0).stop 2024-09-19T05:19:23.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 -- 172.21.15.1:0/3883740989 shutdown_connections 2024-09-19T05:19:23.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 --2- 172.21.15.1:0/3883740989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 0x7f898810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 --2- 172.21.15.1:0/3883740989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 0x7f89881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 --2- 172.21.15.1:0/3883740989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f8988101200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 -- 172.21.15.1:0/3883740989 >> 172.21.15.1:0/3883740989 conn(0x7f89880fc7d0 msgr2=0x7f89880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 -- 172.21.15.1:0/3883740989 shutdown_connections 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 -- 172.21.15.1:0/3883740989 wait complete. 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 Processor -- start 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.564+0000 7f898d294640 1 -- start start 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 0x7f8988199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 0x7f89881a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8988110ff0 con 0x7f8988100e20 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8988110e70 con 0x7f8988102ef0 2024-09-19T05:19:23.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8988111170 con 0x7f8988102570 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35170/0 (socket says 172.21.15.1:35170) 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 -- 172.21.15.1:0/4254856962 learned_addr learned my addr 172.21.15.1:0/4254856962 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f89867fc640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 0x7f8988199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f89877fe640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 0x7f89881a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 -- 172.21.15.1:0/4254856962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 msgr2=0x7f8988199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 0x7f8988199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 -- 172.21.15.1:0/4254856962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 msgr2=0x7f89881a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 0x7f89881a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 -- 172.21.15.1:0/4254856962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89881a49a0 con 0x7f8988100e20 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f8986ffd640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8980005e30 tx=0x7f8980003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980034040 con 0x7f8988100e20 2024-09-19T05:19:23.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89881a4b70 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f898002fe10 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.565+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800047f0 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.566+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89881a5020 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.566+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8988101200 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.568+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8980037020 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.568+0000 7f897ffff640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 0x7f89740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.568+0000 7f89867fc640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 0x7f89740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.568+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f89800f0d30 con 0x7f8988100e20 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.569+0000 7f89867fc640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 0x7f89740a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f898806aac0 tx=0x7f8970009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:23.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.572+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8980081210 con 0x7f8988100e20 2024-09-19T05:19:23.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.784+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f89881a52b0 con 0x7f8988100e20 2024-09-19T05:19:23.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.784+0000 7f897ffff640 1 -- 172.21.15.1:0/4254856962 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f89800bd810 con 0x7f8988100e20 2024-09-19T05:19:23.786 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:19:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 msgr2=0x7f89740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 0x7f89740a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f898806aac0 tx=0x7f8970009110 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 msgr2=0x7f89881993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8980005e30 tx=0x7f8980003f90 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 shutdown_connections 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f89740a3240 0x7f89740a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8988102ef0 0x7f89881a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8988102570 0x7f8988199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 --2- 172.21.15.1:0/4254856962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8988100e20 0x7f89881993e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.786+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 >> 172.21.15.1:0/4254856962 conn(0x7f89880fc7d0 msgr2=0x7f89880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.787+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 shutdown_connections 2024-09-19T05:19:23.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:23.787+0000 7f898d294640 1 -- 172.21.15.1:0/4254856962 wait complete. 2024-09-19T05:19:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:24 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4254856962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:24.486 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T05:19:24.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:19:24.487 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:19:24.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:24.487 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-19T05:19:24.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:24 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4254856962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:24.507 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:19:24.507 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:19:24.507 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:19:24.507 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:24.507 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T05:19:24.508 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42257sec preferred_lft 42257sec 2024-09-19T05:19:24.509 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T05:19:24.509 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:24.509 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:24.509 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:24.509 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-19T05:19:24.510 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:19:24.510 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:19:24.511 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:24 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4254856962' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:24.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:24.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:24.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:24.732 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:19:24.760 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-19T05:19:24.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:24.762 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-19T05:19:24.832 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-19T05:19:24.832 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:19:24.832 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T05:19:24.832 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T05:19:24.832 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T05:19:24.833 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:19:24.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:25.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:25.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:25.149 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T05:19:25.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:25.166 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-19T05:19:25.222 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:25.222 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:19:25.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:25.223 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T05:19:25.223 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:19:25.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:25.320 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:25 smithi001 ceph-mon[30968]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:25.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:25.342 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T05:19:25.343 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:19:25.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:25.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:25.474 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:25.474 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:19:25.474 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-19T05:19:25.474 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:19:25.474 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:19:25.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:25 smithi060 ceph-mon[35058]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:25 smithi082 ceph-mon[35195]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:25.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:25.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:25.554 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T05:19:25.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:19:25.554 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:25.570 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T05:19:25.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:19:25.571 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:25.626 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-19T05:19:25.693 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:25.750 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-19T05:19:25.750 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-19T05:19:25.750 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-19T05:19:25.750 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-19T05:19:25.750 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-19T05:19:25.751 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/d7c287278e253a182370e49c76f1788c8b299161c291bffa2cbdd6ac53079e9d/merged 2024-09-19T05:19:25.752 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/0a80961be0ad52141e1c1308122a7c49c090ae1d83aa72eac681e0e5e44af3ad/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/0 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e70ba1bf891faef2de395787d22273a1c7fe47e19932098c5eb321cfa26a686b/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/27c9b0c528b07999649de63ea7e216bf26a246bffe85f7f674fc8ad6f1162baf/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/8ec820b61c7b35ebc6942738106546e144cc319815f88d165e7d3649a6d8affc/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/51e3642453f6464c662ad13fd785ec04ddbcde41de235ac843f1551869d7bcdc/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/ec1f1414de061a99509bcd9f4144324892cd049f970d863171c3e1c8dcdbe114/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e47df2a41dd9c932a4af260c3da03dd87e2f25fcb0a49730a951317ae1cae2db/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/53b182ecf4fed5a56c731f9eac9f032bf580ec861f6baa9a02786a977535ceea/merged 2024-09-19T05:19:25.753 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/1dd31f9894e16fd611882075028ff632a7d70ae484afa3da0bdd9dcfb812a07f/merged 2024-09-19T05:19:25.754 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-19T05:19:25.754 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:25.754 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:25.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:25.754 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-19T05:19:25.806 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:19:25.806 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T05:19:25.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-19T05:19:25.875 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-19T05:19:25.932 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:25.933 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/d7c287278e253a182370e49c76f1788c8b299161c291bffa2cbdd6ac53079e9d/merged 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/0a80961be0ad52141e1c1308122a7c49c090ae1d83aa72eac681e0e5e44af3ad/merged 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/0 2024-09-19T05:19:25.934 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e70ba1bf891faef2de395787d22273a1c7fe47e19932098c5eb321cfa26a686b/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/27c9b0c528b07999649de63ea7e216bf26a246bffe85f7f674fc8ad6f1162baf/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/8ec820b61c7b35ebc6942738106546e144cc319815f88d165e7d3649a6d8affc/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/51e3642453f6464c662ad13fd785ec04ddbcde41de235ac843f1551869d7bcdc/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/ec1f1414de061a99509bcd9f4144324892cd049f970d863171c3e1c8dcdbe114/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e47df2a41dd9c932a4af260c3da03dd87e2f25fcb0a49730a951317ae1cae2db/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/53b182ecf4fed5a56c731f9eac9f032bf580ec861f6baa9a02786a977535ceea/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/1dd31f9894e16fd611882075028ff632a7d70ae484afa3da0bdd9dcfb812a07f/merged 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:25.935 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:25.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:25.936 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-19T05:19:25.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi001.stderr:2024-09-19T05:19:25.985+0000 7f8a54cfb480 -1 init, newargv = 0x55c60839dd40 newargc=15 2024-09-19T05:19:25.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi001.stderr:ceph-fuse[75140]: starting ceph client 2024-09-19T05:19:25.993 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi001.stderr:ceph-fuse[75140]: starting fuse 2024-09-19T05:19:27.091 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-19T05:19:27.124 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:27.184 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-19T05:19:27.184 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-19T05:19:27.184 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-19T05:19:27.184 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-19T05:19:27.185 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/d7c287278e253a182370e49c76f1788c8b299161c291bffa2cbdd6ac53079e9d/merged 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/0a80961be0ad52141e1c1308122a7c49c090ae1d83aa72eac681e0e5e44af3ad/merged 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/0 2024-09-19T05:19:27.186 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e70ba1bf891faef2de395787d22273a1c7fe47e19932098c5eb321cfa26a686b/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/27c9b0c528b07999649de63ea7e216bf26a246bffe85f7f674fc8ad6f1162baf/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/8ec820b61c7b35ebc6942738106546e144cc319815f88d165e7d3649a6d8affc/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/51e3642453f6464c662ad13fd785ec04ddbcde41de235ac843f1551869d7bcdc/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/ec1f1414de061a99509bcd9f4144324892cd049f970d863171c3e1c8dcdbe114/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/e47df2a41dd9c932a4af260c3da03dd87e2f25fcb0a49730a951317ae1cae2db/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/53b182ecf4fed5a56c731f9eac9f032bf580ec861f6baa9a02786a977535ceea/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/containers/storage/overlay/1dd31f9894e16fd611882075028ff632a7d70ae484afa3da0bdd9dcfb812a07f/merged 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:19:27.187 INFO:teuthology.orchestra.run.smithi001.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:27.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:27.188 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-19T05:19:27.243 INFO:teuthology.orchestra.run.smithi001.stdout:120 2024-09-19T05:19:27.243 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T05:19:27.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:19:27.243 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2024-09-19T05:19:27.243 DEBUG:teuthology.orchestra.run.smithi001:> import re 2024-09-19T05:19:27.243 DEBUG:teuthology.orchestra.run.smithi001:> import os 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:19:27.244 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> return f 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.admin")) 2024-09-19T05:19:27.245 DEBUG:teuthology.orchestra.run.smithi001:> ' 2024-09-19T05:19:27.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:27 smithi001 ceph-mon[30968]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:27.370 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.admin.75140.asok 2024-09-19T05:19:27.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:27.381 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75140.asok 2024-09-19T05:19:27.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:27.382 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75140.asok status 2024-09-19T05:19:27.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:27 smithi060 ceph-mon[35058]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:27 smithi082 ceph-mon[35195]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:27.519 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:19:27.519 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2024-09-19T05:19:27.519 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "admin", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "75140", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 14730, 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2024-09-19T05:19:27.520 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 14730 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2462407824 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2462407824 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.14730 192.168.0.1:0/2462407824", 2024-09-19T05:19:27.521 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.1:0/2462407824", 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 17, 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 87, 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2024-09-19T05:19:27.522 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:19:27.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:27.528 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2024-09-19T05:19:27.528 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:27.545 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2024-09-19T05:19:27.545 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:27.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:27.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:27.612 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T05:19:27.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:19:27.722 INFO:teuthology.orchestra.run.smithi001.stdout:# file: . 2024-09-19T05:19:27.722 INFO:teuthology.orchestra.run.smithi001.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T05:19:27.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:27.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:27.728 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:19:27.728 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:19:27.747 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:19:28.044 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 -- 172.21.15.1:0/2464533601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 msgr2=0x7f0150106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 --2- 172.21.15.1:0/2464533601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f0150106e60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0140009930 tx=0x7f014002a420 comp rx=0 tx=0).stop 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 -- 172.21.15.1:0/2464533601 shutdown_connections 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 --2- 172.21.15.1:0/2464533601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150101420 0x7f015010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 --2- 172.21.15.1:0/2464533601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150100a80 0x7f0150100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 --2- 172.21.15.1:0/2464533601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f0150106e60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 -- 172.21.15.1:0/2464533601 >> 172.21.15.1:0/2464533601 conn(0x7f01500fc7a0 msgr2=0x7f01500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 -- 172.21.15.1:0/2464533601 shutdown_connections 2024-09-19T05:19:28.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.554+0000 7f0154c61640 1 -- 172.21.15.1:0/2464533601 wait complete. 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 Processor -- start 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 -- start start 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150100a80 0x7f0150102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150101420 0x7f0150102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0150110ea0 con 0x7f0150106a80 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0150110d20 con 0x7f0150100a80 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f0154c61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0150111020 con 0x7f0150101420 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f014ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f014ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52022/0 (socket says 172.21.15.1:52022) 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f014ed9d640 1 -- 172.21.15.1:0/189058543 learned_addr learned my addr 172.21.15.1:0/189058543 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:28.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f014e59c640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150100a80 0x7f0150102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.555+0000 7f014dd9b640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150101420 0x7f0150102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 -- 172.21.15.1:0/189058543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150101420 msgr2=0x7f0150102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150101420 0x7f0150102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 -- 172.21.15.1:0/189058543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150100a80 msgr2=0x7f0150102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150100a80 0x7f0150102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 -- 172.21.15.1:0/189058543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01501a69b0 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f014ed9d640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f014800cad0 tx=0x7f014800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014800ad60 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0148005020 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01501a6ca0 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014800f6b0 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.556+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01501a7190 con 0x7f0150106a80 2024-09-19T05:19:28.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.557+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0150100ee0 con 0x7f0150106a80 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.558+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0148005560 con 0x7f0150106a80 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.559+0000 7f013f7fe640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 0x7f01380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.559+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f01480cfee0 con 0x7f0150106a80 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.559+0000 7f014e59c640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 0x7f01380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.560+0000 7f014e59c640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 0x7f01380a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0140009900 tx=0x7f01400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:28.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.562+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0148014030 con 0x7f0150106a80 2024-09-19T05:19:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.751+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0150103b80 con 0x7f0150106a80 2024-09-19T05:19:28.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.751+0000 7f013f7fe640 1 -- 172.21.15.1:0/189058543 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+578 (secure 0 0 0) 0x7f0150103b80 con 0x7f0150106a80 2024-09-19T05:19:28.753 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/809983124 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:28.753 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2268063463 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/449595009 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/899239314 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1905634441 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/149790801 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:28.754 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-19T05:19:28.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.754+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 msgr2=0x7f01380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:28.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.754+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 0x7f01380a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0140009900 tx=0x7f01400058d0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.754+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 msgr2=0x7f01501030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:28.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.754+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f014800cad0 tx=0x7f014800ced0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 shutdown_connections 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f01380a3240 0x7f01380a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0150106a80 0x7f01501030d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0150101420 0x7f0150102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 --2- 172.21.15.1:0/189058543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0150100a80 0x7f0150102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 >> 172.21.15.1:0/189058543 conn(0x7f01500fc7a0 msgr2=0x7f01501048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 shutdown_connections 2024-09-19T05:19:28.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:28.755+0000 7f0154c61640 1 -- 172.21.15.1:0/189058543 wait complete. 2024-09-19T05:19:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:29 smithi060 ceph-mon[35058]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:29 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/189058543' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:29 smithi082 ceph-mon[35195]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:29 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/189058543' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:29.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:29 smithi001 ceph-mon[30968]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:29.545 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:29 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/189058543' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:29.580 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:19:29.580 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:19:29.600 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:19:29.904 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 -- 172.21.15.1:0/3197144881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 msgr2=0x7f5758101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 --2- 172.21.15.1:0/3197144881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758101200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5754009900 tx=0x7f575402a480 comp rx=0 tx=0).stop 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 -- 172.21.15.1:0/3197144881 shutdown_connections 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 --2- 172.21.15.1:0/3197144881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 0x7f575810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 --2- 172.21.15.1:0/3197144881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 0x7f57581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 --2- 172.21.15.1:0/3197144881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758101200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.400+0000 7f575f565640 1 -- 172.21.15.1:0/3197144881 >> 172.21.15.1:0/3197144881 conn(0x7f57580fc7d0 msgr2=0x7f57580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:30.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- 172.21.15.1:0/3197144881 shutdown_connections 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- 172.21.15.1:0/3197144881 wait complete. 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 Processor -- start 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- start start 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 0x7f57581999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 0x7f57581a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5758110fa0 con 0x7f5758100e20 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5758110e20 con 0x7f5758102ef0 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.401+0000 7f575f565640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5758111120 con 0x7f5758102570 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52054/0 (socket says 172.21.15.1:52054) 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 -- 172.21.15.1:0/3485299198 learned_addr learned my addr 172.21.15.1:0/3485299198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575db02640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 0x7f57581a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575cb00640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 0x7f57581999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 -- 172.21.15.1:0/3485299198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 msgr2=0x7f57581999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 0x7f57581999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 -- 172.21.15.1:0/3485299198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 msgr2=0x7f57581a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 0x7f57581a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 -- 172.21.15.1:0/3485299198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57581a4a30 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575d301640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5754006010 tx=0x7f5754003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575403f070 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5754031e30 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.402+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57581a4c00 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.403+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754035030 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.403+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57581a50b0 con 0x7f5758100e20 2024-09-19T05:19:30.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.404+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5758101200 con 0x7f5758100e20 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.405+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5754042070 con 0x7f5758100e20 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.405+0000 7f574e7fc640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 0x7f57440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.406+0000 7f575cb00640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 0x7f57440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.406+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f57540f0530 con 0x7f5758100e20 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.406+0000 7f575cb00640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 0x7f57440a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f575806aac0 tx=0x7f5748008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:30.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.410+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57540bcfb0 con 0x7f5758100e20 2024-09-19T05:19:30.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.624+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5758109090 con 0x7f5758100e20 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.625+0000 7f574e7fc640 1 -- 172.21.15.1:0/3485299198 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+578 (secure 0 0 0) 0x7f57540bc8b0 con 0x7f5758100e20 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/809983124 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2268063463 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/449595009 2024-09-20T05:12:09.745993+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:30.627 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:30.628 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/899239314 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:30.628 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1905634441 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:30.628 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/149790801 2024-09-20T05:11:44.793185+0000 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 msgr2=0x7f57440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 0x7f57440a5780 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f575806aac0 tx=0x7f5748008040 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 msgr2=0x7f5758199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5754006010 tx=0x7f5754003c80 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 shutdown_connections 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57440a32c0 0x7f57440a5780 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5758102ef0 0x7f57581a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5758102570 0x7f57581999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 --2- 172.21.15.1:0/3485299198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5758100e20 0x7f5758199470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 >> 172.21.15.1:0/3485299198 conn(0x7f57580fc7d0 msgr2=0x7f57580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:30.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 shutdown_connections 2024-09-19T05:19:30.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:30.627+0000 7f575f565640 1 -- 172.21.15.1:0/3485299198 wait complete. 2024-09-19T05:19:31.476 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:31 smithi001 ceph-mon[30968]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:31.476 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:31 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3485299198' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:31.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:31 smithi060 ceph-mon[35058]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:31.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:31 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3485299198' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:31.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:31 smithi082 ceph-mon[35195]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:31.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:31 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3485299198' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:19:31.621 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2024-09-19T05:19:31.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:31.621 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T05:19:31.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi001.stderr:ceph-fuse[75140]: fuse finished with error 0 and tester_r 0 2024-09-19T05:19:31.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:19:33.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:33 smithi060 ceph-mon[35058]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:33.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:33 smithi082 ceph-mon[35195]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:33 smithi001 ceph-mon[30968]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-19T05:19:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:35 smithi060 ceph-mon[35058]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:35 smithi082 ceph-mon[35195]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:35 smithi001 ceph-mon[30968]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:37.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:37 smithi060 ceph-mon[35058]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:37.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:37 smithi082 ceph-mon[35195]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:37.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:37 smithi001 ceph-mon[30968]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:37.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T05:19:37.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:37.753 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T05:19:37.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:38.097 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:38.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 -- 172.21.15.1:0/3058752510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c106f10 msgr2=0x7fc73c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:38.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 --2- 172.21.15.1:0/3058752510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c106f10 0x7fc73c10ea90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc734009900 tx=0x7fc73402a410 comp rx=0 tx=0).stop 2024-09-19T05:19:38.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 -- 172.21.15.1:0/3058752510 shutdown_connections 2024-09-19T05:19:38.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 --2- 172.21.15.1:0/3058752510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c106f10 0x7fc73c10ea90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 --2- 172.21.15.1:0/3058752510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 0x7fc73c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 --2- 172.21.15.1:0/3058752510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c101de0 0x7fc73c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 -- 172.21.15.1:0/3058752510 >> 172.21.15.1:0/3058752510 conn(0x7fc73c0fd8c0 msgr2=0x7fc73c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 -- 172.21.15.1:0/3058752510 shutdown_connections 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.590+0000 7fc74446d640 1 -- 172.21.15.1:0/3058752510 wait complete. 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 Processor -- start 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 -- start start 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 0x7fc73c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c106f10 0x7fc73c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c111f70 con 0x7fc73c101de0 2024-09-19T05:19:38.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c111df0 con 0x7fc73c106f10 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc74446d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c1120f0 con 0x7fc73c102790 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56076/0 (socket says 172.21.15.1:56076) 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 -- 172.21.15.1:0/1320066866 learned_addr learned my addr 172.21.15.1:0/1320066866 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742a0a640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c106f10 0x7fc73c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc741a08640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 0x7fc73c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 -- 172.21.15.1:0/1320066866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 msgr2=0x7fc73c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 0x7fc73c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 -- 172.21.15.1:0/1320066866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c106f10 msgr2=0x7fc73c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c106f10 0x7fc73c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.591+0000 7fc742209640 1 -- 172.21.15.1:0/1320066866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c19d2f0 con 0x7fc73c101de0 2024-09-19T05:19:38.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc742209640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d950 tx=0x7fc73800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738017070 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c19d5e0 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc738009c30 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800f6b0 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.592+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1a4ec0 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.593+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c1021c0 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.594+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc7380109d0 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.595+0000 7fc7337fe640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 0x7fc7240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.595+0000 7fc741a08640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 0x7fc7240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.595+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc7380cf720 con 0x7fc73c101de0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.595+0000 7fc741a08640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 0x7fc7240a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc73c108880 tx=0x7fc72c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:38.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.598+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc738009de0 con 0x7fc73c101de0 2024-09-19T05:19:38.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.773+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc73c10a180 con 0x7fc73c101de0 2024-09-19T05:19:38.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.775+0000 7fc7337fe640 1 -- 172.21.15.1:0/1320066866 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7fc73809bb50 con 0x7fc73c101de0 2024-09-19T05:19:38.778 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:38.778 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 msgr2=0x7fc7240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 0x7fc7240a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc73c108880 tx=0x7fc72c0075b0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 msgr2=0x7fc73c198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d950 tx=0x7fc73800de10 comp rx=0 tx=0).stop 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 shutdown_connections 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc7240a3240 0x7fc7240a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c106f10 0x7fc73c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc73c102790 0x7fc73c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 --2- 172.21.15.1:0/1320066866 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc73c101de0 0x7fc73c198340 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 >> 172.21.15.1:0/1320066866 conn(0x7fc73c0fd8c0 msgr2=0x7fc73c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 shutdown_connections 2024-09-19T05:19:38.781 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:38.777+0000 7fc74446d640 1 -- 172.21.15.1:0/1320066866 wait complete. 2024-09-19T05:19:39.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:39 smithi060 ceph-mon[35058]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:39.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:39 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1320066866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:39.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:39 smithi082 ceph-mon[35195]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:39.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:39 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1320066866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:39.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:39 smithi001 ceph-mon[30968]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T05:19:39.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:39 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1320066866' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:39.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:39.874 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 -- 172.21.15.1:0/3820962375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968106f10 msgr2=0x7f996810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 --2- 172.21.15.1:0/3820962375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968106f10 0x7f996810ea90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9960009ca0 tx=0x7f996002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 -- 172.21.15.1:0/3820962375 shutdown_connections 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 --2- 172.21.15.1:0/3820962375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968106f10 0x7f996810ea90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 --2- 172.21.15.1:0/3820962375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 0x7f99681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 --2- 172.21.15.1:0/3820962375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968101de0 0x7f99681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 -- 172.21.15.1:0/3820962375 >> 172.21.15.1:0/3820962375 conn(0x7f99680fd8c0 msgr2=0x7f99680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 -- 172.21.15.1:0/3820962375 shutdown_connections 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.397+0000 7f996f67f640 1 -- 172.21.15.1:0/3820962375 wait complete. 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 Processor -- start 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 -- start start 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 0x7f99681989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 0x7f996819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9968111fe0 con 0x7f9968101de0 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9968111e60 con 0x7f9968106f10 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996f67f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9968112160 con 0x7f9968102790 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996d41b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996d41b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56086/0 (socket says 172.21.15.1:56086) 2024-09-19T05:19:40.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.398+0000 7f996d41b640 1 -- 172.21.15.1:0/933195651 learned_addr learned my addr 172.21.15.1:0/933195651 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996dc1c640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 0x7f996819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996cc1a640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 0x7f99681989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 -- 172.21.15.1:0/933195651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 msgr2=0x7f99681989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 0x7f99681989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 -- 172.21.15.1:0/933195651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 msgr2=0x7f996819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 0x7f996819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 -- 172.21.15.1:0/933195651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996819d430 con 0x7f9968101de0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996dc1c640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 0x7f996819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996d41b640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f996400c890 tx=0x7f996400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964004220 con 0x7f9968101de0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99640043c0 con 0x7f9968101de0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996819d720 con 0x7f9968101de0 2024-09-19T05:19:40.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640049e0 con 0x7f9968101de0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.399+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99681a5000 con 0x7f9968101de0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.400+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99681021c0 con 0x7f9968101de0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.402+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f99640079b0 con 0x7f9968101de0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.403+0000 7f995e7fc640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 0x7f99540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.403+0000 7f996cc1a640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 0x7f99540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.403+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f99640cfe20 con 0x7f9968101de0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.403+0000 7f996cc1a640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 0x7f99540a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99680ff790 tx=0x7f9958008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.406+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9964014030 con 0x7f9968101de0 2024-09-19T05:19:40.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.583+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99681997e0 con 0x7f9968101de0 2024-09-19T05:19:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.585+0000 7f995e7fc640 1 -- 172.21.15.1:0/933195651 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7f996409c920 con 0x7f9968101de0 2024-09-19T05:19:40.588 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:40.588 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 msgr2=0x7f99540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 0x7f99540a5780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99680ff790 tx=0x7f9958008040 comp rx=0 tx=0).stop 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 msgr2=0x7f9968198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f996400c890 tx=0x7f996400cd50 comp rx=0 tx=0).stop 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 shutdown_connections 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f99540a32c0 0x7f99540a5780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9968106f10 0x7f996819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9968102790 0x7f99681989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 --2- 172.21.15.1:0/933195651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9968101de0 0x7f9968198480 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 >> 172.21.15.1:0/933195651 conn(0x7f99680fd8c0 msgr2=0x7f99680fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 shutdown_connections 2024-09-19T05:19:40.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:40.587+0000 7f996f67f640 1 -- 172.21.15.1:0/933195651 wait complete. 2024-09-19T05:19:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:41 smithi001 ceph-mon[30968]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:41 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/933195651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:41.408 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:19:41.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:41 smithi060 ceph-mon[35058]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:41.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:41 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/933195651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:41.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:41 smithi082 ceph-mon[35195]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:41.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:41 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/933195651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:41.671 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 -- 172.21.15.1:0/3470965718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 msgr2=0x7fc5bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3470965718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc101200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009900 tx=0x7fc5b802a480 comp rx=0 tx=0).stop 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 -- 172.21.15.1:0/3470965718 shutdown_connections 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3470965718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3470965718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102570 0x7fc5bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:42.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3470965718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc101200 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 -- 172.21.15.1:0/3470965718 >> 172.21.15.1:0/3470965718 conn(0x7fc5bc0fc7d0 msgr2=0x7fc5bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 -- 172.21.15.1:0/3470965718 shutdown_connections 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.206+0000 7fc5c397e640 1 -- 172.21.15.1:0/3470965718 wait complete. 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 Processor -- start 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 -- start start 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 0x7fc5bc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc1120d0 con 0x7fc5bc100e20 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc111f50 con 0x7fc5bc102570 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c397e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc112250 con 0x7fc5bc102ef0 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56114/0 (socket says 172.21.15.1:56114) 2024-09-19T05:19:42.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 -- 172.21.15.1:0/3029001795 learned_addr learned my addr 172.21.15.1:0/3029001795 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c1f1b640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c0f19640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 0x7fc5bc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 -- 172.21.15.1:0/3029001795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 msgr2=0x7fc5bc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 -- 172.21.15.1:0/3029001795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 msgr2=0x7fc5bc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 0x7fc5bc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c171a640 1 -- 172.21.15.1:0/3029001795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc19d4e0 con 0x7fc5bc100e20 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c0f19640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 0x7fc5bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.207+0000 7fc5c1f1b640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5c171a640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5b802aa70 tx=0x7fc5b8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b803f070 con 0x7fc5bc100e20 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5b8031c30 con 0x7fc5bc100e20 2024-09-19T05:19:42.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5bc19d770 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8035030 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.208+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5bc1a50b0 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.209+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5bc1021b0 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.210+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc5b8042070 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.211+0000 7fc5b27fc640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 0x7fc5a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.211+0000 7fc5c0f19640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 0x7fc5a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.211+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc5b80f09a0 con 0x7fc5bc100e20 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.211+0000 7fc5c0f19640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 0x7fc5a80a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0ffdc0 tx=0x7fc5ac005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:42.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.214+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc5b8031de0 con 0x7fc5bc100e20 2024-09-19T05:19:42.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:42.432+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc5bc101200 con 0x7fc5bc100e20 2024-09-19T05:19:43.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.113+0000 7fc5b27fc640 1 -- 172.21.15.1:0/3029001795 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fc5bc101200 con 0x7fc5bc100e20 2024-09-19T05:19:43.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 msgr2=0x7fc5a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 0x7fc5a80a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0ffdc0 tx=0x7fc5ac005d30 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 msgr2=0x7fc5bc198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5b802aa70 tx=0x7fc5b8003c10 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 shutdown_connections 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc5a80a3240 0x7fc5a80a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5bc102ef0 0x7fc5bc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5bc102570 0x7fc5bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 --2- 172.21.15.1:0/3029001795 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc5bc100e20 0x7fc5bc198530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 >> 172.21.15.1:0/3029001795 conn(0x7fc5bc0fc7d0 msgr2=0x7fc5bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 shutdown_connections 2024-09-19T05:19:43.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:43.118+0000 7fc5c397e640 1 -- 172.21.15.1:0/3029001795 wait complete. 2024-09-19T05:19:43.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:43 smithi001 ceph-mon[30968]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:43.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:19:43.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:43 smithi060 ceph-mon[35058]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:43.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:19:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:43 smithi082 ceph-mon[35195]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:19:43.961 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T05:19:43.961 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T05:19:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:44 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:19:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:44 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:44.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:44 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:19:44.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:44 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:44.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:44 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3029001795' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:19:44.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:44 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 -- 172.21.15.1:0/2065380302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 msgr2=0x7fb00c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 --2- 172.21.15.1:0/2065380302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c10ea90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb004009ca0 tx=0x7fb00402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 -- 172.21.15.1:0/2065380302 shutdown_connections 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 --2- 172.21.15.1:0/2065380302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c10ea90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 --2- 172.21.15.1:0/2065380302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 0x7fb00c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 --2- 172.21.15.1:0/2065380302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.737+0000 7fb01311e640 1 -- 172.21.15.1:0/2065380302 >> 172.21.15.1:0/2065380302 conn(0x7fb00c0fd8c0 msgr2=0x7fb00c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:44.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- 172.21.15.1:0/2065380302 shutdown_connections 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- 172.21.15.1:0/2065380302 wait complete. 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 Processor -- start 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- start start 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 0x7fb00c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c111f70 con 0x7fb00c106f10 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c111df0 con 0x7fb00c102790 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb01311e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c1120f0 con 0x7fb00c101de0 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.738+0000 7fb0116bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33078/0 (socket says 172.21.15.1:33078) 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 -- 172.21.15.1:0/603805979 learned_addr learned my addr 172.21.15.1:0/603805979 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:44.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb003fff640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 0x7fb00c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb010eba640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 -- 172.21.15.1:0/603805979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 msgr2=0x7fb00c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 -- 172.21.15.1:0/603805979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 msgr2=0x7fb00c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 0x7fb00c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 -- 172.21.15.1:0/603805979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c1a6890 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb010eba640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb0116bb640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb004031a20 tx=0x7fb004031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004003c30 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb004003dd0 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c1a6b20 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.739+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00402fcf0 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.740+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c1a70b0 con 0x7fb00c106f10 2024-09-19T05:19:44.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.741+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00c1021c0 con 0x7fb00c106f10 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.742+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb004004b40 con 0x7fb00c106f10 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.742+0000 7fb001ffb640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 0x7faff40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.743+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb0040f0fc0 con 0x7fb00c106f10 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.743+0000 7fb010eba640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 0x7faff40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.743+0000 7fb010eba640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 0x7faff40a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb008005fd0 tx=0x7fb008005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:44.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.746+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0040bdb30 con 0x7fb00c106f10 2024-09-19T05:19:44.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:44.959+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb00c075a20 con 0x7fb00c106f10 2024-09-19T05:19:45.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.120+0000 7fb001ffb640 1 -- 172.21.15.1:0/603805979 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fb00c075a20 con 0x7fb00c106f10 2024-09-19T05:19:45.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.122+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 msgr2=0x7faff40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:45.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.122+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 0x7faff40a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb008005fd0 tx=0x7fb008005ea0 comp rx=0 tx=0).stop 2024-09-19T05:19:45.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.122+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 msgr2=0x7fb00c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.122+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb004031a20 tx=0x7fb004031a50 comp rx=0 tx=0).stop 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 shutdown_connections 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faff40a32c0 0x7faff40a5780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb00c106f10 0x7fb00c074f70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb00c102790 0x7fb00c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 --2- 172.21.15.1:0/603805979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb00c101de0 0x7fb00c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 >> 172.21.15.1:0/603805979 conn(0x7fb00c0fd8c0 msgr2=0x7fb00c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 shutdown_connections 2024-09-19T05:19:45.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:45.123+0000 7fb01311e640 1 -- 172.21.15.1:0/603805979 wait complete. 2024-09-19T05:19:45.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:45 smithi001 ceph-mon[30968]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:45.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:45 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:19:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:45 smithi060 ceph-mon[35058]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:45 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:19:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:45 smithi082 ceph-mon[35195]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T05:19:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:19:45.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T05:19:46.199 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:46.321 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:46 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:19:46.322 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:46 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:46.322 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:46 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:46.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:46 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:19:46.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:46 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:46.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:46 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:46 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/603805979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:19:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:46 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:19:46.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:46 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 -- 172.21.15.1:0/258916777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 msgr2=0x7f027c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 --2- 172.21.15.1:0/258916777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c10d950 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0274009cd0 tx=0x7f027402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 -- 172.21.15.1:0/258916777 shutdown_connections 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 --2- 172.21.15.1:0/258916777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c10d950 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 --2- 172.21.15.1:0/258916777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 0x7f027c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 --2- 172.21.15.1:0/258916777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 0x7f027c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 -- 172.21.15.1:0/258916777 >> 172.21.15.1:0/258916777 conn(0x7f027c0fc7a0 msgr2=0x7f027c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:46.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 -- 172.21.15.1:0/258916777 shutdown_connections 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.707+0000 7f028089e640 1 -- 172.21.15.1:0/258916777 wait complete. 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 Processor -- start 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 -- start start 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 0x7f027c1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 0x7f027c197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f027c110ef0 con 0x7f027c101420 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f027c110d70 con 0x7f027c100a80 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f028089e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f027c111070 con 0x7f027c106a80 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33096/0 (socket says 172.21.15.1:33096) 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 -- 172.21.15.1:0/2423027408 learned_addr learned my addr 172.21.15.1:0/2423027408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:46.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f027ad9d640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 0x7f027c197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f027a59c640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 0x7f027c1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 -- 172.21.15.1:0/2423027408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 msgr2=0x7f027c197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 0x7f027c197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 -- 172.21.15.1:0/2423027408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 msgr2=0x7f027c1970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 0x7f027c1970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.708+0000 7f0273fff640 1 -- 172.21.15.1:0/2423027408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c1a6940 con 0x7f027c101420 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f0273fff640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f026400d950 tx=0x7f026400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264017070 con 0x7f027c101420 2024-09-19T05:19:46.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c1a6c30 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0264009c30 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400f6b0 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.709+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c1a71c0 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.710+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c100ee0 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.711+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f02640109d0 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.712+0000 7f02737fe640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 0x7f02680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.712+0000 7f027a59c640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 0x7f02680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.712+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f02640cf850 con 0x7f027c101420 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.713+0000 7f027a59c640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 0x7f02680a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f026c00a810 tx=0x7f026c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:46.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.717+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0264009de0 con 0x7f027c101420 2024-09-19T05:19:46.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:46.931+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f027c1a74e0 con 0x7f027c101420 2024-09-19T05:19:47.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.132+0000 7f02737fe640 1 -- 172.21.15.1:0/2423027408 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f026409c330 con 0x7f027c101420 2024-09-19T05:19:47.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 msgr2=0x7f02680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:47.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 0x7f02680a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f026c00a810 tx=0x7f026c008040 comp rx=0 tx=0).stop 2024-09-19T05:19:47.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 msgr2=0x7f027c197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:47.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f026400d950 tx=0x7f026400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 shutdown_connections 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02680a3240 0x7f02680a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f027c106a80 0x7f027c197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f027c101420 0x7f027c197610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 --2- 172.21.15.1:0/2423027408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f027c100a80 0x7f027c1970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 >> 172.21.15.1:0/2423027408 conn(0x7f027c0fc7a0 msgr2=0x7f027c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 shutdown_connections 2024-09-19T05:19:47.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:47.134+0000 7f028089e640 1 -- 172.21.15.1:0/2423027408 wait complete. 2024-09-19T05:19:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:47 smithi001 ceph-mon[30968]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:47 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:19:47.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:47 smithi060 ceph-mon[35058]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:47.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:47 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:19:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:47 smithi082 ceph-mon[35195]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:47 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:19:47.949 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T05:19:47.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T05:19:48.211 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:48.332 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:19:48.333 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:48.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:19:48.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:48 smithi060 ceph-mon[35058]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:48.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2423027408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:19:48.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:48 smithi082 ceph-mon[35195]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T05:19:48.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.726+0000 7f66ac03f640 1 -- 172.21.15.1:0/2694853843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4112b90 msgr2=0x7f66a4114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:48.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.726+0000 7f66ac03f640 1 --2- 172.21.15.1:0/2694853843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4112b90 0x7f66a4114f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f669c009ca0 tx=0x7f669c02a950 comp rx=0 tx=0).stop 2024-09-19T05:19:48.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 -- 172.21.15.1:0/2694853843 shutdown_connections 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 --2- 172.21.15.1:0/2694853843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4112b90 0x7f66a4114f80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 --2- 172.21.15.1:0/2694853843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074eb0 0x7f66a4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 --2- 172.21.15.1:0/2694853843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4074590 0x7f66a4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 -- 172.21.15.1:0/2694853843 >> 172.21.15.1:0/2694853843 conn(0x7f66a40fd8c0 msgr2=0x7f66a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 -- 172.21.15.1:0/2694853843 shutdown_connections 2024-09-19T05:19:48.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 -- 172.21.15.1:0/2694853843 wait complete. 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 Processor -- start 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.727+0000 7f66ac03f640 1 -- start start 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074590 0x7f66a41a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4112b90 0x7f66a419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f66a4118560 con 0x7f66a4074eb0 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41183e0 con 0x7f66a4074590 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66ac03f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66a41186e0 con 0x7f66a4112b90 2024-09-19T05:19:48.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33114/0 (socket says 172.21.15.1:33114) 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 -- 172.21.15.1:0/3944938692 learned_addr learned my addr 172.21.15.1:0/3944938692 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a9ddb640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074590 0x7f66a41a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66aa5dc640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4112b90 0x7f66a419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 -- 172.21.15.1:0/3944938692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4112b90 msgr2=0x7f66a419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4112b90 0x7f66a419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 -- 172.21.15.1:0/3944938692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074590 msgr2=0x7f66a41a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074590 0x7f66a41a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 -- 172.21.15.1:0/3944938692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a419efc0 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.728+0000 7f66a95da640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f669400d950 tx=0x7f669400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.729+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694017030 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.729+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6694004020 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.729+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a419f2b0 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.729+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940047a0 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.729+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a41ab5a0 con 0x7f66a4074eb0 2024-09-19T05:19:48.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.730+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a4074970 con 0x7f66a4074eb0 2024-09-19T05:19:48.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.731+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f66940041d0 con 0x7f66a4074eb0 2024-09-19T05:19:48.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.731+0000 7f669affd640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 0x7f66900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:48.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.732+0000 7f66a9ddb640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 0x7f66900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:48.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.732+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f66940cf4d0 con 0x7f66a4074eb0 2024-09-19T05:19:48.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.732+0000 7f66a9ddb640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 0x7f66900a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66a419f9d0 tx=0x7f66a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:48.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.736+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f669409bfb0 con 0x7f66a4074eb0 2024-09-19T05:19:48.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.934+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f66a40ff730 con 0x7f66900a3240 2024-09-19T05:19:48.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.954+0000 7f669affd640 1 -- 172.21.15.1:0/3944938692 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f66a40ff730 con 0x7f66900a3240 2024-09-19T05:19:48.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 msgr2=0x7f66900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 0x7f66900a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66a419f9d0 tx=0x7f66a000b390 comp rx=0 tx=0).stop 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 msgr2=0x7f66a41a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f669400d950 tx=0x7f669400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 shutdown_connections 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f66900a3240 0x7f66900a5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66a4112b90 0x7f66a419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f66a4074eb0 0x7f66a41a4c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 --2- 172.21.15.1:0/3944938692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66a4074590 0x7f66a41a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:48.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 >> 172.21.15.1:0/3944938692 conn(0x7f66a40fd8c0 msgr2=0x7f66a40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:48.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 shutdown_connections 2024-09-19T05:19:48.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:48.956+0000 7f66ac03f640 1 -- 172.21.15.1:0/3944938692 wait complete. 2024-09-19T05:19:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:49 smithi001 ceph-mon[30968]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 0 op/s 2024-09-19T05:19:49.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:19:48.940+0000 7feb98fc5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:49.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:19:48.940+0000 7feb98fc5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:49.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:19:48.940+0000 7feb98fc5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:49.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:19:48.940+0000 7feb98fc5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:49.342 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:19:48 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:19:48.940+0000 7feb98fc5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:49.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:49 smithi060 ceph-mon[35058]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 0 op/s 2024-09-19T05:19:49.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:49 smithi082 ceph-mon[35195]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 0 op/s 2024-09-19T05:19:49.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T05:19:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:50.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:50 smithi001 ceph-mon[30968]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:50.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 -- 172.21.15.1:0/4000333249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108102570 msgr2=0x7f61081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:50.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 --2- 172.21.15.1:0/4000333249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108102570 0x7f61081029b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009900 tx=0x7f60fc02a480 comp rx=0 tx=0).stop 2024-09-19T05:19:50.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 -- 172.21.15.1:0/4000333249 shutdown_connections 2024-09-19T05:19:50.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 --2- 172.21.15.1:0/4000333249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102ef0 0x7f610810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 --2- 172.21.15.1:0/4000333249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108102570 0x7f61081029b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 --2- 172.21.15.1:0/4000333249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108100e20 0x7f6108101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 -- 172.21.15.1:0/4000333249 >> 172.21.15.1:0/4000333249 conn(0x7f61080fc7d0 msgr2=0x7f61080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 -- 172.21.15.1:0/4000333249 shutdown_connections 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.465+0000 7f610cc63640 1 -- 172.21.15.1:0/4000333249 wait complete. 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 Processor -- start 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 -- start start 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 0x7f6108198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108102ef0 0x7f610819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6108110f80 con 0x7f6108100e20 2024-09-19T05:19:50.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6108110e00 con 0x7f6108102570 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610cc63640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6108111100 con 0x7f6108102ef0 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33148/0 (socket says 172.21.15.1:33148) 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.466+0000 7f610659c640 1 -- 172.21.15.1:0/3878932484 learned_addr learned my addr 172.21.15.1:0/3878932484 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f6106d9d640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108102ef0 0x7f610819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f6105d9b640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 0x7f6108198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 -- 172.21.15.1:0/3878932484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108102ef0 msgr2=0x7f610819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108102ef0 0x7f610819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 -- 172.21.15.1:0/3878932484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 msgr2=0x7f6108198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 0x7f6108198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 -- 172.21.15.1:0/3878932484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610819d4e0 con 0x7f6108100e20 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f6105d9b640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 0x7f6108198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610659c640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60f800e9f0 tx=0x7f60f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:50.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f800cd80 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60f8005500 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610819d7d0 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8010690 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.467+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61081a50b0 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.468+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6108101200 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.469+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f60f80046c0 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.470+0000 7f60f77fe640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 0x7f60f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.470+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f60f80d03e0 con 0x7f6108100e20 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.470+0000 7f6105d9b640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 0x7f60f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.471+0000 7f6105d9b640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 0x7f60f00a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000c00 tx=0x7f60fc004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:50.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.473+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60f8054210 con 0x7f6108100e20 2024-09-19T05:19:50.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:50 smithi060 ceph-mon[35058]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:50 smithi082 ceph-mon[35195]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:50.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.676+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6108106f10 con 0x7f60f00a3350 2024-09-19T05:19:50.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.702+0000 7f60f77fe640 1 -- 172.21.15.1:0/3878932484 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6108106f10 con 0x7f60f00a3350 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 msgr2=0x7f60f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 0x7f60f00a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000c00 tx=0x7f60fc004100 comp rx=0 tx=0).stop 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 msgr2=0x7f6108198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60f800e9f0 tx=0x7f60f800edf0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 shutdown_connections 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60f00a3350 0x7f60f00a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6108102ef0 0x7f610819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6108102570 0x7f6108198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 --2- 172.21.15.1:0/3878932484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6108100e20 0x7f6108198530 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:50.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.704+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 >> 172.21.15.1:0/3878932484 conn(0x7f61080fc7d0 msgr2=0x7f6108069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:50.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.705+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 shutdown_connections 2024-09-19T05:19:50.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:50.705+0000 7f610cc63640 1 -- 172.21.15.1:0/3878932484 wait complete. 2024-09-19T05:19:51.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:51 smithi001 ceph-mon[30968]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 op/s 2024-09-19T05:19:51.319 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:51 smithi001 ceph-mon[30968]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T05:19:51.320 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:51 smithi001 ceph-mon[30968]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:51.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T05:19:51.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:51 smithi082 ceph-mon[35195]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 op/s 2024-09-19T05:19:51.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:51 smithi082 ceph-mon[35195]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T05:19:51.409 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:51 smithi082 ceph-mon[35195]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:51.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:51 smithi060 ceph-mon[35058]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 op/s 2024-09-19T05:19:51.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:51 smithi060 ceph-mon[35058]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T05:19:51.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:51 smithi060 ceph-mon[35058]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:51.616 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 -- 172.21.15.1:0/2061613702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 msgr2=0x7f5584100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 --2- 172.21.15.1:0/2061613702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 0x7f5584100ee0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5578009930 tx=0x7f557802a420 comp rx=0 tx=0).stop 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 -- 172.21.15.1:0/2061613702 shutdown_connections 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 --2- 172.21.15.1:0/2061613702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584101420 0x7f558410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 --2- 172.21.15.1:0/2061613702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 0x7f5584100ee0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 --2- 172.21.15.1:0/2061613702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 0x7f5584106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 -- 172.21.15.1:0/2061613702 >> 172.21.15.1:0/2061613702 conn(0x7f55840fc7a0 msgr2=0x7f55840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 -- 172.21.15.1:0/2061613702 shutdown_connections 2024-09-19T05:19:52.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.133+0000 7f5589edf640 1 -- 172.21.15.1:0/2061613702 wait complete. 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.134+0000 7f5589edf640 1 Processor -- start 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.134+0000 7f5589edf640 1 -- start start 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.134+0000 7f5589edf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584100a80 0x7f55841973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.134+0000 7f5589edf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.134+0000 7f5589edf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 0x7f558419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5589edf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5584110e80 con 0x7f5584101420 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5589edf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5584110d00 con 0x7f5584106a80 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5589edf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5584111000 con 0x7f5584100a80 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33176/0 (socket says 172.21.15.1:33176) 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 -- 172.21.15.1:0/2067877957 learned_addr learned my addr 172.21.15.1:0/2067877957 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f55837fe640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584100a80 0x7f55841973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5583fff640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 0x7f558419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:52.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 -- 172.21.15.1:0/2067877957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584100a80 msgr2=0x7f55841973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584100a80 0x7f55841973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 -- 172.21.15.1:0/2067877957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 msgr2=0x7f558419bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 0x7f558419bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 -- 172.21.15.1:0/2067877957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558419c360 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5578009230 tx=0x7f5578004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557803f030 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558419c5f0 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578003ad0 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578035070 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.135+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55841a3f30 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.136+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55841021c0 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.138+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5578042030 con 0x7f5584101420 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.138+0000 7f5580ff9640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 0x7f556c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:52.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.139+0000 7f55837fe640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 0x7f556c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.139+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f55780f0360 con 0x7f5584101420 2024-09-19T05:19:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.139+0000 7f55837fe640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 0x7f556c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5574009b50 tx=0x7f5574005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:52.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.143+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55780bcce0 con 0x7f5584101420 2024-09-19T05:19:52.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.351+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f5584062630 con 0x7f556c0a32d0 2024-09-19T05:19:52.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.356+0000 7f5580ff9640 1 -- 172.21.15.1:0/2067877957 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5584062630 con 0x7f556c0a32d0 2024-09-19T05:19:52.358 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/1a5cd655-9de4-4526-874d-8992b5fd3e9c 2024-09-19T05:19:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 msgr2=0x7f556c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 0x7f556c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5574009b50 tx=0x7f5574005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 msgr2=0x7f55841978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5578009230 tx=0x7f5578004270 comp rx=0 tx=0).stop 2024-09-19T05:19:52.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 shutdown_connections 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a32d0 0x7f556c0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584106a80 0x7f558419bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f55841978f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 --2- 172.21.15.1:0/2067877957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584100a80 0x7f55841973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.358+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 >> 172.21.15.1:0/2067877957 conn(0x7f55840fc7a0 msgr2=0x7f55840fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.359+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 shutdown_connections 2024-09-19T05:19:52.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:52.359+0000 7f5589edf640 1 -- 172.21.15.1:0/2067877957 wait complete. 2024-09-19T05:19:53.163 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T05:19:53.424 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:53.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:53 smithi060 ceph-mon[35058]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T05:19:53.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:53 smithi060 ceph-mon[35058]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:53 smithi082 ceph-mon[35195]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T05:19:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:53 smithi082 ceph-mon[35195]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:53.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:53 smithi001 ceph-mon[30968]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-19T05:19:53.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:53 smithi001 ceph-mon[30968]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- 172.21.15.1:0/2336064621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470100e20 msgr2=0x7f9470101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 --2- 172.21.15.1:0/2336064621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470100e20 0x7f9470101200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f946c009900 tx=0x7f946c02a480 comp rx=0 tx=0).stop 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- 172.21.15.1:0/2336064621 shutdown_connections 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 --2- 172.21.15.1:0/2336064621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470102ef0 0x7f947010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 --2- 172.21.15.1:0/2336064621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 0x7f94701029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 --2- 172.21.15.1:0/2336064621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470100e20 0x7f9470101200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- 172.21.15.1:0/2336064621 >> 172.21.15.1:0/2336064621 conn(0x7f94700fc7d0 msgr2=0x7f94700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- 172.21.15.1:0/2336064621 shutdown_connections 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- 172.21.15.1:0/2336064621 wait complete. 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 Processor -- start 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.895+0000 7f94771c0640 1 -- start start 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470100e20 0x7f9470198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 0x7f9470198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9470110f80 con 0x7f9470102ef0 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9470110e00 con 0x7f9470100e20 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9470111100 con 0x7f9470102570 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33198/0 (socket says 172.21.15.1:33198) 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 -- 172.21.15.1:0/2904057646 learned_addr learned my addr 172.21.15.1:0/2904057646 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f9467fff640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 0x7f9470198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f9474f5c640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470100e20 0x7f9470198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 -- 172.21.15.1:0/2904057646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 msgr2=0x7f9470198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 0x7f9470198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 -- 172.21.15.1:0/2904057646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470100e20 msgr2=0x7f9470198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470100e20 0x7f9470198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 -- 172.21.15.1:0/2904057646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947019d4d0 con 0x7f9470102ef0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f947575d640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f946800eaa0 tx=0x7f946800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946800cdb0 con 0x7f9470102ef0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9468005020 con 0x7f9470102ef0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947019d7c0 con 0x7f9470102ef0 2024-09-19T05:19:53.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.896+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94680116b0 con 0x7f9470102ef0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.897+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94701a50a0 con 0x7f9470102ef0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.898+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9470101200 con 0x7f9470102ef0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.899+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9468005560 con 0x7f9470102ef0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.901+0000 7f9465ffb640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 0x7f94580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.901+0000 7f9474f5c640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 0x7f94580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.901+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f94680cff60 con 0x7f9470102ef0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.901+0000 7f9474f5c640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 0x7f94580a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f946c005ab0 tx=0x7f946c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:53.905+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9468016030 con 0x7f9470102ef0 2024-09-19T05:19:54.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.109+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f94701068a0 con 0x7f94580a3350 2024-09-19T05:19:54.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.133+0000 7f9465ffb640 1 -- 172.21.15.1:0/2904057646 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f94701068a0 con 0x7f94580a3350 2024-09-19T05:19:54.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 msgr2=0x7f94580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 0x7f94580a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f946c005ab0 tx=0x7f946c005a20 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 msgr2=0x7f947019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f946800eaa0 tx=0x7f946800ef60 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 shutdown_connections 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94580a3350 0x7f94580a5810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9470102ef0 0x7f947019cdf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9470102570 0x7f9470198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 --2- 172.21.15.1:0/2904057646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9470100e20 0x7f9470198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 >> 172.21.15.1:0/2904057646 conn(0x7f94700fc7d0 msgr2=0x7f947006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 shutdown_connections 2024-09-19T05:19:54.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:54.135+0000 7f94771c0640 1 -- 172.21.15.1:0/2904057646 wait complete. 2024-09-19T05:19:54.773 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T05:19:55.036 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:55.452 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:55 smithi001 ceph-mon[30968]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:55.453 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:55 smithi001 ceph-mon[30968]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:55.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:55 smithi060 ceph-mon[35058]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:55 smithi060 ceph-mon[35058]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:55 smithi082 ceph-mon[35195]: pgmap v309: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:55 smithi082 ceph-mon[35195]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:55.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 -- 172.21.15.1:0/3609234667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44102790 msgr2=0x7f5a441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/3609234667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44102790 0x7f5a441067e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009900 tx=0x7f5a3802a410 comp rx=0 tx=0).stop 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 -- 172.21.15.1:0/3609234667 shutdown_connections 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/3609234667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44106f10 0x7f5a4410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/3609234667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44102790 0x7f5a441067e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/3609234667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44101de0 0x7f5a441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 -- 172.21.15.1:0/3609234667 >> 172.21.15.1:0/3609234667 conn(0x7f5a440fd8c0 msgr2=0x7f5a440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 -- 172.21.15.1:0/3609234667 shutdown_connections 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.538+0000 7f5a4a29c640 1 -- 172.21.15.1:0/3609234667 wait complete. 2024-09-19T05:19:55.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 Processor -- start 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 -- start start 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44102790 0x7f5a441988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 0x7f5a4419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44111f70 con 0x7f5a44101de0 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44111df0 con 0x7f5a44106f10 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.539+0000 7f5a4a29c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441120f0 con 0x7f5a44102790 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51516/0 (socket says 172.21.15.1:51516) 2024-09-19T05:19:55.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 -- 172.21.15.1:0/2987527462 learned_addr learned my addr 172.21.15.1:0/2987527462 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a48839640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 0x7f5a4419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a437fe640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44102790 0x7f5a441988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 -- 172.21.15.1:0/2987527462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44102790 msgr2=0x7f5a441988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44102790 0x7f5a441988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 -- 172.21.15.1:0/2987527462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 msgr2=0x7f5a4419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 0x7f5a4419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 -- 172.21.15.1:0/2987527462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4419d360 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a48839640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 0x7f5a4419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a43fff640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c890 tx=0x7f5a3400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34004220 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a340043c0 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a340049e0 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4419d650 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.540+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a441a4f30 con 0x7f5a44101de0 2024-09-19T05:19:55.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.541+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a441021c0 con 0x7f5a44101de0 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.542+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5a340079b0 con 0x7f5a44101de0 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.543+0000 7f5a417fa640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 0x7f5a2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.544+0000 7f5a437fe640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 0x7f5a2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.544+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5a340cfdf0 con 0x7f5a44101de0 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.544+0000 7f5a437fe640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 0x7f5a2c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a441088e0 tx=0x7f5a38031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:55.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.548+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a34014030 con 0x7f5a44101de0 2024-09-19T05:19:55.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.753+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5a4410a1c0 con 0x7f5a2c0a32d0 2024-09-19T05:19:55.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.757+0000 7f5a417fa640 1 -- 172.21.15.1:0/2987527462 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5a38031860 con 0x7f5a2c0a32d0 2024-09-19T05:19:55.759 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/b41561ac-f641-4384-a7f0-dc70293bfb0c 2024-09-19T05:19:55.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 msgr2=0x7f5a2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 0x7f5a2c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5a441088e0 tx=0x7f5a38031490 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 msgr2=0x7f5a441983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c890 tx=0x7f5a3400cd50 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 shutdown_connections 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5a2c0a32d0 0x7f5a2c0a5790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a44106f10 0x7f5a4419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a44102790 0x7f5a441988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 --2- 172.21.15.1:0/2987527462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a44101de0 0x7f5a441983b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 >> 172.21.15.1:0/2987527462 conn(0x7f5a440fd8c0 msgr2=0x7f5a440fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 shutdown_connections 2024-09-19T05:19:55.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:55.760+0000 7f5a4a29c640 1 -- 172.21.15.1:0/2987527462 wait complete. 2024-09-19T05:19:56.443 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:56 smithi001 ceph-mon[30968]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:56.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:56.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:56 smithi060 ceph-mon[35058]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:56.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:56 smithi082 ceph-mon[35195]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:56.749 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 -- 172.21.15.1:0/67867472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c41036c0 msgr2=0x7f38c410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 --2- 172.21.15.1:0/67867472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c41036c0 0x7f38c410bbb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009900 tx=0x7f38b002a480 comp rx=0 tx=0).stop 2024-09-19T05:19:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 -- 172.21.15.1:0/67867472 shutdown_connections 2024-09-19T05:19:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 --2- 172.21.15.1:0/67867472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c410c180 0x7f38c410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 --2- 172.21.15.1:0/67867472 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c41036c0 0x7f38c410bbb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 --2- 172.21.15.1:0/67867472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102da0 0x7f38c4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 -- 172.21.15.1:0/67867472 >> 172.21.15.1:0/67867472 conn(0x7f38c40fc7a0 msgr2=0x7f38c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 -- 172.21.15.1:0/67867472 shutdown_connections 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 -- 172.21.15.1:0/67867472 wait complete. 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.302+0000 7f38cab91640 1 Processor -- start 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 -- start start 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c41036c0 0x7f38c4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 0x7f38c419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111f60 con 0x7f38c4102da0 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4111de0 con 0x7f38c410c180 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38cab91640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41120e0 con 0x7f38c41036c0 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51534/0 (socket says 172.21.15.1:51534) 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 -- 172.21.15.1:0/1377854845 learned_addr learned my addr 172.21.15.1:0/1377854845 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c3fff640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c41036c0 0x7f38c4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c912e640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 0x7f38c419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 -- 172.21.15.1:0/1377854845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c41036c0 msgr2=0x7f38c4198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c41036c0 0x7f38c4198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 -- 172.21.15.1:0/1377854845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 msgr2=0x7f38c419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 0x7f38c419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 -- 172.21.15.1:0/1377854845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c419d3d0 con 0x7f38c4102da0 2024-09-19T05:19:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c912e640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 0x7f38c419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.303+0000 7f38c892d640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38b800e9f0 tx=0x7f38b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.304+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b800cd80 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.304+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38b8010910 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.304+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c419d6c0 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.304+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8018990 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.304+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c41a4fa0 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.305+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c4103180 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.306+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f38b8010ac0 con 0x7f38c4102da0 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.307+0000 7f38c1ffb640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 0x7f38b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.307+0000 7f38c3fff640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 0x7f38b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.307+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f38b80d0340 con 0x7f38c4102da0 2024-09-19T05:19:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.307+0000 7f38c3fff640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 0x7f38b40a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009230 tx=0x7f38b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.310+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38b809c670 con 0x7f38c4102da0 2024-09-19T05:19:57.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:57 smithi060 ceph-mon[35058]: pgmap v310: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:57.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:57 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:57.468 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:57 smithi082 ceph-mon[35195]: pgmap v310: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:57.469 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:57 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:57.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.533+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38c41071f0 con 0x7f38c4102da0 2024-09-19T05:19:57.535 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:57 smithi001 ceph-mon[30968]: pgmap v310: 129 pgs: 129 active+clean; 601 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:19:57.536 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:57 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:57.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.534+0000 7f38c1ffb640 1 -- 172.21.15.1:0/1377854845 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f38b80a0970 con 0x7f38c4102da0 2024-09-19T05:19:57.536 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:57.537 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:19:57.537 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:19:57.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 msgr2=0x7f38b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:57.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 0x7f38b40a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009230 tx=0x7f38b00058d0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 msgr2=0x7f38c4198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:57.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38b800e9f0 tx=0x7f38b800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 shutdown_connections 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f38b40a3350 0x7f38b40a5810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c410c180 0x7f38c419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38c41036c0 0x7f38c4198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 --2- 172.21.15.1:0/1377854845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f38c4102da0 0x7f38c4198420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 >> 172.21.15.1:0/1377854845 conn(0x7f38c40fc7a0 msgr2=0x7f38c40fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 shutdown_connections 2024-09-19T05:19:57.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:57.536+0000 7f38cab91640 1 -- 172.21.15.1:0/1377854845 wait complete. 2024-09-19T05:19:58.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:58 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1377854845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:58.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:58 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:58 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:58 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:58 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:58 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1377854845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:58.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:58 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:58 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:58 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:58 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:58 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1377854845' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:58.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:58 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:58 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:58 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.514 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:58 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:19:58.853 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:59.149 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:59.429 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:19:59 smithi001 ceph-mon[30968]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:19:59.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:19:59 smithi060 ceph-mon[35058]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:19:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:19:59 smithi082 ceph-mon[35195]: pgmap v311: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:19:59.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 -- 172.21.15.1:0/1493631548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 msgr2=0x7feab410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:59.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 --2- 172.21.15.1:0/1493631548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab410d950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feaac009cd0 tx=0x7feaac02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 -- 172.21.15.1:0/1493631548 shutdown_connections 2024-09-19T05:19:59.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 --2- 172.21.15.1:0/1493631548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab410d950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 --2- 172.21.15.1:0/1493631548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 0x7feab4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 --2- 172.21.15.1:0/1493631548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 -- 172.21.15.1:0/1493631548 >> 172.21.15.1:0/1493631548 conn(0x7feab40fc7a0 msgr2=0x7feab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 -- 172.21.15.1:0/1493631548 shutdown_connections 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.630+0000 7feabafed640 1 -- 172.21.15.1:0/1493631548 wait complete. 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.631+0000 7feabafed640 1 Processor -- start 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.631+0000 7feabafed640 1 -- start start 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 0x7feab4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:59.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab41a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feab4110e80 con 0x7feab4101420 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feab4110d00 con 0x7feab4106a80 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feabafed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feab4111000 con 0x7feab4100a80 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51556/0 (socket says 172.21.15.1:51556) 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 -- 172.21.15.1:0/1145842099 learned_addr learned my addr 172.21.15.1:0/1145842099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feab958a640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab41a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feab8d89640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 0x7feab4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 -- 172.21.15.1:0/1145842099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 msgr2=0x7feab4199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 0x7feab4199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 -- 172.21.15.1:0/1145842099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 msgr2=0x7feab41a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab41a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 -- 172.21.15.1:0/1145842099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab41a4810 con 0x7feab4101420 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feab958a640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab41a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaabfff640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d950 tx=0x7feaa400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.632+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4017070 con 0x7feab4101420 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.633+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab41a49e0 con 0x7feab4101420 2024-09-19T05:19:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.633+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa4009c30 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.633+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa400f6b0 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.633+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab41a4f20 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.634+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab4100ee0 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.635+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7feaa40109d0 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.636+0000 7feaa9ffb640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 0x7fea9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.636+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7feaa40cfd90 con 0x7feab4101420 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.636+0000 7feab8d89640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 0x7fea9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:59.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.636+0000 7feab8d89640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 0x7fea9c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feab0005fd0 tx=0x7feab0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:59.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.640+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feaa4009de0 con 0x7feab4101420 2024-09-19T05:19:59.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.830+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feab4109010 con 0x7feab4101420 2024-09-19T05:19:59.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.832+0000 7feaa9ffb640 1 -- 172.21.15.1:0/1145842099 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7feaa409c6b0 con 0x7feab4101420 2024-09-19T05:19:59.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:19:59.834 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:59.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.834+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 msgr2=0x7fea9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:59.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 0x7fea9c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feab0005fd0 tx=0x7feab0005850 comp rx=0 tx=0).stop 2024-09-19T05:19:59.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 msgr2=0x7feab4199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:59.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7feaa400d950 tx=0x7feaa400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:59.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 shutdown_connections 2024-09-19T05:19:59.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fea9c0a32d0 0x7fea9c0a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feab4106a80 0x7feab41a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feab4101420 0x7feab4199790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 --2- 172.21.15.1:0/1145842099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feab4100a80 0x7feab4199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:59.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 >> 172.21.15.1:0/1145842099 conn(0x7feab40fc7a0 msgr2=0x7feab40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:59.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 shutdown_connections 2024-09-19T05:19:59.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:19:59.835+0000 7feabafed640 1 -- 172.21.15.1:0/1145842099 wait complete. 2024-09-19T05:20:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1145842099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:00.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:00 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1145842099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:00 smithi060 ceph-mon[35058]: overall HEALTH_OK 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1145842099' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:00 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:20:00.522 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T05:20:00.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:20:00.781 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 -- 172.21.15.1:0/1428738921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102ef0 msgr2=0x7f5ec010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/1428738921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102ef0 0x7f5ec010da40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009ca0 tx=0x7f5eb802a950 comp rx=0 tx=0).stop 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 -- 172.21.15.1:0/1428738921 shutdown_connections 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/1428738921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102ef0 0x7f5ec010da40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/1428738921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102570 0x7f5ec01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/1428738921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 0x7f5ec0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 -- 172.21.15.1:0/1428738921 >> 172.21.15.1:0/1428738921 conn(0x7f5ec00fc7d0 msgr2=0x7f5ec00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 -- 172.21.15.1:0/1428738921 shutdown_connections 2024-09-19T05:20:01.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.279+0000 7f5ec6d87640 1 -- 172.21.15.1:0/1428738921 wait complete. 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 Processor -- start 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 -- start start 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 0x7f5ec0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 0x7f5ec019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0110f80 con 0x7f5ec0102570 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0110e00 con 0x7f5ec0102ef0 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec6d87640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0111100 con 0x7f5ec0100e20 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51562/0 (socket says 172.21.15.1:51562) 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 -- 172.21.15.1:0/335683082 learned_addr learned my addr 172.21.15.1:0/335683082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec4b23640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 0x7f5ec0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec5324640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 0x7f5ec019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 -- 172.21.15.1:0/335683082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 msgr2=0x7f5ec0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 0x7f5ec0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 -- 172.21.15.1:0/335683082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 msgr2=0x7f5ec019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 0x7f5ec019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ebffff640 1 -- 172.21.15.1:0/335683082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec019d2c0 con 0x7f5ec0102570 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.280+0000 7f5ec5324640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 0x7f5ec019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ebffff640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c920 tx=0x7f5eac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac007c70 con 0x7f5ec0102570 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eac007e10 con 0x7f5ec0102570 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec019d5b0 con 0x7f5ec0102570 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac018890 con 0x7f5ec0102570 2024-09-19T05:20:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.281+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a4e90 con 0x7f5ec0102570 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.282+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec0101200 con 0x7f5ec0102570 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.283+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5eac018a70 con 0x7f5ec0102570 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.284+0000 7f5ebdffb640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 0x7f5eb00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.284+0000 7f5ec4b23640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 0x7f5eb00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.284+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5eac0cfee0 con 0x7f5ec0102570 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.284+0000 7f5ec4b23640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 0x7f5eb00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005e10 tx=0x7f5eb4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.288+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5eac014030 con 0x7f5ec0102570 2024-09-19T05:20:01.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.460+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ec006a780 con 0x7f5eb00a32d0 2024-09-19T05:20:01.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.470+0000 7f5ebdffb640 1 -- 172.21.15.1:0/335683082 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340512 (secure 0 0 0) 0x7f5ec006a780 con 0x7f5eb00a32d0 2024-09-19T05:20:01.475 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:01.477 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 msgr2=0x7f5eb00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 0x7f5eb00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005e10 tx=0x7f5eb4005da0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 msgr2=0x7f5ec0198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00c920 tx=0x7f5eac00cde0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 shutdown_connections 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5eb00a32d0 0x7f5eb00a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ec0102ef0 0x7f5ec019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ec0102570 0x7f5ec0198850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 --2- 172.21.15.1:0/335683082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0100e20 0x7f5ec0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 >> 172.21.15.1:0/335683082 conn(0x7f5ec00fc7d0 msgr2=0x7f5ec006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 shutdown_connections 2024-09-19T05:20:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:01.473+0000 7f5ec6d87640 1 -- 172.21.15.1:0/335683082 wait complete. 2024-09-19T05:20:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:01 smithi001 ceph-mon[30968]: pgmap v312: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:02.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:01 smithi060 ceph-mon[35058]: pgmap v312: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:01 smithi082 ceph-mon[35195]: pgmap v312: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:02.211 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-19T05:19:59.843424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634745,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":164,"num_read_kb":173,"num_write":255,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381492,"kb_used_data":11432,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560332,"statfs":{"total":1151940427776,"available":1151549779968,"internally_reserved":0,"allocated":11706368,"data_stored":7615673,"data_compressed":318396,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39735,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":55,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003399"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040079+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:19:12.040079+0000","last_peered":"2024-09-19T05:19:12.040079+0000","last_clean":"2024-09-19T05:19:12.040079+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:19:12.040079+0000","last_undegraded":"2024-09-19T05:19:12.040079+0000","last_fullsized":"2024-09-19T05:19:12.040079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037874+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:19:12.037874+0000","last_peered":"2024-09-19T05:19:12.037874+0000","last_clean":"2024-09-19T05:19:12.037874+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:19:12.037874+0000","last_undegraded":"2024-09-19T05:19:12.037874+0000","last_fullsized":"2024-09-19T05:19:12.037874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038041+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:19:12.038041+0000","last_peered":"2024-09-19T05:19:12.038041+0000","last_clean":"2024-09-19T05:19:12.038041+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:19:12.038041+0000","last_undegraded":"2024-09-19T05:19:12.038041+0000","last_fullsized":"2024-09-19T05:19:12.038041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038179+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:19:12.038179+0000","last_peered":"2024-09-19T05:19:12.038179+0000","last_clean":"2024-09-19T05:19:12.038179+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:19:12.038179+0000","last_undegraded":"2024-09-19T05:19:12.038179+0000","last_fullsized":"2024-09-19T05:19:12.038179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013961+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:19:12.013961+0000","last_peered":"2024-09-19T05:19:12.013961+0000","last_clean":"2024-09-19T05:19:12.013961+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:19:12.013961+0000","last_undegraded":"2024-09-19T05:19:12.013961+0000","last_fullsized":"2024-09-19T05:19:12.013961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038491+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:19:12.038491+0000","last_peered":"2024-09-19T05:19:12.038491+0000","last_clean":"2024-09-19T05:19:12.038491+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:19:12.038491+0000","last_undegraded":"2024-09-19T05:19:12.038491+0000","last_fullsized":"2024-09-19T05:19:12.038491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015089+0000","last_change":"2024-09-19T05:18:59.696877+0000","last_active":"2024-09-19T05:19:12.015089+0000","last_peered":"2024-09-19T05:19:12.015089+0000","last_clean":"2024-09-19T05:19:12.015089+0000","last_became_active":"2024-09-19T05:18:59.696501+0000","last_became_peered":"2024-09-19T05:18:59.696501+0000","last_unstale":"2024-09-19T05:19:12.015089+0000","last_undegraded":"2024-09-19T05:19:12.015089+0000","last_fullsized":"2024-09-19T05:19:12.015089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:14.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038197+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:19:12.038197+0000","last_peered":"2024-09-19T05:19:12.038197+0000","last_clean":"2024-09-19T05:19:12.038197+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:19:12.038197+0000","last_undegraded":"2024-09-19T05:19:12.038197+0000","last_fullsized":"2024-09-19T05:19:12.038197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039405+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:19:12.039405+0000","last_peered":"2024-09-19T05:19:12.039405+0000","last_clean":"2024-09-19T05:19:12.039405+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:19:12.039405+0000","last_undegraded":"2024-09-19T05:19:12.039405+0000","last_fullsized":"2024-09-19T05:19:12.039405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014838+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:19:12.014838+0000","last_peered":"2024-09-19T05:19:12.014838+0000","last_clean":"2024-09-19T05:19:12.014838+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:19:12.014838+0000","last_undegraded":"2024-09-19T05:19:12.014838+0000","last_fullsized":"2024-09-19T05:19:12.014838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039607+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:19:12.039607+0000","last_peered":"2024-09-19T05:19:12.039607+0000","last_clean":"2024-09-19T05:19:12.039607+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:19:12.039607+0000","last_undegraded":"2024-09-19T05:19:12.039607+0000","last_fullsized":"2024-09-19T05:19:12.039607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038922+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:19:12.038922+0000","last_peered":"2024-09-19T05:19:12.038922+0000","last_clean":"2024-09-19T05:19:12.038922+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:19:12.038922+0000","last_undegraded":"2024-09-19T05:19:12.038922+0000","last_fullsized":"2024-09-19T05:19:12.038922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014152+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:19:12.014152+0000","last_peered":"2024-09-19T05:19:12.014152+0000","last_clean":"2024-09-19T05:19:12.014152+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:19:12.014152+0000","last_undegraded":"2024-09-19T05:19:12.014152+0000","last_fullsized":"2024-09-19T05:19:12.014152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014466+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:19:12.014466+0000","last_peered":"2024-09-19T05:19:12.014466+0000","last_clean":"2024-09-19T05:19:12.014466+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:19:12.014466+0000","last_undegraded":"2024-09-19T05:19:12.014466+0000","last_fullsized":"2024-09-19T05:19:12.014466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039164+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:19:12.039164+0000","last_peered":"2024-09-19T05:19:12.039164+0000","last_clean":"2024-09-19T05:19:12.039164+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:19:12.039164+0000","last_undegraded":"2024-09-19T05:19:12.039164+0000","last_fullsized":"2024-09-19T05:19:12.039164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038743+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:19:12.038743+0000","last_peered":"2024-09-19T05:19:12.038743+0000","last_clean":"2024-09-19T05:19:12.038743+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:19:12.038743+0000","last_undegraded":"2024-09-19T05:19:12.038743+0000","last_fullsized":"2024-09-19T05:19:12.038743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038238+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:19:12.038238+0000","last_peered":"2024-09-19T05:19:12.038238+0000","last_clean":"2024-09-19T05:19:12.038238+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:19:12.038238+0000","last_undegraded":"2024-09-19T05:19:12.038238+0000","last_fullsized":"2024-09-19T05:19:12.038238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039412+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:19:12.039412+0000","last_peered":"2024-09-19T05:19:12.039412+0000","last_clean":"2024-09-19T05:19:12.039412+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:19:12.039412+0000","last_undegraded":"2024-09-19T05:19:12.039412+0000","last_fullsized":"2024-09-19T05:19:12.039412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038419+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:19:12.038419+0000","last_peered":"2024-09-19T05:19:12.038419+0000","last_clean":"2024-09-19T05:19:12.038419+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:19:12.038419+0000","last_undegraded":"2024-09-19T05:19:12.038419+0000","last_fullsized":"2024-09-19T05:19:12.038419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038774+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:19:12.038774+0000","last_peered":"2024-09-19T05:19:12.038774+0000","last_clean":"2024-09-19T05:19:12.038774+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:19:12.038774+0000","last_undegraded":"2024-09-19T05:19:12.038774+0000","last_fullsized":"2024-09-19T05:19:12.038774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039841+0000","last_change":"2024-09-19T05:19:09.016342+0000","last_active":"2024-09-19T05:19:12.039841+0000","last_peered":"2024-09-19T05:19:12.039841+0000","last_clean":"2024-09-19T05:19:12.039841+0000","last_became_active":"2024-09-19T05:19:09.015247+0000","last_became_peered":"2024-09-19T05:19:09.015247+0000","last_unstale":"2024-09-19T05:19:12.039841+0000","last_undegraded":"2024-09-19T05:19:12.039841+0000","last_fullsized":"2024-09-19T05:19:12.039841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:23.735913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014285+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:19:12.014285+0000","last_peered":"2024-09-19T05:19:12.014285+0000","last_clean":"2024-09-19T05:19:12.014285+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:19:12.014285+0000","last_undegraded":"2024-09-19T05:19:12.014285+0000","last_fullsized":"2024-09-19T05:19:12.014285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037944+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:19:12.037944+0000","last_peered":"2024-09-19T05:19:12.037944+0000","last_clean":"2024-09-19T05:19:12.037944+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:19:12.037944+0000","last_undegraded":"2024-09-19T05:19:12.037944+0000","last_fullsized":"2024-09-19T05:19:12.037944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038937+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:19:12.038937+0000","last_peered":"2024-09-19T05:19:12.038937+0000","last_clean":"2024-09-19T05:19:12.038937+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:19:12.038937+0000","last_undegraded":"2024-09-19T05:19:12.038937+0000","last_fullsized":"2024-09-19T05:19:12.038937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013795+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:19:12.013795+0000","last_peered":"2024-09-19T05:19:12.013795+0000","last_clean":"2024-09-19T05:19:12.013795+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:19:12.013795+0000","last_undegraded":"2024-09-19T05:19:12.013795+0000","last_fullsized":"2024-09-19T05:19:12.013795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040085+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:19:12.040085+0000","last_peered":"2024-09-19T05:19:12.040085+0000","last_clean":"2024-09-19T05:19:12.040085+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:19:12.040085+0000","last_undegraded":"2024-09-19T05:19:12.040085+0000","last_fullsized":"2024-09-19T05:19:12.040085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038277+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:19:12.038277+0000","last_peered":"2024-09-19T05:19:12.038277+0000","last_clean":"2024-09-19T05:19:12.038277+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:19:12.038277+0000","last_undegraded":"2024-09-19T05:19:12.038277+0000","last_fullsized":"2024-09-19T05:19:12.038277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038052+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:19:12.038052+0000","last_peered":"2024-09-19T05:19:12.038052+0000","last_clean":"2024-09-19T05:19:12.038052+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:19:12.038052+0000","last_undegraded":"2024-09-19T05:19:12.038052+0000","last_fullsized":"2024-09-19T05:19:12.038052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:54.983007+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:19:54.983007+0000","last_peered":"2024-09-19T05:19:54.983007+0000","last_clean":"2024-09-19T05:19:54.983007+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:19:54.983007+0000","last_undegraded":"2024-09-19T05:19:54.983007+0000","last_fullsized":"2024-09-19T05:19:54.983007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037560+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:19:12.037560+0000","last_peered":"2024-09-19T05:19:12.037560+0000","last_clean":"2024-09-19T05:19:12.037560+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:19:12.037560+0000","last_undegraded":"2024-09-19T05:19:12.037560+0000","last_fullsized":"2024-09-19T05:19:12.037560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038482+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:19:12.038482+0000","last_peered":"2024-09-19T05:19:12.038482+0000","last_clean":"2024-09-19T05:19:12.038482+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:19:12.038482+0000","last_undegraded":"2024-09-19T05:19:12.038482+0000","last_fullsized":"2024-09-19T05:19:12.038482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015142+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:19:12.015142+0000","last_peered":"2024-09-19T05:19:12.015142+0000","last_clean":"2024-09-19T05:19:12.015142+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:19:12.015142+0000","last_undegraded":"2024-09-19T05:19:12.015142+0000","last_fullsized":"2024-09-19T05:19:12.015142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038820+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:19:12.038820+0000","last_peered":"2024-09-19T05:19:12.038820+0000","last_clean":"2024-09-19T05:19:12.038820+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:19:12.038820+0000","last_undegraded":"2024-09-19T05:19:12.038820+0000","last_fullsized":"2024-09-19T05:19:12.038820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038990+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:19:12.038990+0000","last_peered":"2024-09-19T05:19:12.038990+0000","last_clean":"2024-09-19T05:19:12.038990+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:19:12.038990+0000","last_undegraded":"2024-09-19T05:19:12.038990+0000","last_fullsized":"2024-09-19T05:19:12.038990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039878+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:19:12.039878+0000","last_peered":"2024-09-19T05:19:12.039878+0000","last_clean":"2024-09-19T05:19:12.039878+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:19:12.039878+0000","last_undegraded":"2024-09-19T05:19:12.039878+0000","last_fullsized":"2024-09-19T05:19:12.039878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014496+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:19:12.014496+0000","last_peered":"2024-09-19T05:19:12.014496+0000","last_clean":"2024-09-19T05:19:12.014496+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:19:12.014496+0000","last_undegraded":"2024-09-19T05:19:12.014496+0000","last_fullsized":"2024-09-19T05:19:12.014496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038672+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:19:12.038672+0000","last_peered":"2024-09-19T05:19:12.038672+0000","last_clean":"2024-09-19T05:19:12.038672+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:19:12.038672+0000","last_undegraded":"2024-09-19T05:19:12.038672+0000","last_fullsized":"2024-09-19T05:19:12.038672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014251+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:19:12.014251+0000","last_peered":"2024-09-19T05:19:12.014251+0000","last_clean":"2024-09-19T05:19:12.014251+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:19:12.014251+0000","last_undegraded":"2024-09-19T05:19:12.014251+0000","last_fullsized":"2024-09-19T05:19:12.014251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038384+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:19:12.038384+0000","last_peered":"2024-09-19T05:19:12.038384+0000","last_clean":"2024-09-19T05:19:12.038384+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:19:12.038384+0000","last_undegraded":"2024-09-19T05:19:12.038384+0000","last_fullsized":"2024-09-19T05:19:12.038384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038921+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:19:12.038921+0000","last_peered":"2024-09-19T05:19:12.038921+0000","last_clean":"2024-09-19T05:19:12.038921+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:19:12.038921+0000","last_undegraded":"2024-09-19T05:19:12.038921+0000","last_fullsized":"2024-09-19T05:19:12.038921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038011+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:19:12.038011+0000","last_peered":"2024-09-19T05:19:12.038011+0000","last_clean":"2024-09-19T05:19:12.038011+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:19:12.038011+0000","last_undegraded":"2024-09-19T05:19:12.038011+0000","last_fullsized":"2024-09-19T05:19:12.038011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038897+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:19:12.038897+0000","last_peered":"2024-09-19T05:19:12.038897+0000","last_clean":"2024-09-19T05:19:12.038897+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:19:12.038897+0000","last_undegraded":"2024-09-19T05:19:12.038897+0000","last_fullsized":"2024-09-19T05:19:12.038897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037787+0000","last_change":"2024-09-19T05:19:01.942408+0000","last_active":"2024-09-19T05:19:12.037787+0000","last_peered":"2024-09-19T05:19:12.037787+0000","last_clean":"2024-09-19T05:19:12.037787+0000","last_became_active":"2024-09-19T05:19:01.942058+0000","last_became_peered":"2024-09-19T05:19:01.942058+0000","last_unstale":"2024-09-19T05:19:12.037787+0000","last_undegraded":"2024-09-19T05:19:12.037787+0000","last_fullsized":"2024-09-19T05:19:12.037787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:47.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013938+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:19:12.013938+0000","last_peered":"2024-09-19T05:19:12.013938+0000","last_clean":"2024-09-19T05:19:12.013938+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:19:12.013938+0000","last_undegraded":"2024-09-19T05:19:12.013938+0000","last_fullsized":"2024-09-19T05:19:12.013938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039416+0000","last_change":"2024-09-19T05:19:09.030753+0000","last_active":"2024-09-19T05:19:12.039416+0000","last_peered":"2024-09-19T05:19:12.039416+0000","last_clean":"2024-09-19T05:19:12.039416+0000","last_became_active":"2024-09-19T05:19:09.030379+0000","last_became_peered":"2024-09-19T05:19:09.030379+0000","last_unstale":"2024-09-19T05:19:12.039416+0000","last_undegraded":"2024-09-19T05:19:12.039416+0000","last_fullsized":"2024-09-19T05:19:12.039416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:24.780185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038942+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:19:12.038942+0000","last_peered":"2024-09-19T05:19:12.038942+0000","last_clean":"2024-09-19T05:19:12.038942+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:19:12.038942+0000","last_undegraded":"2024-09-19T05:19:12.038942+0000","last_fullsized":"2024-09-19T05:19:12.038942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039716+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:19:12.039716+0000","last_peered":"2024-09-19T05:19:12.039716+0000","last_clean":"2024-09-19T05:19:12.039716+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:19:12.039716+0000","last_undegraded":"2024-09-19T05:19:12.039716+0000","last_fullsized":"2024-09-19T05:19:12.039716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014052+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:19:12.014052+0000","last_peered":"2024-09-19T05:19:12.014052+0000","last_clean":"2024-09-19T05:19:12.014052+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:19:12.014052+0000","last_undegraded":"2024-09-19T05:19:12.014052+0000","last_fullsized":"2024-09-19T05:19:12.014052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014573+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:19:12.014573+0000","last_peered":"2024-09-19T05:19:12.014573+0000","last_clean":"2024-09-19T05:19:12.014573+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:19:12.014573+0000","last_undegraded":"2024-09-19T05:19:12.014573+0000","last_fullsized":"2024-09-19T05:19:12.014573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014631+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:19:12.014631+0000","last_peered":"2024-09-19T05:19:12.014631+0000","last_clean":"2024-09-19T05:19:12.014631+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:19:12.014631+0000","last_undegraded":"2024-09-19T05:19:12.014631+0000","last_fullsized":"2024-09-19T05:19:12.014631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038794+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:19:12.038794+0000","last_peered":"2024-09-19T05:19:12.038794+0000","last_clean":"2024-09-19T05:19:12.038794+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:19:12.038794+0000","last_undegraded":"2024-09-19T05:19:12.038794+0000","last_fullsized":"2024-09-19T05:19:12.038794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038076+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:19:12.038076+0000","last_peered":"2024-09-19T05:19:12.038076+0000","last_clean":"2024-09-19T05:19:12.038076+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:19:12.038076+0000","last_undegraded":"2024-09-19T05:19:12.038076+0000","last_fullsized":"2024-09-19T05:19:12.038076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014440+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:19:12.014440+0000","last_peered":"2024-09-19T05:19:12.014440+0000","last_clean":"2024-09-19T05:19:12.014440+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:19:12.014440+0000","last_undegraded":"2024-09-19T05:19:12.014440+0000","last_fullsized":"2024-09-19T05:19:12.014440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039875+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:19:12.039875+0000","last_peered":"2024-09-19T05:19:12.039875+0000","last_clean":"2024-09-19T05:19:12.039875+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:19:12.039875+0000","last_undegraded":"2024-09-19T05:19:12.039875+0000","last_fullsized":"2024-09-19T05:19:12.039875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014034+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:19:12.014034+0000","last_peered":"2024-09-19T05:19:12.014034+0000","last_clean":"2024-09-19T05:19:12.014034+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:19:12.014034+0000","last_undegraded":"2024-09-19T05:19:12.014034+0000","last_fullsized":"2024-09-19T05:19:12.014034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014688+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:19:12.014688+0000","last_peered":"2024-09-19T05:19:12.014688+0000","last_clean":"2024-09-19T05:19:12.014688+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:19:12.014688+0000","last_undegraded":"2024-09-19T05:19:12.014688+0000","last_fullsized":"2024-09-19T05:19:12.014688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038834+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:19:12.038834+0000","last_peered":"2024-09-19T05:19:12.038834+0000","last_clean":"2024-09-19T05:19:12.038834+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:19:12.038834+0000","last_undegraded":"2024-09-19T05:19:12.038834+0000","last_fullsized":"2024-09-19T05:19:12.038834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038047+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:19:12.038047+0000","last_peered":"2024-09-19T05:19:12.038047+0000","last_clean":"2024-09-19T05:19:12.038047+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:19:12.038047+0000","last_undegraded":"2024-09-19T05:19:12.038047+0000","last_fullsized":"2024-09-19T05:19:12.038047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039607+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:19:12.039607+0000","last_peered":"2024-09-19T05:19:12.039607+0000","last_clean":"2024-09-19T05:19:12.039607+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:19:12.039607+0000","last_undegraded":"2024-09-19T05:19:12.039607+0000","last_fullsized":"2024-09-19T05:19:12.039607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015120+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:19:12.015120+0000","last_peered":"2024-09-19T05:19:12.015120+0000","last_clean":"2024-09-19T05:19:12.015120+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:19:12.015120+0000","last_undegraded":"2024-09-19T05:19:12.015120+0000","last_fullsized":"2024-09-19T05:19:12.015120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038383+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:19:12.038383+0000","last_peered":"2024-09-19T05:19:12.038383+0000","last_clean":"2024-09-19T05:19:12.038383+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:19:12.038383+0000","last_undegraded":"2024-09-19T05:19:12.038383+0000","last_fullsized":"2024-09-19T05:19:12.038383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039772+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:19:12.039772+0000","last_peered":"2024-09-19T05:19:12.039772+0000","last_clean":"2024-09-19T05:19:12.039772+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:19:12.039772+0000","last_undegraded":"2024-09-19T05:19:12.039772+0000","last_fullsized":"2024-09-19T05:19:12.039772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014379+0000","last_change":"2024-09-19T05:18:59.742846+0000","last_active":"2024-09-19T05:19:12.014379+0000","last_peered":"2024-09-19T05:19:12.014379+0000","last_clean":"2024-09-19T05:19:12.014379+0000","last_became_active":"2024-09-19T05:18:59.742334+0000","last_became_peered":"2024-09-19T05:18:59.742334+0000","last_unstale":"2024-09-19T05:19:12.014379+0000","last_undegraded":"2024-09-19T05:19:12.014379+0000","last_fullsized":"2024-09-19T05:19:12.014379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:55.434122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038729+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:19:12.038729+0000","last_peered":"2024-09-19T05:19:12.038729+0000","last_clean":"2024-09-19T05:19:12.038729+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:19:12.038729+0000","last_undegraded":"2024-09-19T05:19:12.038729+0000","last_fullsized":"2024-09-19T05:19:12.038729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013877+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:19:12.013877+0000","last_peered":"2024-09-19T05:19:12.013877+0000","last_clean":"2024-09-19T05:19:12.013877+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:19:12.013877+0000","last_undegraded":"2024-09-19T05:19:12.013877+0000","last_fullsized":"2024-09-19T05:19:12.013877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039795+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:19:12.039795+0000","last_peered":"2024-09-19T05:19:12.039795+0000","last_clean":"2024-09-19T05:19:12.039795+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:19:12.039795+0000","last_undegraded":"2024-09-19T05:19:12.039795+0000","last_fullsized":"2024-09-19T05:19:12.039795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039930+0000","last_change":"2024-09-19T05:19:09.024259+0000","last_active":"2024-09-19T05:19:12.039930+0000","last_peered":"2024-09-19T05:19:12.039930+0000","last_clean":"2024-09-19T05:19:12.039930+0000","last_became_active":"2024-09-19T05:19:09.023865+0000","last_became_peered":"2024-09-19T05:19:09.023865+0000","last_unstale":"2024-09-19T05:19:12.039930+0000","last_undegraded":"2024-09-19T05:19:12.039930+0000","last_fullsized":"2024-09-19T05:19:12.039930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:56.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014233+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:19:12.014233+0000","last_peered":"2024-09-19T05:19:12.014233+0000","last_clean":"2024-09-19T05:19:12.014233+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:19:12.014233+0000","last_undegraded":"2024-09-19T05:19:12.014233+0000","last_fullsized":"2024-09-19T05:19:12.014233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039291+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:19:12.039291+0000","last_peered":"2024-09-19T05:19:12.039291+0000","last_clean":"2024-09-19T05:19:12.039291+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:19:12.039291+0000","last_undegraded":"2024-09-19T05:19:12.039291+0000","last_fullsized":"2024-09-19T05:19:12.039291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039016+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:19:12.039016+0000","last_peered":"2024-09-19T05:19:12.039016+0000","last_clean":"2024-09-19T05:19:12.039016+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:19:12.039016+0000","last_undegraded":"2024-09-19T05:19:12.039016+0000","last_fullsized":"2024-09-19T05:19:12.039016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038273+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:19:12.038273+0000","last_peered":"2024-09-19T05:19:12.038273+0000","last_clean":"2024-09-19T05:19:12.038273+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:19:12.038273+0000","last_undegraded":"2024-09-19T05:19:12.038273+0000","last_fullsized":"2024-09-19T05:19:12.038273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038560+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:19:12.038560+0000","last_peered":"2024-09-19T05:19:12.038560+0000","last_clean":"2024-09-19T05:19:12.038560+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:19:12.038560+0000","last_undegraded":"2024-09-19T05:19:12.038560+0000","last_fullsized":"2024-09-19T05:19:12.038560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039499+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:19:12.039499+0000","last_peered":"2024-09-19T05:19:12.039499+0000","last_clean":"2024-09-19T05:19:12.039499+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:19:12.039499+0000","last_undegraded":"2024-09-19T05:19:12.039499+0000","last_fullsized":"2024-09-19T05:19:12.039499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015027+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:19:12.015027+0000","last_peered":"2024-09-19T05:19:12.015027+0000","last_clean":"2024-09-19T05:19:12.015027+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:19:12.015027+0000","last_undegraded":"2024-09-19T05:19:12.015027+0000","last_fullsized":"2024-09-19T05:19:12.015027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'23","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:57.155720+0000","last_change":"2024-09-19T05:18:59.697949+0000","last_active":"2024-09-19T05:19:57.155720+0000","last_peered":"2024-09-19T05:19:57.155720+0000","last_clean":"2024-09-19T05:19:57.155720+0000","last_became_active":"2024-09-19T05:18:59.697556+0000","last_became_peered":"2024-09-19T05:18:59.697556+0000","last_unstale":"2024-09-19T05:19:57.155720+0000","last_undegraded":"2024-09-19T05:19:57.155720+0000","last_fullsized":"2024-09-19T05:19:57.155720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.995278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":58,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039502+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:19:12.039502+0000","last_peered":"2024-09-19T05:19:12.039502+0000","last_clean":"2024-09-19T05:19:12.039502+0000","last_became_active":"2024-09-19T05:19:09.016554+0000","last_became_peered":"2024-09-19T05:19:09.016554+0000","last_unstale":"2024-09-19T05:19:12.039502+0000","last_undegraded":"2024-09-19T05:19:12.039502+0000","last_fullsized":"2024-09-19T05:19:12.039502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:57.423061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038314+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:19:12.038314+0000","last_peered":"2024-09-19T05:19:12.038314+0000","last_clean":"2024-09-19T05:19:12.038314+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:19:12.038314+0000","last_undegraded":"2024-09-19T05:19:12.038314+0000","last_fullsized":"2024-09-19T05:19:12.038314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039816+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:19:12.039816+0000","last_peered":"2024-09-19T05:19:12.039816+0000","last_clean":"2024-09-19T05:19:12.039816+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:19:12.039816+0000","last_undegraded":"2024-09-19T05:19:12.039816+0000","last_fullsized":"2024-09-19T05:19:12.039816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039695+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:19:12.039695+0000","last_peered":"2024-09-19T05:19:12.039695+0000","last_clean":"2024-09-19T05:19:12.039695+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:19:12.039695+0000","last_undegraded":"2024-09-19T05:19:12.039695+0000","last_fullsized":"2024-09-19T05:19:12.039695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014030+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:19:12.014030+0000","last_peered":"2024-09-19T05:19:12.014030+0000","last_clean":"2024-09-19T05:19:12.014030+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:19:12.014030+0000","last_undegraded":"2024-09-19T05:19:12.014030+0000","last_fullsized":"2024-09-19T05:19:12.014030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014518+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:19:12.014518+0000","last_peered":"2024-09-19T05:19:12.014518+0000","last_clean":"2024-09-19T05:19:12.014518+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:19:12.014518+0000","last_undegraded":"2024-09-19T05:19:12.014518+0000","last_fullsized":"2024-09-19T05:19:12.014518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039300+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:19:12.039300+0000","last_peered":"2024-09-19T05:19:12.039300+0000","last_clean":"2024-09-19T05:19:12.039300+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:19:12.039300+0000","last_undegraded":"2024-09-19T05:19:12.039300+0000","last_fullsized":"2024-09-19T05:19:12.039300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038831+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:19:12.038831+0000","last_peered":"2024-09-19T05:19:12.038831+0000","last_clean":"2024-09-19T05:19:12.038831+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:19:12.038831+0000","last_undegraded":"2024-09-19T05:19:12.038831+0000","last_fullsized":"2024-09-19T05:19:12.038831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039566+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:19:12.039566+0000","last_peered":"2024-09-19T05:19:12.039566+0000","last_clean":"2024-09-19T05:19:12.039566+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:19:12.039566+0000","last_undegraded":"2024-09-19T05:19:12.039566+0000","last_fullsized":"2024-09-19T05:19:12.039566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038585+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:19:12.038585+0000","last_peered":"2024-09-19T05:19:12.038585+0000","last_clean":"2024-09-19T05:19:12.038585+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:19:12.038585+0000","last_undegraded":"2024-09-19T05:19:12.038585+0000","last_fullsized":"2024-09-19T05:19:12.038585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013727+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:19:12.013727+0000","last_peered":"2024-09-19T05:19:12.013727+0000","last_clean":"2024-09-19T05:19:12.013727+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:19:12.013727+0000","last_undegraded":"2024-09-19T05:19:12.013727+0000","last_fullsized":"2024-09-19T05:19:12.013727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039349+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:19:12.039349+0000","last_peered":"2024-09-19T05:19:12.039349+0000","last_clean":"2024-09-19T05:19:12.039349+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:19:12.039349+0000","last_undegraded":"2024-09-19T05:19:12.039349+0000","last_fullsized":"2024-09-19T05:19:12.039349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039013+0000","last_change":"2024-09-19T05:18:59.690280+0000","last_active":"2024-09-19T05:19:12.039013+0000","last_peered":"2024-09-19T05:19:12.039013+0000","last_clean":"2024-09-19T05:19:12.039013+0000","last_became_active":"2024-09-19T05:18:59.689990+0000","last_became_peered":"2024-09-19T05:18:59.689990+0000","last_unstale":"2024-09-19T05:19:12.039013+0000","last_undegraded":"2024-09-19T05:19:12.039013+0000","last_fullsized":"2024-09-19T05:19:12.039013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:24.937837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038357+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:19:12.038357+0000","last_peered":"2024-09-19T05:19:12.038357+0000","last_clean":"2024-09-19T05:19:12.038357+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:19:12.038357+0000","last_undegraded":"2024-09-19T05:19:12.038357+0000","last_fullsized":"2024-09-19T05:19:12.038357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037691+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:19:12.037691+0000","last_peered":"2024-09-19T05:19:12.037691+0000","last_clean":"2024-09-19T05:19:12.037691+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:19:12.037691+0000","last_undegraded":"2024-09-19T05:19:12.037691+0000","last_fullsized":"2024-09-19T05:19:12.037691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037903+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:19:12.037903+0000","last_peered":"2024-09-19T05:19:12.037903+0000","last_clean":"2024-09-19T05:19:12.037903+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:19:12.037903+0000","last_undegraded":"2024-09-19T05:19:12.037903+0000","last_fullsized":"2024-09-19T05:19:12.037903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038825+0000","last_change":"2024-09-19T05:18:59.691950+0000","last_active":"2024-09-19T05:19:12.038825+0000","last_peered":"2024-09-19T05:19:12.038825+0000","last_clean":"2024-09-19T05:19:12.038825+0000","last_became_active":"2024-09-19T05:18:59.691551+0000","last_became_peered":"2024-09-19T05:18:59.691551+0000","last_unstale":"2024-09-19T05:19:12.038825+0000","last_undegraded":"2024-09-19T05:19:12.038825+0000","last_fullsized":"2024-09-19T05:19:12.038825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:56.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039211+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:19:12.039211+0000","last_peered":"2024-09-19T05:19:12.039211+0000","last_clean":"2024-09-19T05:19:12.039211+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:19:12.039211+0000","last_undegraded":"2024-09-19T05:19:12.039211+0000","last_fullsized":"2024-09-19T05:19:12.039211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038507+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:19:12.038507+0000","last_peered":"2024-09-19T05:19:12.038507+0000","last_clean":"2024-09-19T05:19:12.038507+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:19:12.038507+0000","last_undegraded":"2024-09-19T05:19:12.038507+0000","last_fullsized":"2024-09-19T05:19:12.038507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039307+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:19:12.039307+0000","last_peered":"2024-09-19T05:19:12.039307+0000","last_clean":"2024-09-19T05:19:12.039307+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:19:12.039307+0000","last_undegraded":"2024-09-19T05:19:12.039307+0000","last_fullsized":"2024-09-19T05:19:12.039307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014440+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:19:12.014440+0000","last_peered":"2024-09-19T05:19:12.014440+0000","last_clean":"2024-09-19T05:19:12.014440+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:19:12.014440+0000","last_undegraded":"2024-09-19T05:19:12.014440+0000","last_fullsized":"2024-09-19T05:19:12.014440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038566+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:19:12.038566+0000","last_peered":"2024-09-19T05:19:12.038566+0000","last_clean":"2024-09-19T05:19:12.038566+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:19:12.038566+0000","last_undegraded":"2024-09-19T05:19:12.038566+0000","last_fullsized":"2024-09-19T05:19:12.038566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038311+0000","last_change":"2024-09-19T05:19:01.943020+0000","last_active":"2024-09-19T05:19:12.038311+0000","last_peered":"2024-09-19T05:19:12.038311+0000","last_clean":"2024-09-19T05:19:12.038311+0000","last_became_active":"2024-09-19T05:19:01.942697+0000","last_became_peered":"2024-09-19T05:19:01.942697+0000","last_unstale":"2024-09-19T05:19:12.038311+0000","last_undegraded":"2024-09-19T05:19:12.038311+0000","last_fullsized":"2024-09-19T05:19:12.038311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:37.172627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038472+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:19:12.038472+0000","last_peered":"2024-09-19T05:19:12.038472+0000","last_clean":"2024-09-19T05:19:12.038472+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:19:12.038472+0000","last_undegraded":"2024-09-19T05:19:12.038472+0000","last_fullsized":"2024-09-19T05:19:12.038472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038124+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:19:12.038124+0000","last_peered":"2024-09-19T05:19:12.038124+0000","last_clean":"2024-09-19T05:19:12.038124+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:19:12.038124+0000","last_undegraded":"2024-09-19T05:19:12.038124+0000","last_fullsized":"2024-09-19T05:19:12.038124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013990+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:19:12.013990+0000","last_peered":"2024-09-19T05:19:12.013990+0000","last_clean":"2024-09-19T05:19:12.013990+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:19:12.013990+0000","last_undegraded":"2024-09-19T05:19:12.013990+0000","last_fullsized":"2024-09-19T05:19:12.013990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038410+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:19:12.038410+0000","last_peered":"2024-09-19T05:19:12.038410+0000","last_clean":"2024-09-19T05:19:12.038410+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:19:12.038410+0000","last_undegraded":"2024-09-19T05:19:12.038410+0000","last_fullsized":"2024-09-19T05:19:12.038410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039533+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:19:12.039533+0000","last_peered":"2024-09-19T05:19:12.039533+0000","last_clean":"2024-09-19T05:19:12.039533+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:19:12.039533+0000","last_undegraded":"2024-09-19T05:19:12.039533+0000","last_fullsized":"2024-09-19T05:19:12.039533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038693+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:19:12.038693+0000","last_peered":"2024-09-19T05:19:12.038693+0000","last_clean":"2024-09-19T05:19:12.038693+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:19:12.038693+0000","last_undegraded":"2024-09-19T05:19:12.038693+0000","last_fullsized":"2024-09-19T05:19:12.038693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037967+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:19:12.037967+0000","last_peered":"2024-09-19T05:19:12.037967+0000","last_clean":"2024-09-19T05:19:12.037967+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:19:12.037967+0000","last_undegraded":"2024-09-19T05:19:12.037967+0000","last_fullsized":"2024-09-19T05:19:12.037967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038875+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:19:12.038875+0000","last_peered":"2024-09-19T05:19:12.038875+0000","last_clean":"2024-09-19T05:19:12.038875+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:19:12.038875+0000","last_undegraded":"2024-09-19T05:19:12.038875+0000","last_fullsized":"2024-09-19T05:19:12.038875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038591+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:19:12.038591+0000","last_peered":"2024-09-19T05:19:12.038591+0000","last_clean":"2024-09-19T05:19:12.038591+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:19:12.038591+0000","last_undegraded":"2024-09-19T05:19:12.038591+0000","last_fullsized":"2024-09-19T05:19:12.038591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038327+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:19:12.038327+0000","last_peered":"2024-09-19T05:19:12.038327+0000","last_clean":"2024-09-19T05:19:12.038327+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:19:12.038327+0000","last_undegraded":"2024-09-19T05:19:12.038327+0000","last_fullsized":"2024-09-19T05:19:12.038327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038149+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:19:12.038149+0000","last_peered":"2024-09-19T05:19:12.038149+0000","last_clean":"2024-09-19T05:19:12.038149+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:19:12.038149+0000","last_undegraded":"2024-09-19T05:19:12.038149+0000","last_fullsized":"2024-09-19T05:19:12.038149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039073+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:19:12.039073+0000","last_peered":"2024-09-19T05:19:12.039073+0000","last_clean":"2024-09-19T05:19:12.039073+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:19:12.039073+0000","last_undegraded":"2024-09-19T05:19:12.039073+0000","last_fullsized":"2024-09-19T05:19:12.039073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039270+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:19:12.039270+0000","last_peered":"2024-09-19T05:19:12.039270+0000","last_clean":"2024-09-19T05:19:12.039270+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:19:12.039270+0000","last_undegraded":"2024-09-19T05:19:12.039270+0000","last_fullsized":"2024-09-19T05:19:12.039270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040203+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:19:12.040203+0000","last_peered":"2024-09-19T05:19:12.040203+0000","last_clean":"2024-09-19T05:19:12.040203+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:19:12.040203+0000","last_undegraded":"2024-09-19T05:19:12.040203+0000","last_fullsized":"2024-09-19T05:19:12.040203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040030+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:19:12.040030+0000","last_peered":"2024-09-19T05:19:12.040030+0000","last_clean":"2024-09-19T05:19:12.040030+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:19:12.040030+0000","last_undegraded":"2024-09-19T05:19:12.040030+0000","last_fullsized":"2024-09-19T05:19:12.040030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037788+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:19:12.037788+0000","last_peered":"2024-09-19T05:19:12.037788+0000","last_clean":"2024-09-19T05:19:12.037788+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:19:12.037788+0000","last_undegraded":"2024-09-19T05:19:12.037788+0000","last_fullsized":"2024-09-19T05:19:12.037788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013597+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:19:12.013597+0000","last_peered":"2024-09-19T05:19:12.013597+0000","last_clean":"2024-09-19T05:19:12.013597+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:19:12.013597+0000","last_undegraded":"2024-09-19T05:19:12.013597+0000","last_fullsized":"2024-09-19T05:19:12.013597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013541+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:19:12.013541+0000","last_peered":"2024-09-19T05:19:12.013541+0000","last_clean":"2024-09-19T05:19:12.013541+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:19:12.013541+0000","last_undegraded":"2024-09-19T05:19:12.013541+0000","last_fullsized":"2024-09-19T05:19:12.013541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038056+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:19:12.038056+0000","last_peered":"2024-09-19T05:19:12.038056+0000","last_clean":"2024-09-19T05:19:12.038056+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:19:12.038056+0000","last_undegraded":"2024-09-19T05:19:12.038056+0000","last_fullsized":"2024-09-19T05:19:12.038056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039621+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:19:12.039621+0000","last_peered":"2024-09-19T05:19:12.039621+0000","last_clean":"2024-09-19T05:19:12.039621+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:19:12.039621+0000","last_undegraded":"2024-09-19T05:19:12.039621+0000","last_fullsized":"2024-09-19T05:19:12.039621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014590+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:19:12.014590+0000","last_peered":"2024-09-19T05:19:12.014590+0000","last_clean":"2024-09-19T05:19:12.014590+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:19:12.014590+0000","last_undegraded":"2024-09-19T05:19:12.014590+0000","last_fullsized":"2024-09-19T05:19:12.014590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039831+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:19:12.039831+0000","last_peered":"2024-09-19T05:19:12.039831+0000","last_clean":"2024-09-19T05:19:12.039831+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:19:12.039831+0000","last_undegraded":"2024-09-19T05:19:12.039831+0000","last_fullsized":"2024-09-19T05:19:12.039831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038898+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:19:12.038898+0000","last_peered":"2024-09-19T05:19:12.038898+0000","last_clean":"2024-09-19T05:19:12.038898+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:19:12.038898+0000","last_undegraded":"2024-09-19T05:19:12.038898+0000","last_fullsized":"2024-09-19T05:19:12.038898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037679+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:19:12.037679+0000","last_peered":"2024-09-19T05:19:12.037679+0000","last_clean":"2024-09-19T05:19:12.037679+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:19:12.037679+0000","last_undegraded":"2024-09-19T05:19:12.037679+0000","last_fullsized":"2024-09-19T05:19:12.037679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013942+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:19:12.013942+0000","last_peered":"2024-09-19T05:19:12.013942+0000","last_clean":"2024-09-19T05:19:12.013942+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:19:12.013942+0000","last_undegraded":"2024-09-19T05:19:12.013942+0000","last_fullsized":"2024-09-19T05:19:12.013942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038734+0000","last_change":"2024-09-19T05:19:01.943934+0000","last_active":"2024-09-19T05:19:12.038734+0000","last_peered":"2024-09-19T05:19:12.038734+0000","last_clean":"2024-09-19T05:19:12.038734+0000","last_became_active":"2024-09-19T05:19:01.943200+0000","last_became_peered":"2024-09-19T05:19:01.943200+0000","last_unstale":"2024-09-19T05:19:12.038734+0000","last_undegraded":"2024-09-19T05:19:12.038734+0000","last_fullsized":"2024-09-19T05:19:12.038734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:00.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014346+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:19:12.014346+0000","last_peered":"2024-09-19T05:19:12.014346+0000","last_clean":"2024-09-19T05:19:12.014346+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:19:12.014346+0000","last_undegraded":"2024-09-19T05:19:12.014346+0000","last_fullsized":"2024-09-19T05:19:12.014346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039548+0000","last_change":"2024-09-19T05:19:01.948368+0000","last_active":"2024-09-19T05:19:12.039548+0000","last_peered":"2024-09-19T05:19:12.039548+0000","last_clean":"2024-09-19T05:19:12.039548+0000","last_became_active":"2024-09-19T05:19:01.947922+0000","last_became_peered":"2024-09-19T05:19:01.947922+0000","last_unstale":"2024-09-19T05:19:12.039548+0000","last_undegraded":"2024-09-19T05:19:12.039548+0000","last_fullsized":"2024-09-19T05:19:12.039548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:02.666651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013542+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:19:12.013542+0000","last_peered":"2024-09-19T05:19:12.013542+0000","last_clean":"2024-09-19T05:19:12.013542+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:19:12.013542+0000","last_undegraded":"2024-09-19T05:19:12.013542+0000","last_fullsized":"2024-09-19T05:19:12.013542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013664+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:19:12.013664+0000","last_peered":"2024-09-19T05:19:12.013664+0000","last_clean":"2024-09-19T05:19:12.013664+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:19:12.013664+0000","last_undegraded":"2024-09-19T05:19:12.013664+0000","last_fullsized":"2024-09-19T05:19:12.013664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039999+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:19:12.039999+0000","last_peered":"2024-09-19T05:19:12.039999+0000","last_clean":"2024-09-19T05:19:12.039999+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:19:12.039999+0000","last_undegraded":"2024-09-19T05:19:12.039999+0000","last_fullsized":"2024-09-19T05:19:12.039999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44143,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":64,"num_write":72,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":132429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547224,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":477377,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":1107188,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906978,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":482055,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135910,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":477981,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1072423,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528369,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":473281,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1067927,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477399,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182462,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":473385,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":516660,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":516626,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":473371,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":43539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:20:02.262 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:20:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:02.958 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:02 smithi001 ceph-mon[30968]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:03.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:02 smithi060 ceph-mon[35058]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:03.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:02 smithi082 ceph-mon[35195]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- 172.21.15.1:0/3231626988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0100e20 msgr2=0x7f75e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 --2- 172.21.15.1:0/3231626988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0100e20 0x7f75e0101200 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009900 tx=0x7f75d002a480 comp rx=0 tx=0).stop 2024-09-19T05:20:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- 172.21.15.1:0/3231626988 shutdown_connections 2024-09-19T05:20:03.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 --2- 172.21.15.1:0/3231626988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 --2- 172.21.15.1:0/3231626988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0102570 0x7f75e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 --2- 172.21.15.1:0/3231626988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0100e20 0x7f75e0101200 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- 172.21.15.1:0/3231626988 >> 172.21.15.1:0/3231626988 conn(0x7f75e00fc7d0 msgr2=0x7f75e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- 172.21.15.1:0/3231626988 shutdown_connections 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- 172.21.15.1:0/3231626988 wait complete. 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 Processor -- start 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.038+0000 7f75e6926640 1 -- start start 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0100e20 0x7f75e0103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e01041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0110f80 con 0x7f75e0102570 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0110e00 con 0x7f75e0100e20 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e6926640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0111100 con 0x7f75e0102ef0 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51572/0 (socket says 172.21.15.1:51572) 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 -- 172.21.15.1:0/2513084663 learned_addr learned my addr 172.21.15.1:0/2513084663 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75dffff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0100e20 0x7f75e0103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e4ec3640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e01041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 -- 172.21.15.1:0/2513084663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 msgr2=0x7f75e01041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e01041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 -- 172.21.15.1:0/2513084663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0100e20 msgr2=0x7f75e0103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0100e20 0x7f75e0103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 -- 172.21.15.1:0/2513084663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e01a6980 con 0x7f75e0102570 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75e4ec3640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75d7fff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75c800d950 tx=0x7f75c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.039+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8017070 con 0x7f75e0102570 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.040+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75c8009c30 con 0x7f75e0102570 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.040+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e01a6c70 con 0x7f75e0102570 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.040+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c800f6b0 con 0x7f75e0102570 2024-09-19T05:20:03.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.040+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e01a71b0 con 0x7f75e0102570 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.041+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e0101200 con 0x7f75e0102570 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.042+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f75c80109d0 con 0x7f75e0102570 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.043+0000 7f75ddffb640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 0x7f75cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.043+0000 7f75dffff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 0x7f75cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.043+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f75c80cf950 con 0x7f75e0102570 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.043+0000 7f75dffff640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 0x7f75cc0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009230 tx=0x7f75d00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.046+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75c8009de0 con 0x7f75e0102570 2024-09-19T05:20:03.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.219+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75e01068a0 con 0x7f75cc0a32d0 2024-09-19T05:20:03.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.229+0000 7f75ddffb640 1 -- 172.21.15.1:0/2513084663 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340514 (secure 0 0 0) 0x7f75e01068a0 con 0x7f75cc0a32d0 2024-09-19T05:20:03.234 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:03.235 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:20:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 msgr2=0x7f75cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 0x7f75cc0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009230 tx=0x7f75d00058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 msgr2=0x7f75e0103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f75c800d950 tx=0x7f75c800de10 comp rx=0 tx=0).stop 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 shutdown_connections 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75cc0a32d0 0x7f75cc0a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75e0102ef0 0x7f75e01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75e0102570 0x7f75e0103c90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 --2- 172.21.15.1:0/2513084663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75e0100e20 0x7f75e0103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 >> 172.21.15.1:0/2513084663 conn(0x7f75e00fc7d0 msgr2=0x7f75e006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 shutdown_connections 2024-09-19T05:20:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:03.232+0000 7f75e6926640 1 -- 172.21.15.1:0/2513084663 wait complete. 2024-09-19T05:20:03.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:03 smithi001 ceph-mon[30968]: pgmap v313: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:03 smithi060 ceph-mon[35058]: pgmap v313: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:03 smithi082 ceph-mon[35195]: pgmap v313: 129 pgs: 129 active+clean; 620 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-19T05:20:04.012 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-19T05:20:01.843965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634745,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":164,"num_read_kb":173,"num_write":255,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381516,"kb_used_data":11456,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560308,"statfs":{"total":1151940427776,"available":1151549755392,"internally_reserved":0,"allocated":11730944,"data_stored":7640937,"data_compressed":318396,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39735,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":54,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003194"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040079+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:19:12.040079+0000","last_peered":"2024-09-19T05:19:12.040079+0000","last_clean":"2024-09-19T05:19:12.040079+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:19:12.040079+0000","last_undegraded":"2024-09-19T05:19:12.040079+0000","last_fullsized":"2024-09-19T05:19:12.040079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037874+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:19:12.037874+0000","last_peered":"2024-09-19T05:19:12.037874+0000","last_clean":"2024-09-19T05:19:12.037874+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:19:12.037874+0000","last_undegraded":"2024-09-19T05:19:12.037874+0000","last_fullsized":"2024-09-19T05:19:12.037874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038041+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:19:12.038041+0000","last_peered":"2024-09-19T05:19:12.038041+0000","last_clean":"2024-09-19T05:19:12.038041+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:19:12.038041+0000","last_undegraded":"2024-09-19T05:19:12.038041+0000","last_fullsized":"2024-09-19T05:19:12.038041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038179+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:19:12.038179+0000","last_peered":"2024-09-19T05:19:12.038179+0000","last_clean":"2024-09-19T05:19:12.038179+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:19:12.038179+0000","last_undegraded":"2024-09-19T05:19:12.038179+0000","last_fullsized":"2024-09-19T05:19:12.038179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013961+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:19:12.013961+0000","last_peered":"2024-09-19T05:19:12.013961+0000","last_clean":"2024-09-19T05:19:12.013961+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:19:12.013961+0000","last_undegraded":"2024-09-19T05:19:12.013961+0000","last_fullsized":"2024-09-19T05:19:12.013961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038491+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:19:12.038491+0000","last_peered":"2024-09-19T05:19:12.038491+0000","last_clean":"2024-09-19T05:19:12.038491+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:19:12.038491+0000","last_undegraded":"2024-09-19T05:19:12.038491+0000","last_fullsized":"2024-09-19T05:19:12.038491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015089+0000","last_change":"2024-09-19T05:18:59.696877+0000","last_active":"2024-09-19T05:19:12.015089+0000","last_peered":"2024-09-19T05:19:12.015089+0000","last_clean":"2024-09-19T05:19:12.015089+0000","last_became_active":"2024-09-19T05:18:59.696501+0000","last_became_peered":"2024-09-19T05:18:59.696501+0000","last_unstale":"2024-09-19T05:19:12.015089+0000","last_undegraded":"2024-09-19T05:19:12.015089+0000","last_fullsized":"2024-09-19T05:19:12.015089+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:14.716762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038197+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:19:12.038197+0000","last_peered":"2024-09-19T05:19:12.038197+0000","last_clean":"2024-09-19T05:19:12.038197+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:19:12.038197+0000","last_undegraded":"2024-09-19T05:19:12.038197+0000","last_fullsized":"2024-09-19T05:19:12.038197+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039405+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:19:12.039405+0000","last_peered":"2024-09-19T05:19:12.039405+0000","last_clean":"2024-09-19T05:19:12.039405+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:19:12.039405+0000","last_undegraded":"2024-09-19T05:19:12.039405+0000","last_fullsized":"2024-09-19T05:19:12.039405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014838+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:19:12.014838+0000","last_peered":"2024-09-19T05:19:12.014838+0000","last_clean":"2024-09-19T05:19:12.014838+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:19:12.014838+0000","last_undegraded":"2024-09-19T05:19:12.014838+0000","last_fullsized":"2024-09-19T05:19:12.014838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039607+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:19:12.039607+0000","last_peered":"2024-09-19T05:19:12.039607+0000","last_clean":"2024-09-19T05:19:12.039607+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:19:12.039607+0000","last_undegraded":"2024-09-19T05:19:12.039607+0000","last_fullsized":"2024-09-19T05:19:12.039607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038922+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:19:12.038922+0000","last_peered":"2024-09-19T05:19:12.038922+0000","last_clean":"2024-09-19T05:19:12.038922+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:19:12.038922+0000","last_undegraded":"2024-09-19T05:19:12.038922+0000","last_fullsized":"2024-09-19T05:19:12.038922+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014152+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:19:12.014152+0000","last_peered":"2024-09-19T05:19:12.014152+0000","last_clean":"2024-09-19T05:19:12.014152+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:19:12.014152+0000","last_undegraded":"2024-09-19T05:19:12.014152+0000","last_fullsized":"2024-09-19T05:19:12.014152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014466+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:19:12.014466+0000","last_peered":"2024-09-19T05:19:12.014466+0000","last_clean":"2024-09-19T05:19:12.014466+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:19:12.014466+0000","last_undegraded":"2024-09-19T05:19:12.014466+0000","last_fullsized":"2024-09-19T05:19:12.014466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039164+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:19:12.039164+0000","last_peered":"2024-09-19T05:19:12.039164+0000","last_clean":"2024-09-19T05:19:12.039164+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:19:12.039164+0000","last_undegraded":"2024-09-19T05:19:12.039164+0000","last_fullsized":"2024-09-19T05:19:12.039164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038743+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:19:12.038743+0000","last_peered":"2024-09-19T05:19:12.038743+0000","last_clean":"2024-09-19T05:19:12.038743+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:19:12.038743+0000","last_undegraded":"2024-09-19T05:19:12.038743+0000","last_fullsized":"2024-09-19T05:19:12.038743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038238+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:19:12.038238+0000","last_peered":"2024-09-19T05:19:12.038238+0000","last_clean":"2024-09-19T05:19:12.038238+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:19:12.038238+0000","last_undegraded":"2024-09-19T05:19:12.038238+0000","last_fullsized":"2024-09-19T05:19:12.038238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039412+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:19:12.039412+0000","last_peered":"2024-09-19T05:19:12.039412+0000","last_clean":"2024-09-19T05:19:12.039412+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:19:12.039412+0000","last_undegraded":"2024-09-19T05:19:12.039412+0000","last_fullsized":"2024-09-19T05:19:12.039412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038419+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:19:12.038419+0000","last_peered":"2024-09-19T05:19:12.038419+0000","last_clean":"2024-09-19T05:19:12.038419+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:19:12.038419+0000","last_undegraded":"2024-09-19T05:19:12.038419+0000","last_fullsized":"2024-09-19T05:19:12.038419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038774+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:19:12.038774+0000","last_peered":"2024-09-19T05:19:12.038774+0000","last_clean":"2024-09-19T05:19:12.038774+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:19:12.038774+0000","last_undegraded":"2024-09-19T05:19:12.038774+0000","last_fullsized":"2024-09-19T05:19:12.038774+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039841+0000","last_change":"2024-09-19T05:19:09.016342+0000","last_active":"2024-09-19T05:19:12.039841+0000","last_peered":"2024-09-19T05:19:12.039841+0000","last_clean":"2024-09-19T05:19:12.039841+0000","last_became_active":"2024-09-19T05:19:09.015247+0000","last_became_peered":"2024-09-19T05:19:09.015247+0000","last_unstale":"2024-09-19T05:19:12.039841+0000","last_undegraded":"2024-09-19T05:19:12.039841+0000","last_fullsized":"2024-09-19T05:19:12.039841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:23.735913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014285+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:19:12.014285+0000","last_peered":"2024-09-19T05:19:12.014285+0000","last_clean":"2024-09-19T05:19:12.014285+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:19:12.014285+0000","last_undegraded":"2024-09-19T05:19:12.014285+0000","last_fullsized":"2024-09-19T05:19:12.014285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037944+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:19:12.037944+0000","last_peered":"2024-09-19T05:19:12.037944+0000","last_clean":"2024-09-19T05:19:12.037944+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:19:12.037944+0000","last_undegraded":"2024-09-19T05:19:12.037944+0000","last_fullsized":"2024-09-19T05:19:12.037944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038937+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:19:12.038937+0000","last_peered":"2024-09-19T05:19:12.038937+0000","last_clean":"2024-09-19T05:19:12.038937+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:19:12.038937+0000","last_undegraded":"2024-09-19T05:19:12.038937+0000","last_fullsized":"2024-09-19T05:19:12.038937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013795+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:19:12.013795+0000","last_peered":"2024-09-19T05:19:12.013795+0000","last_clean":"2024-09-19T05:19:12.013795+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:19:12.013795+0000","last_undegraded":"2024-09-19T05:19:12.013795+0000","last_fullsized":"2024-09-19T05:19:12.013795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040085+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:19:12.040085+0000","last_peered":"2024-09-19T05:19:12.040085+0000","last_clean":"2024-09-19T05:19:12.040085+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:19:12.040085+0000","last_undegraded":"2024-09-19T05:19:12.040085+0000","last_fullsized":"2024-09-19T05:19:12.040085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038277+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:19:12.038277+0000","last_peered":"2024-09-19T05:19:12.038277+0000","last_clean":"2024-09-19T05:19:12.038277+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:19:12.038277+0000","last_undegraded":"2024-09-19T05:19:12.038277+0000","last_fullsized":"2024-09-19T05:19:12.038277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038052+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:19:12.038052+0000","last_peered":"2024-09-19T05:19:12.038052+0000","last_clean":"2024-09-19T05:19:12.038052+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:19:12.038052+0000","last_undegraded":"2024-09-19T05:19:12.038052+0000","last_fullsized":"2024-09-19T05:19:12.038052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:54.983007+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:19:54.983007+0000","last_peered":"2024-09-19T05:19:54.983007+0000","last_clean":"2024-09-19T05:19:54.983007+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:19:54.983007+0000","last_undegraded":"2024-09-19T05:19:54.983007+0000","last_fullsized":"2024-09-19T05:19:54.983007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037560+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:19:12.037560+0000","last_peered":"2024-09-19T05:19:12.037560+0000","last_clean":"2024-09-19T05:19:12.037560+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:19:12.037560+0000","last_undegraded":"2024-09-19T05:19:12.037560+0000","last_fullsized":"2024-09-19T05:19:12.037560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038482+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:19:12.038482+0000","last_peered":"2024-09-19T05:19:12.038482+0000","last_clean":"2024-09-19T05:19:12.038482+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:19:12.038482+0000","last_undegraded":"2024-09-19T05:19:12.038482+0000","last_fullsized":"2024-09-19T05:19:12.038482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015142+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:19:12.015142+0000","last_peered":"2024-09-19T05:19:12.015142+0000","last_clean":"2024-09-19T05:19:12.015142+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:19:12.015142+0000","last_undegraded":"2024-09-19T05:19:12.015142+0000","last_fullsized":"2024-09-19T05:19:12.015142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038820+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:19:12.038820+0000","last_peered":"2024-09-19T05:19:12.038820+0000","last_clean":"2024-09-19T05:19:12.038820+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:19:12.038820+0000","last_undegraded":"2024-09-19T05:19:12.038820+0000","last_fullsized":"2024-09-19T05:19:12.038820+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038990+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:19:12.038990+0000","last_peered":"2024-09-19T05:19:12.038990+0000","last_clean":"2024-09-19T05:19:12.038990+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:19:12.038990+0000","last_undegraded":"2024-09-19T05:19:12.038990+0000","last_fullsized":"2024-09-19T05:19:12.038990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039878+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:19:12.039878+0000","last_peered":"2024-09-19T05:19:12.039878+0000","last_clean":"2024-09-19T05:19:12.039878+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:19:12.039878+0000","last_undegraded":"2024-09-19T05:19:12.039878+0000","last_fullsized":"2024-09-19T05:19:12.039878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014496+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:19:12.014496+0000","last_peered":"2024-09-19T05:19:12.014496+0000","last_clean":"2024-09-19T05:19:12.014496+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:19:12.014496+0000","last_undegraded":"2024-09-19T05:19:12.014496+0000","last_fullsized":"2024-09-19T05:19:12.014496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038672+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:19:12.038672+0000","last_peered":"2024-09-19T05:19:12.038672+0000","last_clean":"2024-09-19T05:19:12.038672+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:19:12.038672+0000","last_undegraded":"2024-09-19T05:19:12.038672+0000","last_fullsized":"2024-09-19T05:19:12.038672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014251+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:19:12.014251+0000","last_peered":"2024-09-19T05:19:12.014251+0000","last_clean":"2024-09-19T05:19:12.014251+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:19:12.014251+0000","last_undegraded":"2024-09-19T05:19:12.014251+0000","last_fullsized":"2024-09-19T05:19:12.014251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038384+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:19:12.038384+0000","last_peered":"2024-09-19T05:19:12.038384+0000","last_clean":"2024-09-19T05:19:12.038384+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:19:12.038384+0000","last_undegraded":"2024-09-19T05:19:12.038384+0000","last_fullsized":"2024-09-19T05:19:12.038384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038921+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:19:12.038921+0000","last_peered":"2024-09-19T05:19:12.038921+0000","last_clean":"2024-09-19T05:19:12.038921+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:19:12.038921+0000","last_undegraded":"2024-09-19T05:19:12.038921+0000","last_fullsized":"2024-09-19T05:19:12.038921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038011+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:19:12.038011+0000","last_peered":"2024-09-19T05:19:12.038011+0000","last_clean":"2024-09-19T05:19:12.038011+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:19:12.038011+0000","last_undegraded":"2024-09-19T05:19:12.038011+0000","last_fullsized":"2024-09-19T05:19:12.038011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038897+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:19:12.038897+0000","last_peered":"2024-09-19T05:19:12.038897+0000","last_clean":"2024-09-19T05:19:12.038897+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:19:12.038897+0000","last_undegraded":"2024-09-19T05:19:12.038897+0000","last_fullsized":"2024-09-19T05:19:12.038897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037787+0000","last_change":"2024-09-19T05:19:01.942408+0000","last_active":"2024-09-19T05:19:12.037787+0000","last_peered":"2024-09-19T05:19:12.037787+0000","last_clean":"2024-09-19T05:19:12.037787+0000","last_became_active":"2024-09-19T05:19:01.942058+0000","last_became_peered":"2024-09-19T05:19:01.942058+0000","last_unstale":"2024-09-19T05:19:12.037787+0000","last_undegraded":"2024-09-19T05:19:12.037787+0000","last_fullsized":"2024-09-19T05:19:12.037787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:47.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013938+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:19:12.013938+0000","last_peered":"2024-09-19T05:19:12.013938+0000","last_clean":"2024-09-19T05:19:12.013938+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:19:12.013938+0000","last_undegraded":"2024-09-19T05:19:12.013938+0000","last_fullsized":"2024-09-19T05:19:12.013938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039416+0000","last_change":"2024-09-19T05:19:09.030753+0000","last_active":"2024-09-19T05:19:12.039416+0000","last_peered":"2024-09-19T05:19:12.039416+0000","last_clean":"2024-09-19T05:19:12.039416+0000","last_became_active":"2024-09-19T05:19:09.030379+0000","last_became_peered":"2024-09-19T05:19:09.030379+0000","last_unstale":"2024-09-19T05:19:12.039416+0000","last_undegraded":"2024-09-19T05:19:12.039416+0000","last_fullsized":"2024-09-19T05:19:12.039416+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:18:24.780185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038942+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:19:12.038942+0000","last_peered":"2024-09-19T05:19:12.038942+0000","last_clean":"2024-09-19T05:19:12.038942+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:19:12.038942+0000","last_undegraded":"2024-09-19T05:19:12.038942+0000","last_fullsized":"2024-09-19T05:19:12.038942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039716+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:19:12.039716+0000","last_peered":"2024-09-19T05:19:12.039716+0000","last_clean":"2024-09-19T05:19:12.039716+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:19:12.039716+0000","last_undegraded":"2024-09-19T05:19:12.039716+0000","last_fullsized":"2024-09-19T05:19:12.039716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":341,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014052+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:19:12.014052+0000","last_peered":"2024-09-19T05:19:12.014052+0000","last_clean":"2024-09-19T05:19:12.014052+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:19:12.014052+0000","last_undegraded":"2024-09-19T05:19:12.014052+0000","last_fullsized":"2024-09-19T05:19:12.014052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014573+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:19:12.014573+0000","last_peered":"2024-09-19T05:19:12.014573+0000","last_clean":"2024-09-19T05:19:12.014573+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:19:12.014573+0000","last_undegraded":"2024-09-19T05:19:12.014573+0000","last_fullsized":"2024-09-19T05:19:12.014573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014631+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:19:12.014631+0000","last_peered":"2024-09-19T05:19:12.014631+0000","last_clean":"2024-09-19T05:19:12.014631+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:19:12.014631+0000","last_undegraded":"2024-09-19T05:19:12.014631+0000","last_fullsized":"2024-09-19T05:19:12.014631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038794+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:19:12.038794+0000","last_peered":"2024-09-19T05:19:12.038794+0000","last_clean":"2024-09-19T05:19:12.038794+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:19:12.038794+0000","last_undegraded":"2024-09-19T05:19:12.038794+0000","last_fullsized":"2024-09-19T05:19:12.038794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038076+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:19:12.038076+0000","last_peered":"2024-09-19T05:19:12.038076+0000","last_clean":"2024-09-19T05:19:12.038076+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:19:12.038076+0000","last_undegraded":"2024-09-19T05:19:12.038076+0000","last_fullsized":"2024-09-19T05:19:12.038076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014440+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:19:12.014440+0000","last_peered":"2024-09-19T05:19:12.014440+0000","last_clean":"2024-09-19T05:19:12.014440+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:19:12.014440+0000","last_undegraded":"2024-09-19T05:19:12.014440+0000","last_fullsized":"2024-09-19T05:19:12.014440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039875+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:19:12.039875+0000","last_peered":"2024-09-19T05:19:12.039875+0000","last_clean":"2024-09-19T05:19:12.039875+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:19:12.039875+0000","last_undegraded":"2024-09-19T05:19:12.039875+0000","last_fullsized":"2024-09-19T05:19:12.039875+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014034+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:19:12.014034+0000","last_peered":"2024-09-19T05:19:12.014034+0000","last_clean":"2024-09-19T05:19:12.014034+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:19:12.014034+0000","last_undegraded":"2024-09-19T05:19:12.014034+0000","last_fullsized":"2024-09-19T05:19:12.014034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014688+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:19:12.014688+0000","last_peered":"2024-09-19T05:19:12.014688+0000","last_clean":"2024-09-19T05:19:12.014688+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:19:12.014688+0000","last_undegraded":"2024-09-19T05:19:12.014688+0000","last_fullsized":"2024-09-19T05:19:12.014688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038834+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:19:12.038834+0000","last_peered":"2024-09-19T05:19:12.038834+0000","last_clean":"2024-09-19T05:19:12.038834+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:19:12.038834+0000","last_undegraded":"2024-09-19T05:19:12.038834+0000","last_fullsized":"2024-09-19T05:19:12.038834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038047+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:19:12.038047+0000","last_peered":"2024-09-19T05:19:12.038047+0000","last_clean":"2024-09-19T05:19:12.038047+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:19:12.038047+0000","last_undegraded":"2024-09-19T05:19:12.038047+0000","last_fullsized":"2024-09-19T05:19:12.038047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039607+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:19:12.039607+0000","last_peered":"2024-09-19T05:19:12.039607+0000","last_clean":"2024-09-19T05:19:12.039607+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:19:12.039607+0000","last_undegraded":"2024-09-19T05:19:12.039607+0000","last_fullsized":"2024-09-19T05:19:12.039607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015120+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:19:12.015120+0000","last_peered":"2024-09-19T05:19:12.015120+0000","last_clean":"2024-09-19T05:19:12.015120+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:19:12.015120+0000","last_undegraded":"2024-09-19T05:19:12.015120+0000","last_fullsized":"2024-09-19T05:19:12.015120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038383+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:19:12.038383+0000","last_peered":"2024-09-19T05:19:12.038383+0000","last_clean":"2024-09-19T05:19:12.038383+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:19:12.038383+0000","last_undegraded":"2024-09-19T05:19:12.038383+0000","last_fullsized":"2024-09-19T05:19:12.038383+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039772+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:19:12.039772+0000","last_peered":"2024-09-19T05:19:12.039772+0000","last_clean":"2024-09-19T05:19:12.039772+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:19:12.039772+0000","last_undegraded":"2024-09-19T05:19:12.039772+0000","last_fullsized":"2024-09-19T05:19:12.039772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014379+0000","last_change":"2024-09-19T05:18:59.742846+0000","last_active":"2024-09-19T05:19:12.014379+0000","last_peered":"2024-09-19T05:19:12.014379+0000","last_clean":"2024-09-19T05:19:12.014379+0000","last_became_active":"2024-09-19T05:18:59.742334+0000","last_became_peered":"2024-09-19T05:18:59.742334+0000","last_unstale":"2024-09-19T05:19:12.014379+0000","last_undegraded":"2024-09-19T05:19:12.014379+0000","last_fullsized":"2024-09-19T05:19:12.014379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:55.434122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038729+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:19:12.038729+0000","last_peered":"2024-09-19T05:19:12.038729+0000","last_clean":"2024-09-19T05:19:12.038729+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:19:12.038729+0000","last_undegraded":"2024-09-19T05:19:12.038729+0000","last_fullsized":"2024-09-19T05:19:12.038729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013877+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:19:12.013877+0000","last_peered":"2024-09-19T05:19:12.013877+0000","last_clean":"2024-09-19T05:19:12.013877+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:19:12.013877+0000","last_undegraded":"2024-09-19T05:19:12.013877+0000","last_fullsized":"2024-09-19T05:19:12.013877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039795+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:19:12.039795+0000","last_peered":"2024-09-19T05:19:12.039795+0000","last_clean":"2024-09-19T05:19:12.039795+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:19:12.039795+0000","last_undegraded":"2024-09-19T05:19:12.039795+0000","last_fullsized":"2024-09-19T05:19:12.039795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039930+0000","last_change":"2024-09-19T05:19:09.024259+0000","last_active":"2024-09-19T05:19:12.039930+0000","last_peered":"2024-09-19T05:19:12.039930+0000","last_clean":"2024-09-19T05:19:12.039930+0000","last_became_active":"2024-09-19T05:19:09.023865+0000","last_became_peered":"2024-09-19T05:19:09.023865+0000","last_unstale":"2024-09-19T05:19:12.039930+0000","last_undegraded":"2024-09-19T05:19:12.039930+0000","last_fullsized":"2024-09-19T05:19:12.039930+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:56.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014233+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:19:12.014233+0000","last_peered":"2024-09-19T05:19:12.014233+0000","last_clean":"2024-09-19T05:19:12.014233+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:19:12.014233+0000","last_undegraded":"2024-09-19T05:19:12.014233+0000","last_fullsized":"2024-09-19T05:19:12.014233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039291+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:19:12.039291+0000","last_peered":"2024-09-19T05:19:12.039291+0000","last_clean":"2024-09-19T05:19:12.039291+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:19:12.039291+0000","last_undegraded":"2024-09-19T05:19:12.039291+0000","last_fullsized":"2024-09-19T05:19:12.039291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039016+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:19:12.039016+0000","last_peered":"2024-09-19T05:19:12.039016+0000","last_clean":"2024-09-19T05:19:12.039016+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:19:12.039016+0000","last_undegraded":"2024-09-19T05:19:12.039016+0000","last_fullsized":"2024-09-19T05:19:12.039016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038273+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:19:12.038273+0000","last_peered":"2024-09-19T05:19:12.038273+0000","last_clean":"2024-09-19T05:19:12.038273+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:19:12.038273+0000","last_undegraded":"2024-09-19T05:19:12.038273+0000","last_fullsized":"2024-09-19T05:19:12.038273+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038560+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:19:12.038560+0000","last_peered":"2024-09-19T05:19:12.038560+0000","last_clean":"2024-09-19T05:19:12.038560+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:19:12.038560+0000","last_undegraded":"2024-09-19T05:19:12.038560+0000","last_fullsized":"2024-09-19T05:19:12.038560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039499+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:19:12.039499+0000","last_peered":"2024-09-19T05:19:12.039499+0000","last_clean":"2024-09-19T05:19:12.039499+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:19:12.039499+0000","last_undegraded":"2024-09-19T05:19:12.039499+0000","last_fullsized":"2024-09-19T05:19:12.039499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.015027+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:19:12.015027+0000","last_peered":"2024-09-19T05:19:12.015027+0000","last_clean":"2024-09-19T05:19:12.015027+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:19:12.015027+0000","last_undegraded":"2024-09-19T05:19:12.015027+0000","last_fullsized":"2024-09-19T05:19:12.015027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'23","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:57.155720+0000","last_change":"2024-09-19T05:18:59.697949+0000","last_active":"2024-09-19T05:19:57.155720+0000","last_peered":"2024-09-19T05:19:57.155720+0000","last_clean":"2024-09-19T05:19:57.155720+0000","last_became_active":"2024-09-19T05:18:59.697556+0000","last_became_peered":"2024-09-19T05:18:59.697556+0000","last_unstale":"2024-09-19T05:19:57.155720+0000","last_undegraded":"2024-09-19T05:19:57.155720+0000","last_fullsized":"2024-09-19T05:19:57.155720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.995278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":58,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039502+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:19:12.039502+0000","last_peered":"2024-09-19T05:19:12.039502+0000","last_clean":"2024-09-19T05:19:12.039502+0000","last_became_active":"2024-09-19T05:19:09.016554+0000","last_became_peered":"2024-09-19T05:19:09.016554+0000","last_unstale":"2024-09-19T05:19:12.039502+0000","last_undegraded":"2024-09-19T05:19:12.039502+0000","last_fullsized":"2024-09-19T05:19:12.039502+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:57.423061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038314+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:19:12.038314+0000","last_peered":"2024-09-19T05:19:12.038314+0000","last_clean":"2024-09-19T05:19:12.038314+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:19:12.038314+0000","last_undegraded":"2024-09-19T05:19:12.038314+0000","last_fullsized":"2024-09-19T05:19:12.038314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039816+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:19:12.039816+0000","last_peered":"2024-09-19T05:19:12.039816+0000","last_clean":"2024-09-19T05:19:12.039816+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:19:12.039816+0000","last_undegraded":"2024-09-19T05:19:12.039816+0000","last_fullsized":"2024-09-19T05:19:12.039816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039695+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:19:12.039695+0000","last_peered":"2024-09-19T05:19:12.039695+0000","last_clean":"2024-09-19T05:19:12.039695+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:19:12.039695+0000","last_undegraded":"2024-09-19T05:19:12.039695+0000","last_fullsized":"2024-09-19T05:19:12.039695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014030+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:19:12.014030+0000","last_peered":"2024-09-19T05:19:12.014030+0000","last_clean":"2024-09-19T05:19:12.014030+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:19:12.014030+0000","last_undegraded":"2024-09-19T05:19:12.014030+0000","last_fullsized":"2024-09-19T05:19:12.014030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014518+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:19:12.014518+0000","last_peered":"2024-09-19T05:19:12.014518+0000","last_clean":"2024-09-19T05:19:12.014518+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:19:12.014518+0000","last_undegraded":"2024-09-19T05:19:12.014518+0000","last_fullsized":"2024-09-19T05:19:12.014518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039300+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:19:12.039300+0000","last_peered":"2024-09-19T05:19:12.039300+0000","last_clean":"2024-09-19T05:19:12.039300+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:19:12.039300+0000","last_undegraded":"2024-09-19T05:19:12.039300+0000","last_fullsized":"2024-09-19T05:19:12.039300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038831+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:19:12.038831+0000","last_peered":"2024-09-19T05:19:12.038831+0000","last_clean":"2024-09-19T05:19:12.038831+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:19:12.038831+0000","last_undegraded":"2024-09-19T05:19:12.038831+0000","last_fullsized":"2024-09-19T05:19:12.038831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039566+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:19:12.039566+0000","last_peered":"2024-09-19T05:19:12.039566+0000","last_clean":"2024-09-19T05:19:12.039566+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:19:12.039566+0000","last_undegraded":"2024-09-19T05:19:12.039566+0000","last_fullsized":"2024-09-19T05:19:12.039566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038585+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:19:12.038585+0000","last_peered":"2024-09-19T05:19:12.038585+0000","last_clean":"2024-09-19T05:19:12.038585+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:19:12.038585+0000","last_undegraded":"2024-09-19T05:19:12.038585+0000","last_fullsized":"2024-09-19T05:19:12.038585+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013727+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:19:12.013727+0000","last_peered":"2024-09-19T05:19:12.013727+0000","last_clean":"2024-09-19T05:19:12.013727+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:19:12.013727+0000","last_undegraded":"2024-09-19T05:19:12.013727+0000","last_fullsized":"2024-09-19T05:19:12.013727+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039349+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:19:12.039349+0000","last_peered":"2024-09-19T05:19:12.039349+0000","last_clean":"2024-09-19T05:19:12.039349+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:19:12.039349+0000","last_undegraded":"2024-09-19T05:19:12.039349+0000","last_fullsized":"2024-09-19T05:19:12.039349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039013+0000","last_change":"2024-09-19T05:18:59.690280+0000","last_active":"2024-09-19T05:19:12.039013+0000","last_peered":"2024-09-19T05:19:12.039013+0000","last_clean":"2024-09-19T05:19:12.039013+0000","last_became_active":"2024-09-19T05:18:59.689990+0000","last_became_peered":"2024-09-19T05:18:59.689990+0000","last_unstale":"2024-09-19T05:19:12.039013+0000","last_undegraded":"2024-09-19T05:19:12.039013+0000","last_fullsized":"2024-09-19T05:19:12.039013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:24.937837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038357+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:19:12.038357+0000","last_peered":"2024-09-19T05:19:12.038357+0000","last_clean":"2024-09-19T05:19:12.038357+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:19:12.038357+0000","last_undegraded":"2024-09-19T05:19:12.038357+0000","last_fullsized":"2024-09-19T05:19:12.038357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037691+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:19:12.037691+0000","last_peered":"2024-09-19T05:19:12.037691+0000","last_clean":"2024-09-19T05:19:12.037691+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:19:12.037691+0000","last_undegraded":"2024-09-19T05:19:12.037691+0000","last_fullsized":"2024-09-19T05:19:12.037691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037903+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:19:12.037903+0000","last_peered":"2024-09-19T05:19:12.037903+0000","last_clean":"2024-09-19T05:19:12.037903+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:19:12.037903+0000","last_undegraded":"2024-09-19T05:19:12.037903+0000","last_fullsized":"2024-09-19T05:19:12.037903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038825+0000","last_change":"2024-09-19T05:18:59.691950+0000","last_active":"2024-09-19T05:19:12.038825+0000","last_peered":"2024-09-19T05:19:12.038825+0000","last_clean":"2024-09-19T05:19:12.038825+0000","last_became_active":"2024-09-19T05:18:59.691551+0000","last_became_peered":"2024-09-19T05:18:59.691551+0000","last_unstale":"2024-09-19T05:19:12.038825+0000","last_undegraded":"2024-09-19T05:19:12.038825+0000","last_fullsized":"2024-09-19T05:19:12.038825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:56.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039211+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:19:12.039211+0000","last_peered":"2024-09-19T05:19:12.039211+0000","last_clean":"2024-09-19T05:19:12.039211+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:19:12.039211+0000","last_undegraded":"2024-09-19T05:19:12.039211+0000","last_fullsized":"2024-09-19T05:19:12.039211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038507+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:19:12.038507+0000","last_peered":"2024-09-19T05:19:12.038507+0000","last_clean":"2024-09-19T05:19:12.038507+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:19:12.038507+0000","last_undegraded":"2024-09-19T05:19:12.038507+0000","last_fullsized":"2024-09-19T05:19:12.038507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039307+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:19:12.039307+0000","last_peered":"2024-09-19T05:19:12.039307+0000","last_clean":"2024-09-19T05:19:12.039307+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:19:12.039307+0000","last_undegraded":"2024-09-19T05:19:12.039307+0000","last_fullsized":"2024-09-19T05:19:12.039307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014440+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:19:12.014440+0000","last_peered":"2024-09-19T05:19:12.014440+0000","last_clean":"2024-09-19T05:19:12.014440+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:19:12.014440+0000","last_undegraded":"2024-09-19T05:19:12.014440+0000","last_fullsized":"2024-09-19T05:19:12.014440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038566+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:19:12.038566+0000","last_peered":"2024-09-19T05:19:12.038566+0000","last_clean":"2024-09-19T05:19:12.038566+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:19:12.038566+0000","last_undegraded":"2024-09-19T05:19:12.038566+0000","last_fullsized":"2024-09-19T05:19:12.038566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038311+0000","last_change":"2024-09-19T05:19:01.943020+0000","last_active":"2024-09-19T05:19:12.038311+0000","last_peered":"2024-09-19T05:19:12.038311+0000","last_clean":"2024-09-19T05:19:12.038311+0000","last_became_active":"2024-09-19T05:19:01.942697+0000","last_became_peered":"2024-09-19T05:19:01.942697+0000","last_unstale":"2024-09-19T05:19:12.038311+0000","last_undegraded":"2024-09-19T05:19:12.038311+0000","last_fullsized":"2024-09-19T05:19:12.038311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:37.172627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038472+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:19:12.038472+0000","last_peered":"2024-09-19T05:19:12.038472+0000","last_clean":"2024-09-19T05:19:12.038472+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:19:12.038472+0000","last_undegraded":"2024-09-19T05:19:12.038472+0000","last_fullsized":"2024-09-19T05:19:12.038472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038124+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:19:12.038124+0000","last_peered":"2024-09-19T05:19:12.038124+0000","last_clean":"2024-09-19T05:19:12.038124+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:19:12.038124+0000","last_undegraded":"2024-09-19T05:19:12.038124+0000","last_fullsized":"2024-09-19T05:19:12.038124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013990+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:19:12.013990+0000","last_peered":"2024-09-19T05:19:12.013990+0000","last_clean":"2024-09-19T05:19:12.013990+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:19:12.013990+0000","last_undegraded":"2024-09-19T05:19:12.013990+0000","last_fullsized":"2024-09-19T05:19:12.013990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038410+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:19:12.038410+0000","last_peered":"2024-09-19T05:19:12.038410+0000","last_clean":"2024-09-19T05:19:12.038410+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:19:12.038410+0000","last_undegraded":"2024-09-19T05:19:12.038410+0000","last_fullsized":"2024-09-19T05:19:12.038410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039533+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:19:12.039533+0000","last_peered":"2024-09-19T05:19:12.039533+0000","last_clean":"2024-09-19T05:19:12.039533+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:19:12.039533+0000","last_undegraded":"2024-09-19T05:19:12.039533+0000","last_fullsized":"2024-09-19T05:19:12.039533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038693+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:19:12.038693+0000","last_peered":"2024-09-19T05:19:12.038693+0000","last_clean":"2024-09-19T05:19:12.038693+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:19:12.038693+0000","last_undegraded":"2024-09-19T05:19:12.038693+0000","last_fullsized":"2024-09-19T05:19:12.038693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037967+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:19:12.037967+0000","last_peered":"2024-09-19T05:19:12.037967+0000","last_clean":"2024-09-19T05:19:12.037967+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:19:12.037967+0000","last_undegraded":"2024-09-19T05:19:12.037967+0000","last_fullsized":"2024-09-19T05:19:12.037967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038875+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:19:12.038875+0000","last_peered":"2024-09-19T05:19:12.038875+0000","last_clean":"2024-09-19T05:19:12.038875+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:19:12.038875+0000","last_undegraded":"2024-09-19T05:19:12.038875+0000","last_fullsized":"2024-09-19T05:19:12.038875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038591+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:19:12.038591+0000","last_peered":"2024-09-19T05:19:12.038591+0000","last_clean":"2024-09-19T05:19:12.038591+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:19:12.038591+0000","last_undegraded":"2024-09-19T05:19:12.038591+0000","last_fullsized":"2024-09-19T05:19:12.038591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038327+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:19:12.038327+0000","last_peered":"2024-09-19T05:19:12.038327+0000","last_clean":"2024-09-19T05:19:12.038327+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:19:12.038327+0000","last_undegraded":"2024-09-19T05:19:12.038327+0000","last_fullsized":"2024-09-19T05:19:12.038327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038149+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:19:12.038149+0000","last_peered":"2024-09-19T05:19:12.038149+0000","last_clean":"2024-09-19T05:19:12.038149+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:19:12.038149+0000","last_undegraded":"2024-09-19T05:19:12.038149+0000","last_fullsized":"2024-09-19T05:19:12.038149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039073+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:19:12.039073+0000","last_peered":"2024-09-19T05:19:12.039073+0000","last_clean":"2024-09-19T05:19:12.039073+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:19:12.039073+0000","last_undegraded":"2024-09-19T05:19:12.039073+0000","last_fullsized":"2024-09-19T05:19:12.039073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039270+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:19:12.039270+0000","last_peered":"2024-09-19T05:19:12.039270+0000","last_clean":"2024-09-19T05:19:12.039270+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:19:12.039270+0000","last_undegraded":"2024-09-19T05:19:12.039270+0000","last_fullsized":"2024-09-19T05:19:12.039270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040203+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:19:12.040203+0000","last_peered":"2024-09-19T05:19:12.040203+0000","last_clean":"2024-09-19T05:19:12.040203+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:19:12.040203+0000","last_undegraded":"2024-09-19T05:19:12.040203+0000","last_fullsized":"2024-09-19T05:19:12.040203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.040030+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:19:12.040030+0000","last_peered":"2024-09-19T05:19:12.040030+0000","last_clean":"2024-09-19T05:19:12.040030+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:19:12.040030+0000","last_undegraded":"2024-09-19T05:19:12.040030+0000","last_fullsized":"2024-09-19T05:19:12.040030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037788+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:19:12.037788+0000","last_peered":"2024-09-19T05:19:12.037788+0000","last_clean":"2024-09-19T05:19:12.037788+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:19:12.037788+0000","last_undegraded":"2024-09-19T05:19:12.037788+0000","last_fullsized":"2024-09-19T05:19:12.037788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013597+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:19:12.013597+0000","last_peered":"2024-09-19T05:19:12.013597+0000","last_clean":"2024-09-19T05:19:12.013597+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:19:12.013597+0000","last_undegraded":"2024-09-19T05:19:12.013597+0000","last_fullsized":"2024-09-19T05:19:12.013597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013541+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:19:12.013541+0000","last_peered":"2024-09-19T05:19:12.013541+0000","last_clean":"2024-09-19T05:19:12.013541+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:19:12.013541+0000","last_undegraded":"2024-09-19T05:19:12.013541+0000","last_fullsized":"2024-09-19T05:19:12.013541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038056+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:19:12.038056+0000","last_peered":"2024-09-19T05:19:12.038056+0000","last_clean":"2024-09-19T05:19:12.038056+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:19:12.038056+0000","last_undegraded":"2024-09-19T05:19:12.038056+0000","last_fullsized":"2024-09-19T05:19:12.038056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039621+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:19:12.039621+0000","last_peered":"2024-09-19T05:19:12.039621+0000","last_clean":"2024-09-19T05:19:12.039621+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:19:12.039621+0000","last_undegraded":"2024-09-19T05:19:12.039621+0000","last_fullsized":"2024-09-19T05:19:12.039621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014590+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:19:12.014590+0000","last_peered":"2024-09-19T05:19:12.014590+0000","last_clean":"2024-09-19T05:19:12.014590+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:19:12.014590+0000","last_undegraded":"2024-09-19T05:19:12.014590+0000","last_fullsized":"2024-09-19T05:19:12.014590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039831+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:19:12.039831+0000","last_peered":"2024-09-19T05:19:12.039831+0000","last_clean":"2024-09-19T05:19:12.039831+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:19:12.039831+0000","last_undegraded":"2024-09-19T05:19:12.039831+0000","last_fullsized":"2024-09-19T05:19:12.039831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038898+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:19:12.038898+0000","last_peered":"2024-09-19T05:19:12.038898+0000","last_clean":"2024-09-19T05:19:12.038898+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:19:12.038898+0000","last_undegraded":"2024-09-19T05:19:12.038898+0000","last_fullsized":"2024-09-19T05:19:12.038898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.037679+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:19:12.037679+0000","last_peered":"2024-09-19T05:19:12.037679+0000","last_clean":"2024-09-19T05:19:12.037679+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:19:12.037679+0000","last_undegraded":"2024-09-19T05:19:12.037679+0000","last_fullsized":"2024-09-19T05:19:12.037679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013942+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:19:12.013942+0000","last_peered":"2024-09-19T05:19:12.013942+0000","last_clean":"2024-09-19T05:19:12.013942+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:19:12.013942+0000","last_undegraded":"2024-09-19T05:19:12.013942+0000","last_fullsized":"2024-09-19T05:19:12.013942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.038734+0000","last_change":"2024-09-19T05:19:01.943934+0000","last_active":"2024-09-19T05:19:12.038734+0000","last_peered":"2024-09-19T05:19:12.038734+0000","last_clean":"2024-09-19T05:19:12.038734+0000","last_became_active":"2024-09-19T05:19:01.943200+0000","last_became_peered":"2024-09-19T05:19:01.943200+0000","last_unstale":"2024-09-19T05:19:12.038734+0000","last_undegraded":"2024-09-19T05:19:12.038734+0000","last_fullsized":"2024-09-19T05:19:12.038734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:00.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.014346+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:19:12.014346+0000","last_peered":"2024-09-19T05:19:12.014346+0000","last_clean":"2024-09-19T05:19:12.014346+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:19:12.014346+0000","last_undegraded":"2024-09-19T05:19:12.014346+0000","last_fullsized":"2024-09-19T05:19:12.014346+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039548+0000","last_change":"2024-09-19T05:19:01.948368+0000","last_active":"2024-09-19T05:19:12.039548+0000","last_peered":"2024-09-19T05:19:12.039548+0000","last_clean":"2024-09-19T05:19:12.039548+0000","last_became_active":"2024-09-19T05:19:01.947922+0000","last_became_peered":"2024-09-19T05:19:01.947922+0000","last_unstale":"2024-09-19T05:19:12.039548+0000","last_undegraded":"2024-09-19T05:19:12.039548+0000","last_fullsized":"2024-09-19T05:19:12.039548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:02.666651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013542+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:19:12.013542+0000","last_peered":"2024-09-19T05:19:12.013542+0000","last_clean":"2024-09-19T05:19:12.013542+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:19:12.013542+0000","last_undegraded":"2024-09-19T05:19:12.013542+0000","last_fullsized":"2024-09-19T05:19:12.013542+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.013664+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:19:12.013664+0000","last_peered":"2024-09-19T05:19:12.013664+0000","last_clean":"2024-09-19T05:19:12.013664+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:19:12.013664+0000","last_undegraded":"2024-09-19T05:19:12.013664+0000","last_fullsized":"2024-09-19T05:19:12.013664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T05:19:12.039999+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:19:12.039999+0000","last_peered":"2024-09-19T05:19:12.039999+0000","last_clean":"2024-09-19T05:19:12.039999+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:19:12.039999+0000","last_undegraded":"2024-09-19T05:19:12.039999+0000","last_fullsized":"2024-09-19T05:19:12.039999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44143,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":38,"num_read_kb":64,"num_write":72,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":157693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547224,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":477377,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776157,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1056768,"data_stored":1107188,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906978,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":482055,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":477981,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1072423,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528370,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":473281,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1007616,"data_stored":1067927,"data_compressed":53569,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477399,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":473385,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":529292,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":529258,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":946176,"data_stored":473371,"data_compressed":17521,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":55977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":56011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":43539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:20:04.018 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T05:20:04.018 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T05:20:04.019 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T05:20:04.278 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:04.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 -- 172.21.15.1:0/1170699031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61101037c0 msgr2=0x7f611010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 --2- 172.21.15.1:0/1170699031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61101037c0 0x7f611010a050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ca0 tx=0x7f610802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 -- 172.21.15.1:0/1170699031 shutdown_connections 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 --2- 172.21.15.1:0/1170699031 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61101037c0 0x7f611010a050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 --2- 172.21.15.1:0/1170699031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6110102e00 0x7f6110103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 --2- 172.21.15.1:0/1170699031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 0x7f6110102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 -- 172.21.15.1:0/1170699031 >> 172.21.15.1:0/1170699031 conn(0x7f61100fd390 msgr2=0x7f61100ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 -- 172.21.15.1:0/1170699031 shutdown_connections 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.758+0000 7f6117506640 1 -- 172.21.15.1:0/1170699031 wait complete. 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 Processor -- start 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 -- start start 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 0x7f6110075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:04.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61101037c0 0x7f6110074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f611010d880 con 0x7f6110102e00 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f611010d700 con 0x7f6110101c00 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6117506640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f611010da00 con 0x7f61101037c0 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6114aa1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6114aa1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59038/0 (socket says 172.21.15.1:59038) 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6114aa1640 1 -- 172.21.15.1:0/2626224190 learned_addr learned my addr 172.21.15.1:0/2626224190 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f61152a2640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 0x7f6110075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.759+0000 7f6115aa3640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61101037c0 0x7f6110074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 -- 172.21.15.1:0/2626224190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61101037c0 msgr2=0x7f6110074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61101037c0 0x7f6110074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 -- 172.21.15.1:0/2626224190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 msgr2=0x7f6110075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 0x7f6110075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 -- 172.21.15.1:0/2626224190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61100753e0 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6114aa1640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f610000e9f0 tx=0x7f610000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610000cd80 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6100005500 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61101a1f80 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100010690 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.760+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61101a23e0 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.761+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6110108f30 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.762+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f61000046c0 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.763+0000 7f61067fc640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 0x7f60fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.763+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f61000d0220 con 0x7f6110102e00 2024-09-19T05:20:04.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.763+0000 7f61152a2640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 0x7f60fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:04.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.763+0000 7f61152a2640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 0x7f60fc0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f610c0058c0 tx=0x7f610c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:04.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:04.767+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f610009cba0 con 0x7f6110102e00 2024-09-19T05:20:05.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:04 smithi060 ceph-mon[35058]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:05.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:04 smithi082 ceph-mon[35195]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:05.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.010+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f611002d990 con 0x7f6110102e00 2024-09-19T05:20:05.011 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:04 smithi001 ceph-mon[30968]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:05.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.012+0000 7f61067fc640 1 -- 172.21.15.1:0/2626224190 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f610009c4a0 con 0x7f6110102e00 2024-09-19T05:20:05.014 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-19T05:20:05.014 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCFtOtm6fSqABAAFKz6y6Hb2Uuie+g6ICb0gQ== 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 msgr2=0x7f60fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 0x7f60fc0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f610c0058c0 tx=0x7f610c005850 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 msgr2=0x7f61100745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f610000e9f0 tx=0x7f610000edf0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 shutdown_connections 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f60fc0a32d0 0x7f60fc0a5790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61101037c0 0x7f6110074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6110102e00 0x7f61100745e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 --2- 172.21.15.1:0/2626224190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6110101c00 0x7f6110075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 >> 172.21.15.1:0/2626224190 conn(0x7f61100fd390 msgr2=0x7f6110106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.015+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 shutdown_connections 2024-09-19T05:20:05.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:05.016+0000 7f6117506640 1 -- 172.21.15.1:0/2626224190 wait complete. 2024-09-19T05:20:05.740 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:20:05.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T05:20:05.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T05:20:05.787 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T05:20:05.788 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T05:20:05.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T05:20:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:05 smithi060 ceph-mon[35058]: pgmap v314: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-09-19T05:20:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:05 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:20:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:05 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:20:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:05 smithi082 ceph-mon[35195]: pgmap v314: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-09-19T05:20:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:05 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:20:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:05 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:20:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:05 smithi001 ceph-mon[30968]: pgmap v314: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.5 KiB/s wr, 6 op/s 2024-09-19T05:20:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:05 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:20:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:05 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2626224190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:20:06.092 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.591+0000 7f2144d5e640 1 -- 172.21.15.1:0/817369741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2140101440 msgr2=0x7f214010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.591+0000 7f2144d5e640 1 --2- 172.21.15.1:0/817369741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2140101440 0x7f214010df30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2134009900 tx=0x7f213402a410 comp rx=0 tx=0).stop 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 -- 172.21.15.1:0/817369741 shutdown_connections 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 --2- 172.21.15.1:0/817369741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f214010e500 0x7f2140110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 --2- 172.21.15.1:0/817369741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2140101440 0x7f214010df30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 --2- 172.21.15.1:0/817369741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 0x7f2140100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 -- 172.21.15.1:0/817369741 >> 172.21.15.1:0/817369741 conn(0x7f21400fc7d0 msgr2=0x7f21400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 -- 172.21.15.1:0/817369741 shutdown_connections 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 -- 172.21.15.1:0/817369741 wait complete. 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 Processor -- start 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.592+0000 7f2144d5e640 1 -- start start 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 0x7f21401a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2140101440 0x7f21401a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2140114250 con 0x7f214010e500 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21401140d0 con 0x7f2140100b20 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f2144d5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21401143d0 con 0x7f2140101440 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59052/0 (socket says 172.21.15.1:59052) 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 -- 172.21.15.1:0/2028776420 learned_addr learned my addr 172.21.15.1:0/2028776420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213dd9b640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2140101440 0x7f21401a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213e59c640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 0x7f21401a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 -- 172.21.15.1:0/2028776420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2140101440 msgr2=0x7f21401a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2140101440 0x7f21401a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 -- 172.21.15.1:0/2028776420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 msgr2=0x7f21401a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 0x7f21401a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 -- 172.21.15.1:0/2028776420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214019ad30 con 0x7f214010e500 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f213ed9d640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f213800dac0 tx=0x7f213800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.593+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138017070 con 0x7f214010e500 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.594+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2138003e50 con 0x7f214010e500 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.594+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214019b020 con 0x7f214010e500 2024-09-19T05:20:06.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.594+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380106c0 con 0x7f214010e500 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.594+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21401a7310 con 0x7f214010e500 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.595+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214006a850 con 0x7f214010e500 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.596+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2138003970 con 0x7f214010e500 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.597+0000 7f212f7fe640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 0x7f21280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.597+0000 7f213e59c640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 0x7f21280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.597+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f21380cf940 con 0x7f214010e500 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.597+0000 7f213e59c640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 0x7f21280a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21300058c0 tx=0x7f213000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.600+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f213809c340 con 0x7f214010e500 2024-09-19T05:20:06.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.827+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2140100f00 con 0x7f214010e500 2024-09-19T05:20:06.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.832+0000 7f212f7fe640 1 -- 172.21.15.1:0/2028776420 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264036 (secure 0 0 0) 0x7f2140100f00 con 0x7f214010e500 2024-09-19T05:20:06.837 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 msgr2=0x7f21280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 0x7f21280a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21300058c0 tx=0x7f213000a4c0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 msgr2=0x7f214019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f213800dac0 tx=0x7f213800df80 comp rx=0 tx=0).stop 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 shutdown_connections 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f21280a3350 0x7f21280a5810 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f214010e500 0x7f214019a600 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2140101440 0x7f21401a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 --2- 172.21.15.1:0/2028776420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2140100b20 0x7f21401a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 >> 172.21.15.1:0/2028776420 conn(0x7f21400fc7d0 msgr2=0x7f21400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.835+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 shutdown_connections 2024-09-19T05:20:06.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:06.836+0000 7f2144d5e640 1 -- 172.21.15.1:0/2028776420 wait complete. 2024-09-19T05:20:07.590 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":427915191},{"type":"v1","addr":"172.21.15.1:6801","nonce":427915191}]},"active_addr":"172.21.15.1:6801/427915191","active_change":"2024-09-19T05:12:09.746142+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":708825613}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2090276333}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3856069381}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":705911444}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":2000348045}]}]} 2024-09-19T05:20:07.595 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T05:20:07.595 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T05:20:07.595 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:20:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:07 smithi001 ceph-mon[30968]: pgmap v315: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.3 KiB/s wr, 4 op/s 2024-09-19T05:20:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:07 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2028776420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:07 smithi060 ceph-mon[35058]: pgmap v315: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.3 KiB/s wr, 4 op/s 2024-09-19T05:20:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:07 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2028776420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:20:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:07 smithi082 ceph-mon[35195]: pgmap v315: 129 pgs: 129 active+clean; 632 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.3 KiB/s wr, 4 op/s 2024-09-19T05:20:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:07 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2028776420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:20:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- 172.21.15.1:0/1383484554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c1036c0 msgr2=0x7fb18c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 --2- 172.21.15.1:0/1383484554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c1036c0 0x7fb18c10bbb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb178009900 tx=0x7fb17802a480 comp rx=0 tx=0).stop 2024-09-19T05:20:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- 172.21.15.1:0/1383484554 shutdown_connections 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 --2- 172.21.15.1:0/1383484554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c10c180 0x7fb18c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 --2- 172.21.15.1:0/1383484554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c1036c0 0x7fb18c10bbb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 --2- 172.21.15.1:0/1383484554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c102da0 0x7fb18c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- 172.21.15.1:0/1383484554 >> 172.21.15.1:0/1383484554 conn(0x7fb18c0fc7a0 msgr2=0x7fb18c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- 172.21.15.1:0/1383484554 shutdown_connections 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- 172.21.15.1:0/1383484554 wait complete. 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 Processor -- start 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 -- start start 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.333+0000 7fb193252640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 0x7fb18c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 0x7fb18c19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:08.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c111fa0 con 0x7fb18c102da0 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c111e20 con 0x7fb18c1036c0 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c112120 con 0x7fb18c10c180 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59076/0 (socket says 172.21.15.1:59076) 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 -- 172.21.15.1:0/1906502891 learned_addr learned my addr 172.21.15.1:0/1906502891 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb1917ef640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 0x7fb18c19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb18bfff640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 0x7fb18c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:08.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 -- 172.21.15.1:0/1906502891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 msgr2=0x7fb18c19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 0x7fb18c19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 -- 172.21.15.1:0/1906502891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 msgr2=0x7fb18c19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 0x7fb18c19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 -- 172.21.15.1:0/1906502891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c19f6d0 con 0x7fb18c102da0 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb1917ef640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 0x7fb18c19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb18bfff640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 0x7fb18c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb190fee640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb18000d950 tx=0x7fb18000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180017030 con 0x7fb18c102da0 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb180004020 con 0x7fb18c102da0 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1800047a0 con 0x7fb18c102da0 2024-09-19T05:20:08.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.334+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18c19f9c0 con 0x7fb18c102da0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.335+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18c1a72a0 con 0x7fb18c102da0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.336+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18c103180 con 0x7fb18c102da0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.337+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb1800041d0 con 0x7fb18c102da0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.338+0000 7fb189ffb640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 0x7fb17c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.338+0000 7fb18bfff640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 0x7fb17c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.338+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb1800cf760 con 0x7fb18c102da0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.338+0000 7fb18bfff640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 0x7fb17c0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb178000c00 tx=0x7fb178032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:08.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.342+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb18009c080 con 0x7fb18c102da0 2024-09-19T05:20:08.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.517+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb18c1a7530 con 0x7fb18c102da0 2024-09-19T05:20:08.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.519+0000 7fb189ffb640 1 -- 172.21.15.1:0/1906502891 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7fb18009b980 con 0x7fb18c102da0 2024-09-19T05:20:08.521 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:08.521 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 msgr2=0x7fb17c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 0x7fb17c0a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb178000c00 tx=0x7fb178032c70 comp rx=0 tx=0).stop 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 msgr2=0x7fb18c19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb18000d950 tx=0x7fb18000de10 comp rx=0 tx=0).stop 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 shutdown_connections 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb17c0a3350 0x7fb17c0a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb18c10c180 0x7fb18c19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb18c1036c0 0x7fb18c19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 --2- 172.21.15.1:0/1906502891 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb18c102da0 0x7fb18c19a720 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:08.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 >> 172.21.15.1:0/1906502891 conn(0x7fb18c0fc7a0 msgr2=0x7fb18c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:08.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 shutdown_connections 2024-09-19T05:20:08.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:08.521+0000 7fb193252640 1 -- 172.21.15.1:0/1906502891 wait complete. 2024-09-19T05:20:08.832 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:08 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1906502891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:09.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:08 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1906502891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:09.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:08 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1906502891' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:09.167 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T05:20:09.168 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:20:09.431 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:09 smithi001 ceph-mon[30968]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 -- 172.21.15.1:0/2431255558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 msgr2=0x7fe66410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 --2- 172.21.15.1:0/2431255558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe66410ea90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009900 tx=0x7fe65c02a410 comp rx=0 tx=0).stop 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 -- 172.21.15.1:0/2431255558 shutdown_connections 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 --2- 172.21.15.1:0/2431255558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe66410ea90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 --2- 172.21.15.1:0/2431255558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 0x7fe6641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 --2- 172.21.15.1:0/2431255558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 -- 172.21.15.1:0/2431255558 >> 172.21.15.1:0/2431255558 conn(0x7fe6640fd8c0 msgr2=0x7fe6640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 -- 172.21.15.1:0/2431255558 shutdown_connections 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 -- 172.21.15.1:0/2431255558 wait complete. 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.925+0000 7fe66999c640 1 Processor -- start 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 -- start start 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 0x7fe664074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe664111f70 con 0x7fe664106f10 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe664111df0 con 0x7fe664101de0 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe66999c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641120f0 con 0x7fe664102790 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59092/0 (socket says 172.21.15.1:59092) 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 -- 172.21.15.1:0/1471030757 learned_addr learned my addr 172.21.15.1:0/1471030757 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6627fc640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 0x7fe664074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe662ffd640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 -- 172.21.15.1:0/1471030757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 msgr2=0x7fe664074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 0x7fe664074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 -- 172.21.15.1:0/1471030757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 msgr2=0x7fe6640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe6637fe640 1 -- 172.21.15.1:0/1471030757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6641a67f0 con 0x7fe664106f10 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.926+0000 7fe662ffd640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe6637fe640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe65c005ab0 tx=0x7fe65c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c03f030 con 0x7fe664106f10 2024-09-19T05:20:09.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c003ce0 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6641a6a80 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c035070 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.927+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6641a6fb0 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.928+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6641021c0 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.930+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe65c042030 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.931+0000 7fe66899a640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 0x7fe6500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.931+0000 7fe662ffd640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 0x7fe6500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.931+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fe65c0f04d0 con 0x7fe664106f10 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.932+0000 7fe662ffd640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 0x7fe6500a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe65400baa0 tx=0x7fe654005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:09.935+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe65c0bcdf0 con 0x7fe664106f10 2024-09-19T05:20:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:09 smithi060 ceph-mon[35058]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:20:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:09 smithi082 ceph-mon[35195]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-19T05:20:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.113+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe66410a0f0 con 0x7fe664106f10 2024-09-19T05:20:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.114+0000 7fe66899a640 1 -- 172.21.15.1:0/1471030757 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24080 (secure 0 0 0) 0x7fe65c0bc6f0 con 0x7fe664106f10 2024-09-19T05:20:10.116 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:10.116 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":87,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:19:11.756672+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 msgr2=0x7fe6500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 0x7fe6500a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe65400baa0 tx=0x7fe654005d90 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 msgr2=0x7fe664074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe65c005ab0 tx=0x7fe65c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 shutdown_connections 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6500a3350 0x7fe6500a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe664106f10 0x7fe664074f70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664102790 0x7fe664074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 --2- 172.21.15.1:0/1471030757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe664101de0 0x7fe6640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 >> 172.21.15.1:0/1471030757 conn(0x7fe6640fd8c0 msgr2=0x7fe6640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 shutdown_connections 2024-09-19T05:20:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:10.117+0000 7fe66999c640 1 -- 172.21.15.1:0/1471030757 wait complete. 2024-09-19T05:20:10.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T05:20:10.805 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T05:20:10.805 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T05:20:10.805 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T05:20:10.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T05:20:10.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T05:20:10.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T05:20:10.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T05:20:10.807 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T05:20:10.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T05:20:10.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T05:20:10.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T05:20:10.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T05:20:10.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:10 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1471030757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T05:20:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:10 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1471030757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-09-19T05:20:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-19T05:20:11.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2024-09-19T05:20:11.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:10 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1471030757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:11.450 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:11.521 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:11.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:20:11.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T05:20:11.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T05:20:11.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:11 smithi001 ceph-mon[30968]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:20:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-19T05:20:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T05:20:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-19T05:20:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T05:20:12.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:11 smithi060 ceph-mon[35058]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T05:20:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-19T05:20:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-09-19T05:20:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-19T05:20:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-19T05:20:12.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:11 smithi082 ceph-mon[35195]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:20:12.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/2427368812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18103740 msgr2=0x7fbe18107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/2427368812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18103740 0x7fbe18107b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009930 tx=0x7fbe0002a420 comp rx=0 tx=0).stop 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/2427368812 shutdown_connections 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/2427368812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe18108290 0x7fbe1810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/2427368812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18103740 0x7fbe18107b80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/2427368812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe18102d90 0x7fbe18103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/2427368812 >> 172.21.15.1:0/2427368812 conn(0x7fbe180fc7d0 msgr2=0x7fbe180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/2427368812 shutdown_connections 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/2427368812 wait complete. 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 Processor -- start 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.375+0000 7fbe1f1d0640 1 -- start start 2024-09-19T05:20:12.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 0x7fbe181009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe18103740 0x7fbe18100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe18108290 0x7fbe18101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18112090 con 0x7fbe18102d90 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18111f10 con 0x7fbe18103740 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18112210 con 0x7fbe18108290 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 0x7fbe181009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 0x7fbe181009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59118/0 (socket says 172.21.15.1:59118) 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 -- 172.21.15.1:0/3744788664 learned_addr learned my addr 172.21.15.1:0/3744788664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe17fff640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe18103740 0x7fbe18100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1d76d640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe18108290 0x7fbe18101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 -- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe18108290 msgr2=0x7fbe18101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe18108290 0x7fbe18101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 -- 172.21.15.1:0/3744788664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe18103740 msgr2=0x7fbe18100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe18103740 0x7fbe18100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe181a6a90 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1cf6c640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 0x7fbe181009f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800d770 tx=0x7fbe0800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08017070 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe181a6d80 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08005500 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.376+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08004e00 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.377+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181a71e0 con 0x7fbe18102d90 2024-09-19T05:20:12.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.378+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe180628c0 con 0x7fbe18102d90 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.379+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbe08004fa0 con 0x7fbe18102d90 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.379+0000 7fbe15ffb640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe040a32d0 0x7fbe040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbe080cf840 con 0x7fbe18102d90 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe17fff640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe040a32d0 0x7fbe040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe15ffb640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] conn(0x7fbe040ae4a0 0x7fbe040b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe0801ee50 con 0x7fbe040ae4a0 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fbe080d42c0 con 0x7fbe18102d90 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe17fff640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe040a32d0 0x7fbe040a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe00004770 tx=0x7fbe000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.380+0000 7fbe1d76d640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] conn(0x7fbe040ae4a0 0x7fbe040b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:12.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.381+0000 7fbe1d76d640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] conn(0x7fbe040ae4a0 0x7fbe040b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.381+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== osd.5 v2:172.21.15.82:6808/3813280468 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe0801ee50 con 0x7fbe040ae4a0 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.395+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 --> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe18062d40 con 0x7fbe040ae4a0 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe15ffb640 1 -- 172.21.15.1:0/3744788664 <== osd.5 v2:172.21.15.82:6808/3813280468 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbe18062d40 con 0x7fbe040ae4a0 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] conn(0x7fbe040ae4a0 msgr2=0x7fbe040b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] conn(0x7fbe040ae4a0 0x7fbe040b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe040a32d0 msgr2=0x7fbe040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe040a32d0 0x7fbe040a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe00004770 tx=0x7fbe000058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 msgr2=0x7fbe181009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 --2- 172.21.15.1:0/3744788664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe18102d90 0x7fbe181009f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800d770 tx=0x7fbe0800dc30 comp rx=0 tx=0).stop 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1d76d640 1 -- 172.21.15.1:0/3744788664 reap_dead start 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 shutdown_connections 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 >> 172.21.15.1:0/3744788664 conn(0x7fbe180fc7d0 msgr2=0x7fbe18105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.396+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 shutdown_connections 2024-09-19T05:20:12.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:12.397+0000 7fbe1f1d0640 1 -- 172.21.15.1:0/3744788664 wait complete. 2024-09-19T05:20:13.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:12 smithi060 ceph-mon[35058]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:20:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:12 smithi082 ceph-mon[35195]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:20:13.072 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:12 smithi001 ceph-mon[30968]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:20:13.092 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.093 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.093 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.098 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.099 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.111 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.111 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.118 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.122 INFO:teuthology.orchestra.run.smithi001.stdout:158913790010 2024-09-19T05:20:13.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 -- 172.21.15.1:0/2875985366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd34410c2f0 msgr2=0x7fd34410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 --2- 172.21.15.1:0/2875985366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd34410c2f0 0x7fd34410e790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009ca0 tx=0x7fd33c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 -- 172.21.15.1:0/2875985366 shutdown_connections 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 --2- 172.21.15.1:0/2875985366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd34410c2f0 0x7fd34410e790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 --2- 172.21.15.1:0/2875985366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3441037a0 0x7fd34410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 --2- 172.21.15.1:0/2875985366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd344102df0 0x7fd3441031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 -- 172.21.15.1:0/2875985366 >> 172.21.15.1:0/2875985366 conn(0x7fd3440fc7d0 msgr2=0x7fd3440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 -- 172.21.15.1:0/2875985366 shutdown_connections 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.320+0000 7fd34b875640 1 -- 172.21.15.1:0/2875985366 wait complete. 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.321+0000 7fd34b875640 1 Processor -- start 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.321+0000 7fd34b875640 1 -- start start 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 0x7fd3441a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3441037a0 0x7fd3441a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34410c2f0 0x7fd34419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd344112110 con 0x7fd344102df0 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd344111f90 con 0x7fd3441037a0 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd34b875640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd344112290 con 0x7fd34410c2f0 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 0x7fd3441a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 0x7fd3441a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59142/0 (socket says 172.21.15.1:59142) 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 -- 172.21.15.1:0/1226210223 learned_addr learned my addr 172.21.15.1:0/1226210223 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349e12640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34410c2f0 0x7fd34419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd348e10640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3441037a0 0x7fd3441a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 -- 172.21.15.1:0/1226210223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34410c2f0 msgr2=0x7fd34419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd34410c2f0 0x7fd34419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 -- 172.21.15.1:0/1226210223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3441037a0 msgr2=0x7fd3441a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3441037a0 0x7fd3441a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.322+0000 7fd349611640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34419ad20 con 0x7fd344102df0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd349611640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 0x7fd3441a0430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd34000bec0 tx=0x7fd34000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34001c070 con 0x7fd344102df0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd34001a070 con 0x7fd344102df0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340009b50 con 0x7fd344102df0 2024-09-19T05:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34419b010 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.323+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd344103b80 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.324+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd344102480 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.325+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd340009cf0 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.326+0000 7fd33a7fc640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3300a32d0 0x7fd3300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.326+0000 7fd348e10640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3300a32d0 0x7fd3300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.326+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd3400d7c40 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd33a7fc640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] conn(0x7fd3300ae4a0 0x7fd3300b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3300b1010 con 0x7fd3300ae4a0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd3400dc2a0 con 0x7fd344102df0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd348e10640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3300a32d0 0x7fd3300a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd34410ec60 tx=0x7fd33400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd349e12640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] conn(0x7fd3300ae4a0 0x7fd3300b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.327+0000 7fd349e12640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] conn(0x7fd3300ae4a0 0x7fd3300b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.328+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== osd.6 v2:172.21.15.1:6818/362262349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3300b1010 con 0x7fd3300ae4a0 2024-09-19T05:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.352+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 --> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd34406a790 con 0x7fd3300ae4a0 2024-09-19T05:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.352+0000 7fd33a7fc640 1 -- 172.21.15.1:0/1226210223 <== osd.6 v2:172.21.15.1:6818/362262349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd34406a790 con 0x7fd3300ae4a0 2024-09-19T05:20:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] conn(0x7fd3300ae4a0 msgr2=0x7fd3300b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] conn(0x7fd3300ae4a0 0x7fd3300b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3300a32d0 msgr2=0x7fd3300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3300a32d0 0x7fd3300a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd34410ec60 tx=0x7fd33400b390 comp rx=0 tx=0).stop 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 msgr2=0x7fd3441a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 --2- 172.21.15.1:0/1226210223 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd344102df0 0x7fd3441a0430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd34000bec0 tx=0x7fd34000dd20 comp rx=0 tx=0).stop 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd349e12640 1 -- 172.21.15.1:0/1226210223 reap_dead start 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 shutdown_connections 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 >> 172.21.15.1:0/1226210223 conn(0x7fd3440fc7d0 msgr2=0x7fd34410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 shutdown_connections 2024-09-19T05:20:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:13.353+0000 7fd34b875640 1 -- 172.21.15.1:0/1226210223 wait complete. 2024-09-19T05:20:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:14.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:13 smithi060 ceph-mon[35058]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-19T05:20:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:13 smithi082 ceph-mon[35195]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-19T05:20:14.064 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:13 smithi001 ceph-mon[30968]: pgmap v320: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 1 op/s 2024-09-19T05:20:14.099 INFO:teuthology.orchestra.run.smithi001.stdout:193273528373 2024-09-19T05:20:14.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- 172.21.15.1:0/2412475316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc102570 msgr2=0x7f37dc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 --2- 172.21.15.1:0/2412475316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc102570 0x7f37dc1029b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009900 tx=0x7f37c802a480 comp rx=0 tx=0).stop 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- 172.21.15.1:0/2412475316 shutdown_connections 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 --2- 172.21.15.1:0/2412475316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc102ef0 0x7f37dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 --2- 172.21.15.1:0/2412475316 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc102570 0x7f37dc1029b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 --2- 172.21.15.1:0/2412475316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc100e20 0x7f37dc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- 172.21.15.1:0/2412475316 >> 172.21.15.1:0/2412475316 conn(0x7f37dc0fc7d0 msgr2=0x7f37dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- 172.21.15.1:0/2412475316 shutdown_connections 2024-09-19T05:20:14.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- 172.21.15.1:0/2412475316 wait complete. 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 Processor -- start 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.819+0000 7f37e2e26640 1 -- start start 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 0x7f37dc1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc102570 0x7f37dc197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc102ef0 0x7f37dc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc110f80 con 0x7f37dc100e20 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc110e00 con 0x7f37dc102570 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc111100 con 0x7f37dc102ef0 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 0x7f37dc1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 0x7f37dc1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58554/0 (socket says 172.21.15.1:58554) 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 -- 172.21.15.1:0/214028467 learned_addr learned my addr 172.21.15.1:0/214028467 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37dbfff640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc102570 0x7f37dc197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:14.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e13c3640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc102ef0 0x7f37dc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 -- 172.21.15.1:0/214028467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc102ef0 msgr2=0x7f37dc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37dc102ef0 0x7f37dc19bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 -- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc102570 msgr2=0x7f37dc197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc102570 0x7f37dc197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc19c370 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37dbfff640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37dc102570 0x7f37dc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e0bc2640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 0x7f37dc1973c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37d000d950 tx=0x7f37d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0017070 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.820+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc19c660 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.821+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d0009c30 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.821+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d000f6b0 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.821+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc1a3f40 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.822+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37dc107300 con 0x7f37dc100e20 2024-09-19T05:20:14.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.823+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f37d00109d0 con 0x7f37dc100e20 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.823+0000 7f37d9ffb640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f37cc0a32d0 0x7f37cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f37d00cfe90 con 0x7f37dc100e20 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37dbfff640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f37cc0a32d0 0x7f37cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37d9ffb640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] conn(0x7f37cc0ae4a0 0x7f37cc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37cc0b1010 con 0x7f37cc0ae4a0 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f37d00d02e0 con 0x7f37dc100e20 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37dbfff640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f37cc0a32d0 0x7f37cc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0ffd90 tx=0x7f37c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.824+0000 7f37e13c3640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] conn(0x7f37cc0ae4a0 0x7f37cc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.825+0000 7f37e13c3640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] conn(0x7f37cc0ae4a0 0x7f37cc0b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:14.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.825+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== osd.4 v2:172.21.15.60:6808/2639203045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37cc0b1010 con 0x7f37cc0ae4a0 2024-09-19T05:20:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.840+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 --> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37dc1021b0 con 0x7f37cc0ae4a0 2024-09-19T05:20:14.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.840+0000 7f37d9ffb640 1 -- 172.21.15.1:0/214028467 <== osd.4 v2:172.21.15.60:6808/2639203045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f37dc1021b0 con 0x7f37cc0ae4a0 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.840+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] conn(0x7f37cc0ae4a0 msgr2=0x7f37cc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.840+0000 7f37e2e26640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] conn(0x7f37cc0ae4a0 0x7f37cc0b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f37cc0a32d0 msgr2=0x7f37cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f37cc0a32d0 0x7f37cc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0ffd90 tx=0x7f37c8005a20 comp rx=0 tx=0).stop 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 msgr2=0x7f37dc1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:14.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 --2- 172.21.15.1:0/214028467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37dc100e20 0x7f37dc1973c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f37d000d950 tx=0x7f37d000de10 comp rx=0 tx=0).stop 2024-09-19T05:20:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e13c3640 1 -- 172.21.15.1:0/214028467 reap_dead start 2024-09-19T05:20:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 shutdown_connections 2024-09-19T05:20:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 >> 172.21.15.1:0/214028467 conn(0x7f37dc0fc7d0 msgr2=0x7f37dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 shutdown_connections 2024-09-19T05:20:14.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:14.841+0000 7f37e2e26640 1 -- 172.21.15.1:0/214028467 wait complete. 2024-09-19T05:20:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:15 smithi001 ceph-mon[30968]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T05:20:16.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:15 smithi060 ceph-mon[35058]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T05:20:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:15 smithi082 ceph-mon[35195]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-19T05:20:16.631 INFO:teuthology.orchestra.run.smithi001.stdout:137438953535 2024-09-19T05:20:16.631 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 -- 172.21.15.1:0/3319771012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34101036e0 msgr2=0x7f3410107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 --2- 172.21.15.1:0/3319771012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34101036e0 0x7f3410107b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f340c009930 tx=0x7f340c02a420 comp rx=0 tx=0).stop 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 -- 172.21.15.1:0/3319771012 shutdown_connections 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 --2- 172.21.15.1:0/3319771012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 0x7f341010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 --2- 172.21.15.1:0/3319771012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34101036e0 0x7f3410107b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 --2- 172.21.15.1:0/3319771012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3410102d30 0x7f3410103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 -- 172.21.15.1:0/3319771012 >> 172.21.15.1:0/3319771012 conn(0x7f34100fc7d0 msgr2=0x7f34100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 -- 172.21.15.1:0/3319771012 shutdown_connections 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.802+0000 7f341816c640 1 -- 172.21.15.1:0/3319771012 wait complete. 2024-09-19T05:20:16.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 Processor -- start 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 -- start start 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 0x7f3410198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34101036e0 0x7f3410198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 0x7f341019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112140 con 0x7f3410102d30 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3410111fc0 con 0x7f34101036e0 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f341816c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34101122c0 con 0x7f34101082a0 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f3415f08640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 0x7f3410198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f3415f08640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 0x7f3410198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58574/0 (socket says 172.21.15.1:58574) 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.803+0000 7f3415f08640 1 -- 172.21.15.1:0/3344742314 learned_addr learned my addr 172.21.15.1:0/3344742314 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415707640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34101036e0 0x7f3410198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3416709640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 0x7f341019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 -- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 msgr2=0x7f341019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 0x7f341019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 -- 172.21.15.1:0/3344742314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34101036e0 msgr2=0x7f3410198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34101036e0 0x7f3410198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341019d6f0 con 0x7f3410102d30 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415707640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34101036e0 0x7f3410198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3416709640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34101082a0 0x7f341019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3415f08640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 0x7f3410198740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f340400b4a0 tx=0x7f340400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404014070 con 0x7f3410102d30 2024-09-19T05:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341019d9e0 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3404010af0 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404017d10 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.804+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34101a52c0 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.805+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3410062980 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.806+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3404017070 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.807+0000 7f3402ffd640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f33fc0a32d0 0x7f33fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.807+0000 7f3415707640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f33fc0a32d0 0x7f33fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.807+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f34040cf5f0 con 0x7f3410102d30 2024-09-19T05:20:16.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3402ffd640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] conn(0x7f33fc0ae4a0 0x7f33fc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3404011e50 con 0x7f33fc0ae4a0 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f34040cf9a0 con 0x7f3410102d30 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3415707640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f33fc0a32d0 0x7f33fc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a940 tx=0x7f340c032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3416709640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] conn(0x7f33fc0ae4a0 0x7f33fc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.808+0000 7f3416709640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] conn(0x7f33fc0ae4a0 0x7f33fc0b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:16.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.809+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== osd.8 v2:172.21.15.82:6816/500561278 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3404011e50 con 0x7f33fc0ae4a0 2024-09-19T05:20:16.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.823+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 --> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3410062e00 con 0x7f33fc0ae4a0 2024-09-19T05:20:16.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.824+0000 7f3402ffd640 1 -- 172.21.15.1:0/3344742314 <== osd.8 v2:172.21.15.82:6816/500561278 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3410062e00 con 0x7f33fc0ae4a0 2024-09-19T05:20:16.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] conn(0x7f33fc0ae4a0 msgr2=0x7f33fc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] conn(0x7f33fc0ae4a0 0x7f33fc0b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f33fc0a32d0 msgr2=0x7f33fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f33fc0a32d0 0x7f33fc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f340c02a940 tx=0x7f340c032d50 comp rx=0 tx=0).stop 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 msgr2=0x7f3410198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 --2- 172.21.15.1:0/3344742314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3410102d30 0x7f3410198740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f340400b4a0 tx=0x7f340400b960 comp rx=0 tx=0).stop 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f3416709640 1 -- 172.21.15.1:0/3344742314 reap_dead start 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 shutdown_connections 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 >> 172.21.15.1:0/3344742314 conn(0x7f34100fc7d0 msgr2=0x7f3410105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 shutdown_connections 2024-09-19T05:20:16.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:16.825+0000 7f341816c640 1 -- 172.21.15.1:0/3344742314 wait complete. 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- 172.21.15.1:0/2926989188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 msgr2=0x7f3c1c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 --2- 172.21.15.1:0/2926989188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c1029b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009900 tx=0x7f3c1002a480 comp rx=0 tx=0).stop 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- 172.21.15.1:0/2926989188 shutdown_connections 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 --2- 172.21.15.1:0/2926989188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c1c102ef0 0x7f3c1c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 --2- 172.21.15.1:0/2926989188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c1029b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 --2- 172.21.15.1:0/2926989188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c1c100e20 0x7f3c1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- 172.21.15.1:0/2926989188 >> 172.21.15.1:0/2926989188 conn(0x7f3c1c0fc7d0 msgr2=0x7f3c1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- 172.21.15.1:0/2926989188 shutdown_connections 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- 172.21.15.1:0/2926989188 wait complete. 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 Processor -- start 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.256+0000 7f3c22225640 1 -- start start 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c1c100e20 0x7f3c1c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c1c102ef0 0x7f3c1c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c110f50 con 0x7f3c1c102570 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c110dd0 con 0x7f3c1c100e20 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c22225640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1110d0 con 0x7f3c1c102ef0 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58584/0 (socket says 172.21.15.1:58584) 2024-09-19T05:20:17.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 -- 172.21.15.1:0/781491881 learned_addr learned my addr 172.21.15.1:0/781491881 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1bfff640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c1c102ef0 0x7f3c1c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1b7fe640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c1c100e20 0x7f3c1c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 -- 172.21.15.1:0/781491881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c1c102ef0 msgr2=0x7f3c1c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c1c102ef0 0x7f3c1c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 -- 172.21.15.1:0/781491881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c1c100e20 msgr2=0x7f3c1c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c1c100e20 0x7f3c1c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c1a69b0 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c1affd640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c0fd1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006010 tx=0x7f3c10003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.257+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1003f070 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.258+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c10031c30 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.258+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c1a6c40 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.258+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10035030 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.258+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c1a7120 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.258+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c1c0628c0 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.260+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3c10042070 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.260+0000 7f3c18ff9640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3c040a32d0 0x7f3c040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3c100f0eb0 con 0x7f3c1c102570 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c1b7fe640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3c040a32d0 0x7f3c040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:17.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c18ff9640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] conn(0x7f3c040ae4a0 0x7f3c040b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c040b1010 con 0x7f3c040ae4a0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f3c100f1300 con 0x7f3c1c102570 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c1bfff640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] conn(0x7f3c040ae4a0 0x7f3c040b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c1b7fe640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3c040a32d0 0x7f3c040a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005e10 tx=0x7f3c0c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.261+0000 7f3c1bfff640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] conn(0x7f3c040ae4a0 0x7f3c040b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.262+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== osd.3 v2:172.21.15.1:6810/1943710877 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c040b1010 con 0x7f3c040ae4a0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.275+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 --> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c1c062d40 con 0x7f3c040ae4a0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c18ff9640 1 -- 172.21.15.1:0/781491881 <== osd.3 v2:172.21.15.1:6810/1943710877 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c1c062d40 con 0x7f3c040ae4a0 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] conn(0x7f3c040ae4a0 msgr2=0x7f3c040b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] conn(0x7f3c040ae4a0 0x7f3c040b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3c040a32d0 msgr2=0x7f3c040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3c040a32d0 0x7f3c040a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c005e10 tx=0x7f3c0c005da0 comp rx=0 tx=0).stop 2024-09-19T05:20:17.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 msgr2=0x7f3c1c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 --2- 172.21.15.1:0/781491881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3c1c102570 0x7f3c1c0fd1c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006010 tx=0x7f3c10003c10 comp rx=0 tx=0).stop 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c1bfff640 1 -- 172.21.15.1:0/781491881 reap_dead start 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 shutdown_connections 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 >> 172.21.15.1:0/781491881 conn(0x7f3c1c0fc7d0 msgr2=0x7f3c1c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 shutdown_connections 2024-09-19T05:20:17.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.276+0000 7f3c22225640 1 -- 172.21.15.1:0/781491881 wait complete. 2024-09-19T05:20:17.718 INFO:teuthology.orchestra.run.smithi001.stdout:244813135915 2024-09-19T05:20:17.718 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T05:20:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:17 smithi060 ceph-mon[35058]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:17 smithi082 ceph-mon[35195]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:18.025 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:17 smithi001 ceph-mon[30968]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:18.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- 172.21.15.1:0/648678865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf4102d80 msgr2=0x7f2cf4103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/648678865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf4102d80 0x7f2cf4103160 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009900 tx=0x7f2cf002a480 comp rx=0 tx=0).stop 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- 172.21.15.1:0/648678865 shutdown_connections 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/648678865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cf410c160 0x7f2cf410e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/648678865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf41036a0 0x7f2cf410bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/648678865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf4102d80 0x7f2cf4103160 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- 172.21.15.1:0/648678865 >> 172.21.15.1:0/648678865 conn(0x7f2cf40fc780 msgr2=0x7f2cf40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- 172.21.15.1:0/648678865 shutdown_connections 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- 172.21.15.1:0/648678865 wait complete. 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 Processor -- start 2024-09-19T05:20:18.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.510+0000 7f2cfb13b640 1 -- start start 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cf4102d80 0x7f2cf41009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf41036a0 0x7f2cf4100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 0x7f2cf4101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4111f40 con 0x7f2cf410c160 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4111dc0 con 0x7f2cf4102d80 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cfb13b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf41120c0 con 0x7f2cf41036a0 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 0x7f2cf4101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 0x7f2cf4101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58620/0 (socket says 172.21.15.1:58620) 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 -- 172.21.15.1:0/2696813251 learned_addr learned my addr 172.21.15.1:0/2696813251 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf8ed7640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cf4102d80 0x7f2cf41009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cebfff640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf41036a0 0x7f2cf4100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:18.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 -- 172.21.15.1:0/2696813251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf41036a0 msgr2=0x7f2cf4100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cf41036a0 0x7f2cf4100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 -- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cf4102d80 msgr2=0x7f2cf41009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2cf4102d80 0x7f2cf41009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf41a6870 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2cf96d8640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 0x7f2cf4101460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00cad0 tx=0x7f2cec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.511+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00ae20 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.512+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cec005020 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.512+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf41a6b60 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.512+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec00f6f0 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.512+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf41a70a0 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.513+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cf40628c0 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.514+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2cec0051d0 con 0x7f2cf410c160 2024-09-19T05:20:18.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.514+0000 7f2ce9ffb640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2cdc0a3350 0x7f2cdc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:18.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.514+0000 7f2cf8ed7640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2cdc0a3350 0x7f2cdc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:18.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.514+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f2cec0cfe50 con 0x7f2cf410c160 2024-09-19T05:20:18.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2ce9ffb640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] conn(0x7f2cdc0ae520 0x7f2cdc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:18.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cec004810 con 0x7f2cdc0ae520 2024-09-19T05:20:18.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f2cec0d2510 con 0x7f2cf410c160 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2cf8ed7640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2cdc0a3350 0x7f2cdc0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00096c0 tx=0x7f2cf0031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2cebfff640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] conn(0x7f2cdc0ae520 0x7f2cdc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.515+0000 7f2cebfff640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] conn(0x7f2cdc0ae520 0x7f2cdc0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.516+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== osd.10 v2:172.21.15.60:6824/1005024509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cec004810 con 0x7f2cdc0ae520 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.530+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 --> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2cf4062d40 con 0x7f2cdc0ae520 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.530+0000 7f2ce9ffb640 1 -- 172.21.15.1:0/2696813251 <== osd.10 v2:172.21.15.60:6824/1005024509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2cf4062d40 con 0x7f2cdc0ae520 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] conn(0x7f2cdc0ae520 msgr2=0x7f2cdc0b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] conn(0x7f2cdc0ae520 0x7f2cdc0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2cdc0a3350 msgr2=0x7f2cdc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2cdc0a3350 0x7f2cdc0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00096c0 tx=0x7f2cf0031490 comp rx=0 tx=0).stop 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 msgr2=0x7f2cf4101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 --2- 172.21.15.1:0/2696813251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2cf410c160 0x7f2cf4101460 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00cad0 tx=0x7f2cec00cf90 comp rx=0 tx=0).stop 2024-09-19T05:20:18.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cf96d8640 1 -- 172.21.15.1:0/2696813251 reap_dead start 2024-09-19T05:20:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 shutdown_connections 2024-09-19T05:20:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 >> 172.21.15.1:0/2696813251 conn(0x7f2cf40fc780 msgr2=0x7f2cf40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 shutdown_connections 2024-09-19T05:20:18.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:18.531+0000 7f2cfb13b640 1 -- 172.21.15.1:0/2696813251 wait complete. 2024-09-19T05:20:19.308 INFO:teuthology.orchestra.run.smithi001.stdout:292057776162 2024-09-19T05:20:19.309 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 -- 172.21.15.1:0/3997988870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448100e20 msgr2=0x7ff448101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 --2- 172.21.15.1:0/3997988870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448100e20 0x7ff448101200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009900 tx=0x7ff43c02a480 comp rx=0 tx=0).stop 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 -- 172.21.15.1:0/3997988870 shutdown_connections 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 --2- 172.21.15.1:0/3997988870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff448102ef0 0x7ff44810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 --2- 172.21.15.1:0/3997988870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff448102570 0x7ff4481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 --2- 172.21.15.1:0/3997988870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448100e20 0x7ff448101200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 -- 172.21.15.1:0/3997988870 >> 172.21.15.1:0/3997988870 conn(0x7ff4480fc7d0 msgr2=0x7ff4480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 -- 172.21.15.1:0/3997988870 shutdown_connections 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.484+0000 7ff44ed51640 1 -- 172.21.15.1:0/3997988870 wait complete. 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 Processor -- start 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 -- start start 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff448100e20 0x7ff448199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 0x7ff4481998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff448102ef0 0x7ff4481a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff448110f80 con 0x7ff448102570 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff448110e00 con 0x7ff448102ef0 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44ed51640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff448111100 con 0x7ff448100e20 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff447fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 0x7ff4481998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff447fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 0x7ff4481998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58632/0 (socket says 172.21.15.1:58632) 2024-09-19T05:20:19.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff447fff640 1 -- 172.21.15.1:0/2488550568 learned_addr learned my addr 172.21.15.1:0/2488550568 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.485+0000 7ff44caed640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff448100e20 0x7ff448199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff44d2ee640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff448102ef0 0x7ff4481a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 -- 172.21.15.1:0/2488550568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff448100e20 msgr2=0x7ff448199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff448100e20 0x7ff448199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 -- 172.21.15.1:0/2488550568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff448102ef0 msgr2=0x7ff4481a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff448102ef0 0x7ff4481a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4481a4920 con 0x7ff448102570 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff447fff640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 0x7ff4481998a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c890 tx=0x7ff43400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434004220 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4481a4af0 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4340043c0 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434004a00 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.486+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4481a5030 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.487+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff448062940 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.489+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff4340079b0 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff445ffb640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4380a32d0 0x7ff4380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff44caed640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4380a32d0 0x7ff4380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff4340cff60 con 0x7ff448102570 2024-09-19T05:20:19.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff445ffb640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] conn(0x7ff4380ae4a0 0x7ff4380b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff434008e50 con 0x7ff4380ae4a0 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff4340d0310 con 0x7ff448102570 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.490+0000 7ff44d2ee640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] conn(0x7ff4380ae4a0 0x7ff4380b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.491+0000 7ff44caed640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4380a32d0 0x7ff4380a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009230 tx=0x7ff43c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.491+0000 7ff44d2ee640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] conn(0x7ff4380ae4a0 0x7ff4380b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.491+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== osd.0 v2:172.21.15.1:6802/1004052295 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff434008e50 con 0x7ff4380ae4a0 2024-09-19T05:20:19.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.506+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 --> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff448062dc0 con 0x7ff4380ae4a0 2024-09-19T05:20:19.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff445ffb640 1 -- 172.21.15.1:0/2488550568 <== osd.0 v2:172.21.15.1:6802/1004052295 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff448062dc0 con 0x7ff4380ae4a0 2024-09-19T05:20:19.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] conn(0x7ff4380ae4a0 msgr2=0x7ff4380b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] conn(0x7ff4380ae4a0 0x7ff4380b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4380a32d0 msgr2=0x7ff4380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4380a32d0 0x7ff4380a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009230 tx=0x7ff43c0058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 msgr2=0x7ff4481998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 --2- 172.21.15.1:0/2488550568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff448102570 0x7ff4481998a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c890 tx=0x7ff43400cd50 comp rx=0 tx=0).stop 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44d2ee640 1 -- 172.21.15.1:0/2488550568 reap_dead start 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 shutdown_connections 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.507+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 >> 172.21.15.1:0/2488550568 conn(0x7ff4480fc7d0 msgr2=0x7ff4480fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.508+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 shutdown_connections 2024-09-19T05:20:19.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.508+0000 7ff44ed51640 1 -- 172.21.15.1:0/2488550568 wait complete. 2024-09-19T05:20:19.966 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:19 smithi001 ceph-mon[30968]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:19 smithi060 ceph-mon[35058]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:19 smithi082 ceph-mon[35195]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:20.352 INFO:teuthology.orchestra.run.smithi001.stdout:107374182467 2024-09-19T05:20:20.353 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T05:20:20.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 -- 172.21.15.1:0/1325049354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9554102d30 msgr2=0x7f9554103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 --2- 172.21.15.1:0/1325049354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9554102d30 0x7f9554103110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9544009930 tx=0x7f954402a420 comp rx=0 tx=0).stop 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 -- 172.21.15.1:0/1325049354 shutdown_connections 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 --2- 172.21.15.1:0/1325049354 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541082a0 0x7f955410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 --2- 172.21.15.1:0/1325049354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95541036e0 0x7f9554107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 --2- 172.21.15.1:0/1325049354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9554102d30 0x7f9554103110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.508+0000 7f955a067640 1 -- 172.21.15.1:0/1325049354 >> 172.21.15.1:0/1325049354 conn(0x7f95540fc7d0 msgr2=0x7f95540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.509+0000 7f955a067640 1 -- 172.21.15.1:0/1325049354 shutdown_connections 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.509+0000 7f955a067640 1 -- 172.21.15.1:0/1325049354 wait complete. 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.509+0000 7f955a067640 1 Processor -- start 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.509+0000 7f955a067640 1 -- start start 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9554102d30 0x7f9554100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541036e0 0x7f9554100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 0x7f9554101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95541120a0 con 0x7f95541082a0 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9554111f20 con 0x7f95541036e0 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9554112220 con 0x7f9554102d30 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 0x7f9554101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 0x7f9554101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58674/0 (socket says 172.21.15.1:58674) 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 -- 172.21.15.1:0/3215722369 learned_addr learned my addr 172.21.15.1:0/3215722369 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f95537fe640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9554102d30 0x7f9554100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9552ffd640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541036e0 0x7f9554100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 -- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9554102d30 msgr2=0x7f9554100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9554102d30 0x7f9554100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 -- 172.21.15.1:0/3215722369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541036e0 msgr2=0x7f9554100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541036e0 0x7f9554100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541a6a70 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9552ffd640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95541036e0 0x7f9554100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9553fff640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 0x7f9554101410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f954c00cad0 tx=0x7f954c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c00ae20 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f954c005020 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95541a6d60 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.510+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c00f6f0 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.511+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95541a7250 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.511+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95540628c0 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.513+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f954c0051d0 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9550ff9640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f953c0a32d0 0x7f953c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f95537fe640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f953c0a32d0 0x7f953c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f954c0d0260 con 0x7f95541082a0 2024-09-19T05:20:20.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9550ff9640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] conn(0x7f953c0ae4a0 0x7f953c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f953c0b1010 con 0x7f953c0ae4a0 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f954c0d06b0 con 0x7f95541082a0 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f9552ffd640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] conn(0x7f953c0ae4a0 0x7f953c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.514+0000 7f95537fe640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f953c0a32d0 0x7f953c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f9544005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.515+0000 7f9552ffd640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] conn(0x7f953c0ae4a0 0x7f953c0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.516+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== osd.11 v2:172.21.15.82:6824/2019890108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f953c0b1010 con 0x7f953c0ae4a0 2024-09-19T05:20:20.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.529+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 --> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9554062cf0 con 0x7f953c0ae4a0 2024-09-19T05:20:20.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.530+0000 7f9550ff9640 1 -- 172.21.15.1:0/3215722369 <== osd.11 v2:172.21.15.82:6824/2019890108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9554062cf0 con 0x7f953c0ae4a0 2024-09-19T05:20:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] conn(0x7f953c0ae4a0 msgr2=0x7f953c0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] conn(0x7f953c0ae4a0 0x7f953c0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f953c0a32d0 msgr2=0x7f953c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f953c0a32d0 0x7f953c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f9544005a20 comp rx=0 tx=0).stop 2024-09-19T05:20:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 msgr2=0x7f9554101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 --2- 172.21.15.1:0/3215722369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95541082a0 0x7f9554101410 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f954c00cad0 tx=0x7f954c00cf90 comp rx=0 tx=0).stop 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f9553fff640 1 -- 172.21.15.1:0/3215722369 reap_dead start 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 shutdown_connections 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 >> 172.21.15.1:0/3215722369 conn(0x7f95540fc7d0 msgr2=0x7f9554105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 shutdown_connections 2024-09-19T05:20:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:20.531+0000 7f955a067640 1 -- 172.21.15.1:0/3215722369 wait complete. 2024-09-19T05:20:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 -- 172.21.15.1:0/1402005997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 msgr2=0x7fa05c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 --2- 172.21.15.1:0/1402005997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c101200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa044009900 tx=0x7fa04402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 -- 172.21.15.1:0/1402005997 shutdown_connections 2024-09-19T05:20:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 --2- 172.21.15.1:0/1402005997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa05c102ef0 0x7fa05c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 --2- 172.21.15.1:0/1402005997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05c102570 0x7fa05c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 --2- 172.21.15.1:0/1402005997 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c101200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 -- 172.21.15.1:0/1402005997 >> 172.21.15.1:0/1402005997 conn(0x7fa05c0fc7d0 msgr2=0x7fa05c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 -- 172.21.15.1:0/1402005997 shutdown_connections 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.889+0000 7fa061444640 1 -- 172.21.15.1:0/1402005997 wait complete. 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 Processor -- start 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 -- start start 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05c102570 0x7fa05c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa05c102ef0 0x7fa05c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1120b0 con 0x7fa05c100e20 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c111f30 con 0x7fa05c102ef0 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa061444640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c112230 con 0x7fa05c102570 2024-09-19T05:20:20.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.890+0000 7fa05affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58596/0 (socket says 172.21.15.1:58596) 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 -- 172.21.15.1:0/557668440 learned_addr learned my addr 172.21.15.1:0/557668440 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05a7fc640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05c102570 0x7fa05c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05b7fe640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa05c102ef0 0x7fa05c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 -- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05c102570 msgr2=0x7fa05c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa05c102570 0x7fa05c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 -- 172.21.15.1:0/557668440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa05c102ef0 msgr2=0x7fa05c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa05c102ef0 0x7fa05c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c19d4d0 con 0x7fa05c100e20 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa05affd640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c198520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa044003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04403f070 con 0x7fa05c100e20 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa044031c30 con 0x7fa05c100e20 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c19d760 con 0x7fa05c100e20 2024-09-19T05:20:20.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044035030 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.891+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c1a50a0 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.892+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa05c062980 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa044042070 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa0480a32d0 0x7fa0480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa0440f0f00 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa05a7fc640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa0480a32d0 0x7fa0480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] conn(0x7fa0480ae4a0 0x7fa0480b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa044042e50 con 0x7fa0480ae4a0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.895+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa0440f12b0 con 0x7fa05c100e20 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.896+0000 7fa05b7fe640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] conn(0x7fa0480ae4a0 0x7fa0480b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.896+0000 7fa05a7fc640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa0480a32d0 0x7fa0480a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0ffe30 tx=0x7fa04c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.896+0000 7fa05b7fe640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] conn(0x7fa0480ae4a0 0x7fa0480b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.897+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== osd.2 v2:172.21.15.82:6800/1735149029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa044042e50 con 0x7fa0480ae4a0 2024-09-19T05:20:20.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.912+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 --> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa05c062e00 con 0x7fa0480ae4a0 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.913+0000 7fa053fff640 1 -- 172.21.15.1:0/557668440 <== osd.2 v2:172.21.15.82:6800/1735149029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa05c062e00 con 0x7fa0480ae4a0 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.913+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] conn(0x7fa0480ae4a0 msgr2=0x7fa0480b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.913+0000 7fa061444640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] conn(0x7fa0480ae4a0 0x7fa0480b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.913+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa0480a32d0 msgr2=0x7fa0480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.913+0000 7fa061444640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa0480a32d0 0x7fa0480a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0ffe30 tx=0x7fa04c00b390 comp rx=0 tx=0).stop 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 msgr2=0x7fa05c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 --2- 172.21.15.1:0/557668440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa05c100e20 0x7fa05c198520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa044003c10 comp rx=0 tx=0).stop 2024-09-19T05:20:20.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa05b7fe640 1 -- 172.21.15.1:0/557668440 reap_dead start 2024-09-19T05:20:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 shutdown_connections 2024-09-19T05:20:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 >> 172.21.15.1:0/557668440 conn(0x7fa05c0fc7d0 msgr2=0x7fa05c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 shutdown_connections 2024-09-19T05:20:20.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:17.914+0000 7fa061444640 1 -- 172.21.15.1:0/557668440 wait complete. 2024-09-19T05:20:21.348 INFO:teuthology.orchestra.run.smithi001.stdout:77309411402 2024-09-19T05:20:21.349 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T05:20:21.961 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:21 smithi001 ceph-mon[30968]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:21 smithi060 ceph-mon[35058]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:21 smithi082 ceph-mon[35195]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 -- 172.21.15.1:0/4091183845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 msgr2=0x7fbe3410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 --2- 172.21.15.1:0/4091183845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3410e600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009ca0 tx=0x7fbe2c02a950 comp rx=0 tx=0).stop 2024-09-19T05:20:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 -- 172.21.15.1:0/4091183845 shutdown_connections 2024-09-19T05:20:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 --2- 172.21.15.1:0/4091183845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3410e600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 --2- 172.21.15.1:0/4091183845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe341036c0 0x7fbe3410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 --2- 172.21.15.1:0/4091183845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe34102da0 0x7fbe34103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 -- 172.21.15.1:0/4091183845 >> 172.21.15.1:0/4091183845 conn(0x7fbe340fc7a0 msgr2=0x7fbe340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 -- 172.21.15.1:0/4091183845 shutdown_connections 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.043+0000 7fbe392e9640 1 -- 172.21.15.1:0/4091183845 wait complete. 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 Processor -- start 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 -- start start 2024-09-19T05:20:22.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe34102da0 0x7fbe34198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe341036c0 0x7fbe341988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe34111f20 con 0x7fbe3410c180 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe34111da0 con 0x7fbe34102da0 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe392e9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe341120a0 con 0x7fbe341036c0 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe337fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58690/0 (socket says 172.21.15.1:58690) 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe337fe640 1 -- 172.21.15.1:0/104542378 learned_addr learned my addr 172.21.15.1:0/104542378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:22.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe32ffd640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe34102da0 0x7fbe34198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe2a7fc640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe341036c0 0x7fbe341988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe337fe640 1 -- 172.21.15.1:0/104542378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe341036c0 msgr2=0x7fbe341988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.044+0000 7fbe337fe640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe341036c0 0x7fbe341988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe337fe640 1 -- 172.21.15.1:0/104542378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe34102da0 msgr2=0x7fbe34198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe337fe640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe34102da0 0x7fbe34198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe337fe640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3419d310 con 0x7fbe3410c180 2024-09-19T05:20:22.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe32ffd640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe34102da0 0x7fbe34198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe337fe640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3419cc30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004af0 tx=0x7fbe2c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c034040 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe2c030920 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3419d5a0 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c004740 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.045+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe341a4ee0 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.046+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe34062980 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.047+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbe2c037020 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe30ff9640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe200a3350 0x7fbe200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe32ffd640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe200a3350 0x7fbe200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbe2c0f0e60 con 0x7fbe3410c180 2024-09-19T05:20:22.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe30ff9640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] conn(0x7fbe200ae520 0x7fbe200b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe2c033e50 con 0x7fbe200ae520 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fbe2c0f1210 con 0x7fbe3410c180 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe2a7fc640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] conn(0x7fbe200ae520 0x7fbe200b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.048+0000 7fbe32ffd640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe200a3350 0x7fbe200a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400afb0 tx=0x7fbe2400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.049+0000 7fbe2a7fc640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] conn(0x7fbe200ae520 0x7fbe200b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.049+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== osd.9 v2:172.21.15.1:6826/2188836925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe2c033e50 con 0x7fbe200ae520 2024-09-19T05:20:22.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.063+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 --> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe34062db0 con 0x7fbe200ae520 2024-09-19T05:20:22.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.063+0000 7fbe30ff9640 1 -- 172.21.15.1:0/104542378 <== osd.9 v2:172.21.15.1:6826/2188836925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbe34062db0 con 0x7fbe200ae520 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] conn(0x7fbe200ae520 msgr2=0x7fbe200b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] conn(0x7fbe200ae520 0x7fbe200b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe200a3350 msgr2=0x7fbe200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbe200a3350 0x7fbe200a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400afb0 tx=0x7fbe2400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 msgr2=0x7fbe3419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 --2- 172.21.15.1:0/104542378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe3410c180 0x7fbe3419cc30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004af0 tx=0x7fbe2c02f5b0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe337fe640 1 -- 172.21.15.1:0/104542378 reap_dead start 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 shutdown_connections 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 >> 172.21.15.1:0/104542378 conn(0x7fbe340fc7a0 msgr2=0x7fbe340fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:22.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 shutdown_connections 2024-09-19T05:20:22.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:22.064+0000 7fbe392e9640 1 -- 172.21.15.1:0/104542378 wait complete. 2024-09-19T05:20:22.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 -- 172.21.15.1:0/2895944689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 msgr2=0x7f58601029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 --2- 172.21.15.1:0/2895944689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f58601029b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5854009900 tx=0x7f585402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:22.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 -- 172.21.15.1:0/2895944689 shutdown_connections 2024-09-19T05:20:22.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 --2- 172.21.15.1:0/2895944689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5860102ef0 0x7f586010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 --2- 172.21.15.1:0/2895944689 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f58601029b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 --2- 172.21.15.1:0/2895944689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5860100e20 0x7f5860101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 -- 172.21.15.1:0/2895944689 >> 172.21.15.1:0/2895944689 conn(0x7f58600fc7d0 msgr2=0x7f58600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 -- 172.21.15.1:0/2895944689 shutdown_connections 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.715+0000 7f5865cba640 1 -- 172.21.15.1:0/2895944689 wait complete. 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 Processor -- start 2024-09-19T05:20:22.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 -- start start 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5860100e20 0x7f5860198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f5860198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5860102ef0 0x7f586019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5860110fa0 con 0x7f5860102570 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5860110e20 con 0x7f5860100e20 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.716+0000 7f5865cba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5860111120 con 0x7f5860102ef0 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f5860198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f5860198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58656/0 (socket says 172.21.15.1:58656) 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 -- 172.21.15.1:0/3797650916 learned_addr learned my addr 172.21.15.1:0/3797650916 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:22.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585ffff640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5860102ef0 0x7f586019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585f7fe640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5860100e20 0x7f5860198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 -- 172.21.15.1:0/3797650916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5860102ef0 msgr2=0x7f586019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5860102ef0 0x7f586019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 -- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5860100e20 msgr2=0x7f5860198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5860100e20 0x7f5860198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586019d4e0 con 0x7f5860102570 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585effd640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f5860198a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5854006010 tx=0x7f5854003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585403f070 con 0x7f5860102570 2024-09-19T05:20:22.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5854031c30 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586019d770 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854035030 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.717+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58601a50b0 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.718+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5860062980 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.719+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5854042070 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585cff9640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f58480a32d0 0x7f58480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585f7fe640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f58480a32d0 0x7f58480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f58540f0e00 con 0x7f5860102570 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585cff9640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] conn(0x7f58480ae4a0 0x7f58480b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5854005640 con 0x7f58480ae4a0 2024-09-19T05:20:22.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.720+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f58540f11b0 con 0x7f5860102570 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.721+0000 7f585f7fe640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f58480a32d0 0x7f58480a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5850009990 tx=0x7f5850009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.721+0000 7f585ffff640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] conn(0x7f58480ae4a0 0x7f58480b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.721+0000 7f585ffff640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] conn(0x7f58480ae4a0 0x7f58480b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.722+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== osd.7 v2:172.21.15.60:6816/2153188266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5854005640 con 0x7f58480ae4a0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.736+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 --> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5860062e00 con 0x7f58480ae4a0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f585cff9640 1 -- 172.21.15.1:0/3797650916 <== osd.7 v2:172.21.15.60:6816/2153188266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5860062e00 con 0x7f58480ae4a0 2024-09-19T05:20:22.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] conn(0x7f58480ae4a0 msgr2=0x7f58480b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] conn(0x7f58480ae4a0 0x7f58480b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f58480a32d0 msgr2=0x7f58480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f58480a32d0 0x7f58480a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5850009990 tx=0x7f5850009110 comp rx=0 tx=0).stop 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 msgr2=0x7f5860198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 --2- 172.21.15.1:0/3797650916 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5860102570 0x7f5860198a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5854006010 tx=0x7f5854003c10 comp rx=0 tx=0).stop 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f585ffff640 1 -- 172.21.15.1:0/3797650916 reap_dead start 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 shutdown_connections 2024-09-19T05:20:22.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 >> 172.21.15.1:0/3797650916 conn(0x7f58600fc7d0 msgr2=0x7f586006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 shutdown_connections 2024-09-19T05:20:22.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:19.737+0000 7f5865cba640 1 -- 172.21.15.1:0/3797650916 wait complete. 2024-09-19T05:20:22.896 INFO:teuthology.orchestra.run.smithi001.stdout:322122547229 2024-09-19T05:20:22.896 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T05:20:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:23 smithi001 ceph-mon[30968]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:24.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:23 smithi060 ceph-mon[35058]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:23 smithi082 ceph-mon[35195]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:24.059 INFO:teuthology.orchestra.run.smithi001.stdout:214748364849 2024-09-19T05:20:24.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T05:20:24.515 INFO:teuthology.orchestra.run.smithi001.stdout:274877906983 2024-09-19T05:20:24.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T05:20:24.977 INFO:teuthology.orchestra.run.smithi001.stdout:34359738451 2024-09-19T05:20:24.977 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T05:20:25.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 -- 172.21.15.1:0/2568850185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd4102d30 msgr2=0x7f8cd4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2568850185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd4102d30 0x7f8cd4103110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009cd0 tx=0x7f8cc402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 -- 172.21.15.1:0/2568850185 shutdown_connections 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2568850185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd41082a0 0x7f8cd410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2568850185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41036e0 0x7f8cd4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2568850185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd4102d30 0x7f8cd4103110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 -- 172.21.15.1:0/2568850185 >> 172.21.15.1:0/2568850185 conn(0x7f8cd40fc7d0 msgr2=0x7f8cd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 -- 172.21.15.1:0/2568850185 shutdown_connections 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 -- 172.21.15.1:0/2568850185 wait complete. 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.335+0000 7f8cd9586640 1 Processor -- start 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 -- start start 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd4102d30 0x7f8cd4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 0x7f8cd4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41082a0 0x7f8cd419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:25.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41120a0 con 0x7f8cd41036e0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4111f20 con 0x7f8cd4102d30 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd9586640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4112220 con 0x7f8cd41082a0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 0x7f8cd4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 0x7f8cd4198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37050/0 (socket says 172.21.15.1:37050) 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 -- 172.21.15.1:0/2999350174 learned_addr learned my addr 172.21.15.1:0/2999350174 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd37fe640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41082a0 0x7f8cd419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd2ffd640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd4102d30 0x7f8cd4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 -- 172.21.15.1:0/2999350174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41082a0 msgr2=0x7f8cd419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cd41082a0 0x7f8cd419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 -- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd4102d30 msgr2=0x7f8cd4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8cd4102d30 0x7f8cd4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd419d5d0 con 0x7f8cd41036e0 2024-09-19T05:20:25.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.336+0000 7f8cd27fc640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 0x7f8cd4198b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800d750 tx=0x7f8cc800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.337+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8017070 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.337+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cc8005500 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.337+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd419d8c0 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.337+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8004e00 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.337+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41a51a0 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.338+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cd4062980 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.339+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8cc8004fa0 con 0x7f8cd41036e0 2024-09-19T05:20:25.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cbbfff640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8cbc0a3350 0x7f8cbc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cd2ffd640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8cbc0a3350 0x7f8cbc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f8cc80cfc00 con 0x7f8cd41036e0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cbbfff640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] conn(0x7f8cbc0ae520 0x7f8cbc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cc8001d30 con 0x7f8cbc0ae520 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f8cc80cffb0 con 0x7f8cd41036e0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cd2ffd640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8cbc0a3350 0x7f8cbc0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006010 tx=0x7f8cc40093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.340+0000 7f8cd37fe640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] conn(0x7f8cbc0ae520 0x7f8cbc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.341+0000 7f8cd37fe640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] conn(0x7f8cbc0ae520 0x7f8cbc0b09c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.342+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== osd.1 v2:172.21.15.60:6800/2687395785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cc8001d30 con 0x7f8cbc0ae520 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.355+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 --> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cd4062e00 con 0x7f8cbc0ae520 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cbbfff640 1 -- 172.21.15.1:0/2999350174 <== osd.1 v2:172.21.15.60:6800/2687395785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8cd4062e00 con 0x7f8cbc0ae520 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] conn(0x7f8cbc0ae520 msgr2=0x7f8cbc0b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] conn(0x7f8cbc0ae520 0x7f8cbc0b09c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8cbc0a3350 msgr2=0x7f8cbc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8cbc0a3350 0x7f8cbc0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4006010 tx=0x7f8cc40093f0 comp rx=0 tx=0).stop 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 msgr2=0x7f8cd4198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 --2- 172.21.15.1:0/2999350174 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd41036e0 0x7f8cd4198b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8cc800d750 tx=0x7f8cc800dc10 comp rx=0 tx=0).stop 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd37fe640 1 -- 172.21.15.1:0/2999350174 reap_dead start 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 shutdown_connections 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 >> 172.21.15.1:0/2999350174 conn(0x7f8cd40fc7d0 msgr2=0x7f8cd4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 shutdown_connections 2024-09-19T05:20:25.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:25.356+0000 7f8cd9586640 1 -- 172.21.15.1:0/2999350174 wait complete. 2024-09-19T05:20:25.607 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:25 smithi060 ceph-mon[35058]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:25 smithi082 ceph-mon[35195]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:26.027 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:25 smithi001 ceph-mon[30968]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:26.053 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.054 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.062 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.066 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.071 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.083 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:26.094 INFO:teuthology.orchestra.run.smithi001.stdout:55834574927 2024-09-19T05:20:26.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T05:20:27.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 -- 172.21.15.1:0/1774706010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c103ff0 msgr2=0x7f931c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 --2- 172.21.15.1:0/1774706010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c103ff0 0x7f931c1043d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f930c009ca0 tx=0x7f930c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 -- 172.21.15.1:0/1774706010 shutdown_connections 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 --2- 172.21.15.1:0/1774706010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c109120 0x7f931c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 --2- 172.21.15.1:0/1774706010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 --2- 172.21.15.1:0/1774706010 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c103ff0 0x7f931c1043d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 -- 172.21.15.1:0/1774706010 >> 172.21.15.1:0/1774706010 conn(0x7f931c0ffab0 msgr2=0x7f931c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 -- 172.21.15.1:0/1774706010 shutdown_connections 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.967+0000 7f93243a7640 1 -- 172.21.15.1:0/1774706010 wait complete. 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 Processor -- start 2024-09-19T05:20:27.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 -- start start 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 0x7f931c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1141a0 con 0x7f931c109120 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f931c114020 con 0x7f931c1049a0 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f93243a7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f931c114320 con 0x7f931c103ff0 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f9322944640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f9322944640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37076/0 (socket says 172.21.15.1:37076) 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f9322944640 1 -- 172.21.15.1:0/3622942274 learned_addr learned my addr 172.21.15.1:0/3622942274 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f9322143640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 0x7f931c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.968+0000 7f9321942640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:27.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 -- 172.21.15.1:0/3622942274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 msgr2=0x7f931c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 0x7f931c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 -- 172.21.15.1:0/3622942274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 msgr2=0x7f931c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 -- 172.21.15.1:0/3622942274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c19f620 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9321942640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322143640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 0x7f931c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f9322944640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9314009fd0 tx=0x7f931400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314011830 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9314016070 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c19f910 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931400f2e0 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.969+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c1a71f0 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.970+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c1043d0 con 0x7f931c109120 2024-09-19T05:20:27.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.971+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f93140119d0 con 0x7f931c109120 2024-09-19T05:20:27.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.972+0000 7f931b7fe640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 0x7f93040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:27.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.972+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f93140cf360 con 0x7f931c109120 2024-09-19T05:20:27.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.972+0000 7f9322143640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 0x7f93040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:27.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.973+0000 7f9322143640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 0x7f93040a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f930c006010 tx=0x7f930c005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:27.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.976+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f931409bc70 con 0x7f931c109120 2024-09-19T05:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.159+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f931c10bd70 con 0x7f931c109120 2024-09-19T05:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.159+0000 7f931b7fe640 1 -- 172.21.15.1:0/3622942274 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f93140bb070 con 0x7f931c109120 2024-09-19T05:20:27.161 INFO:teuthology.orchestra.run.smithi001.stdout:244813135917 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 msgr2=0x7f93040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 0x7f93040a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f930c006010 tx=0x7f930c005f30 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 msgr2=0x7f931c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9314009fd0 tx=0x7f931400b8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 shutdown_connections 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f93040a3350 0x7f93040a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f931c109120 0x7f931c19ef40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f931c1049a0 0x7f931c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 --2- 172.21.15.1:0/3622942274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f931c103ff0 0x7f931c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 >> 172.21.15.1:0/3622942274 conn(0x7f931c0ffab0 msgr2=0x7f931c100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:27.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 shutdown_connections 2024-09-19T05:20:27.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.161+0000 7f93243a7640 1 -- 172.21.15.1:0/3622942274 wait complete. 2024-09-19T05:20:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:27 smithi060 ceph-mon[35058]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3685958425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:20:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3622942274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:20:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:27 smithi082 ceph-mon[35195]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3685958425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:20:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3622942274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:20:28.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:27 smithi001 ceph-mon[30968]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T05:20:28.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3685958425' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:20:28.033 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3622942274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:20:28.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135915 got 244813135917 for osd.8 2024-09-19T05:20:28.062 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- 172.21.15.1:0/276283452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81082a0 msgr2=0x7f2fa810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 --2- 172.21.15.1:0/276283452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81082a0 0x7f2fa810ec40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0009cd0 tx=0x7f2fa002a910 comp rx=0 tx=0).stop 2024-09-19T05:20:28.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- 172.21.15.1:0/276283452 shutdown_connections 2024-09-19T05:20:28.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 --2- 172.21.15.1:0/276283452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81082a0 0x7f2fa810ec40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 --2- 172.21.15.1:0/276283452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa81036e0 0x7f2fa8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 --2- 172.21.15.1:0/276283452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa8102d30 0x7f2fa8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- 172.21.15.1:0/276283452 >> 172.21.15.1:0/276283452 conn(0x7f2fa80fc7d0 msgr2=0x7f2fa80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:28.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- 172.21.15.1:0/276283452 shutdown_connections 2024-09-19T05:20:28.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- 172.21.15.1:0/276283452 wait complete. 2024-09-19T05:20:28.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 Processor -- start 2024-09-19T05:20:28.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.469+0000 7f2fae555640 1 -- start start 2024-09-19T05:20:28.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 0x7f2fa8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa81082a0 0x7f2fa819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa81120e0 con 0x7f2fa81036e0 2024-09-19T05:20:28.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8111f60 con 0x7f2fa81082a0 2024-09-19T05:20:28.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fae555640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8112260 con 0x7f2fa8102d30 2024-09-19T05:20:28.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37094/0 (socket says 172.21.15.1:37094) 2024-09-19T05:20:28.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 -- 172.21.15.1:0/2645665638 learned_addr learned my addr 172.21.15.1:0/2645665638 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:28.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2facaf2640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa81082a0 0x7f2fa819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa7fff640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 0x7f2fa8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 -- 172.21.15.1:0/2645665638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 msgr2=0x7f2fa8198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 0x7f2fa8198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 -- 172.21.15.1:0/2645665638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa81082a0 msgr2=0x7f2fa819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa81082a0 0x7f2fa819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 -- 172.21.15.1:0/2645665638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa819d5d0 con 0x7f2fa81036e0 2024-09-19T05:20:28.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa7fff640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 0x7f2fa8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:28.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa77fe640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c006fd0 tx=0x7f2f9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:28.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.470+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c011830 con 0x7f2fa81036e0 2024-09-19T05:20:28.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.471+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f9c016070 con 0x7f2fa81036e0 2024-09-19T05:20:28.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.471+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa819d8c0 con 0x7f2fa81036e0 2024-09-19T05:20:28.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.471+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00f2e0 con 0x7f2fa81036e0 2024-09-19T05:20:28.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.471+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa81a51a0 con 0x7f2fa81036e0 2024-09-19T05:20:28.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.472+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa8103110 con 0x7f2fa81036e0 2024-09-19T05:20:28.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.473+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2f9c01b460 con 0x7f2fa81036e0 2024-09-19T05:20:28.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.474+0000 7f2fa57fa640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 0x7f2f900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.474+0000 7f2fa7fff640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 0x7f2f900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.474+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f2f9c0cf3b0 con 0x7f2fa81036e0 2024-09-19T05:20:28.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.474+0000 7f2fa7fff640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 0x7f2f900a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f980058c0 tx=0x7f2f98005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:28.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.478+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f9c09bd20 con 0x7f2fa81036e0 2024-09-19T05:20:28.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- 172.21.15.1:0/924545381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 msgr2=0x7f65081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 --2- 172.21.15.1:0/924545381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081067e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009900 tx=0x7f64f802a410 comp rx=0 tx=0).stop 2024-09-19T05:20:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- 172.21.15.1:0/924545381 shutdown_connections 2024-09-19T05:20:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 --2- 172.21.15.1:0/924545381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508106f10 0x7f650810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 --2- 172.21.15.1:0/924545381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081067e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 --2- 172.21.15.1:0/924545381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508101de0 0x7f65081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- 172.21.15.1:0/924545381 >> 172.21.15.1:0/924545381 conn(0x7f65080fd8c0 msgr2=0x7f65080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- 172.21.15.1:0/924545381 shutdown_connections 2024-09-19T05:20:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- 172.21.15.1:0/924545381 wait complete. 2024-09-19T05:20:28.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 Processor -- start 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.850+0000 7f650f285640 1 -- start start 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 0x7f6508198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 0x7f650819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6508111f90 con 0x7f6508102790 2024-09-19T05:20:28.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6508111e10 con 0x7f6508106f10 2024-09-19T05:20:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650f285640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6508112110 con 0x7f6508101de0 2024-09-19T05:20:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37062/0 (socket says 172.21.15.1:37062) 2024-09-19T05:20:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 -- 172.21.15.1:0/3685958425 learned_addr learned my addr 172.21.15.1:0/3685958425 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:28.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650d822640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 0x7f650819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650d021640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 0x7f6508198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 -- 172.21.15.1:0/3685958425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 msgr2=0x7f6508198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 0x7f6508198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 -- 172.21.15.1:0/3685958425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 msgr2=0x7f650819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 0x7f650819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 -- 172.21.15.1:0/3685958425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650819d420 con 0x7f6508102790 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650d822640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 0x7f650819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650d021640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 0x7f6508198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.851+0000 7f650c820640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f64f8006010 tx=0x7f64f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.852+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f803f030 con 0x7f6508102790 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.852+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64f8003ce0 con 0x7f6508102790 2024-09-19T05:20:28.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.852+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650819d6b0 con 0x7f6508102790 2024-09-19T05:20:28.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.852+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8035070 con 0x7f6508102790 2024-09-19T05:20:28.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.852+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65081a4ff0 con 0x7f6508102790 2024-09-19T05:20:28.645 INFO:teuthology.orchestra.run.smithi001.stdout:193273528375 2024-09-19T05:20:28.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.853+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65081032c0 con 0x7f6508102790 2024-09-19T05:20:28.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.854+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f64f8042030 con 0x7f6508102790 2024-09-19T05:20:28.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.855+0000 7f64fe7fc640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 0x7f64f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:28.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.855+0000 7f650d021640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 0x7f64f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:28.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.855+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f64f80f0850 con 0x7f6508102790 2024-09-19T05:20:28.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.855+0000 7f650d021640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 0x7f64f40a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65040058c0 tx=0x7f6504005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:28.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:26.859+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64f80bd110 con 0x7f6508102790 2024-09-19T05:20:28.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.040+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f65081021c0 con 0x7f6508102790 2024-09-19T05:20:28.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.040+0000 7f64fe7fc640 1 -- 172.21.15.1:0/3685958425 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f65081021c0 con 0x7f6508102790 2024-09-19T05:20:28.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 msgr2=0x7f64f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 0x7f64f40a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65040058c0 tx=0x7f6504005850 comp rx=0 tx=0).stop 2024-09-19T05:20:28.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 msgr2=0x7f65081989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f64f8006010 tx=0x7f64f80042f0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 shutdown_connections 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f64f40a3350 0x7f64f40a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6508106f10 0x7f650819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6508102790 0x7f65081989b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 --2- 172.21.15.1:0/3685958425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6508101de0 0x7f6508198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.042+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 >> 172.21.15.1:0/3685958425 conn(0x7f65080fd8c0 msgr2=0x7f65080fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:28.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.043+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 shutdown_connections 2024-09-19T05:20:28.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:27.043+0000 7f650f285640 1 -- 172.21.15.1:0/3685958425 wait complete. 2024-09-19T05:20:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.663+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2fa810a2b0 con 0x7f2fa81036e0 2024-09-19T05:20:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.663+0000 7f2fa57fa640 1 -- 172.21.15.1:0/2645665638 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f9c09b620 con 0x7f2fa81036e0 2024-09-19T05:20:28.665 INFO:teuthology.orchestra.run.smithi001.stdout:137438953537 2024-09-19T05:20:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 msgr2=0x7f2f900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 0x7f2f900a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f980058c0 tx=0x7f2f98005ec0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 msgr2=0x7f2fa8198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c006fd0 tx=0x7f2f9c00b8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 shutdown_connections 2024-09-19T05:20:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2f900a32d0 0x7f2f900a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fa81082a0 0x7f2fa819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2fa81036e0 0x7f2fa8198b60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 --2- 172.21.15.1:0/2645665638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fa8102d30 0x7f2fa8198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 >> 172.21.15.1:0/2645665638 conn(0x7f2fa80fc7d0 msgr2=0x7f2fa8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 shutdown_connections 2024-09-19T05:20:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:28.665+0000 7f2fae555640 1 -- 172.21.15.1:0/2645665638 wait complete. 2024-09-19T05:20:29.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:28 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2645665638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:20:29.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:28 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2645665638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:20:29.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:28 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2645665638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:20:29.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 -- 172.21.15.1:0/832947902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 msgr2=0x7f0bd810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 --2- 172.21.15.1:0/832947902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd810ea90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009ca0 tx=0x7f0bd002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 -- 172.21.15.1:0/832947902 shutdown_connections 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 --2- 172.21.15.1:0/832947902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd810ea90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 --2- 172.21.15.1:0/832947902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 --2- 172.21.15.1:0/832947902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 0x7f0bd81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 -- 172.21.15.1:0/832947902 >> 172.21.15.1:0/832947902 conn(0x7f0bd80fd8c0 msgr2=0x7f0bd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 -- 172.21.15.1:0/832947902 shutdown_connections 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.512+0000 7f0be07d8640 1 -- 172.21.15.1:0/832947902 wait complete. 2024-09-19T05:20:29.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 Processor -- start 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 -- start start 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 0x7f0bd8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8111f70 con 0x7f0bd8106f10 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8111df0 con 0x7f0bd8102790 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0be07d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81120f0 con 0x7f0bd8101de0 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0bded75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0bded75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37106/0 (socket says 172.21.15.1:37106) 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0bded75640 1 -- 172.21.15.1:0/3135753139 learned_addr learned my addr 172.21.15.1:0/3135753139 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0bde574640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 0x7f0bd8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.513+0000 7f0bddd73640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 -- 172.21.15.1:0/3135753139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 msgr2=0x7f0bd8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 0x7f0bd8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 -- 172.21.15.1:0/3135753139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 msgr2=0x7f0bd81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 -- 172.21.15.1:0/3135753139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd819d340 con 0x7f0bd8106f10 2024-09-19T05:20:29.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bddd73640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bded75640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0031a20 tx=0x7f0bd0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0003b70 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bd0003d10 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd819d5d0 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd002fc80 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.514+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81a4f10 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.515+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd81021c0 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.516+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0bd00046a0 con 0x7f0bd8106f10 2024-09-19T05:20:29.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.517+0000 7f0bcf7fe640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 0x7f0bc40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.517+0000 7f0bde574640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 0x7f0bc40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.517+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0bd00f0ee0 con 0x7f0bd8106f10 2024-09-19T05:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.518+0000 7f0bde574640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 0x7f0bc40a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400abe0 tx=0x7f0bd400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.521+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0bd00bd8e0 con 0x7f0bd8106f10 2024-09-19T05:20:29.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.699+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0bd81a50e0 con 0x7f0bd8106f10 2024-09-19T05:20:29.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.699+0000 7f0bcf7fe640 1 -- 172.21.15.1:0/3135753139 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0bd00bd1e0 con 0x7f0bd8106f10 2024-09-19T05:20:29.875 INFO:teuthology.orchestra.run.smithi001.stdout:158913790013 2024-09-19T05:20:29.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 msgr2=0x7f0bc40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 0x7f0bc40a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400abe0 tx=0x7f0bd400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 msgr2=0x7f0bd819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0031a20 tx=0x7f0bd0031a50 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 shutdown_connections 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0bc40a3350 0x7f0bc40a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bd8106f10 0x7f0bd819cc60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd8102790 0x7f0bd81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 --2- 172.21.15.1:0/3135753139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd8101de0 0x7f0bd8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 >> 172.21.15.1:0/3135753139 conn(0x7f0bd80fd8c0 msgr2=0x7f0bd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:29.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 shutdown_connections 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.703+0000 7f0be07d8640 1 -- 172.21.15.1:0/3135753139 wait complete. 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 -- 172.21.15.1:0/2727854537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84201082a0 msgr2=0x7f842010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 --2- 172.21.15.1:0/2727854537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84201082a0 0x7f842010ec40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8418009cd0 tx=0x7f841802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 -- 172.21.15.1:0/2727854537 shutdown_connections 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 --2- 172.21.15.1:0/2727854537 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84201082a0 0x7f842010ec40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 --2- 172.21.15.1:0/2727854537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 --2- 172.21.15.1:0/2727854537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8420102d30 0x7f8420103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 -- 172.21.15.1:0/2727854537 >> 172.21.15.1:0/2727854537 conn(0x7f84200fc7d0 msgr2=0x7f84200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 -- 172.21.15.1:0/2727854537 shutdown_connections 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.751+0000 7f8427e6e640 1 -- 172.21.15.1:0/2727854537 wait complete. 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 Processor -- start 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 -- start start 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 0x7f842019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84201120a0 con 0x7f8420102d30 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8420111f20 con 0x7f84201082a0 2024-09-19T05:20:29.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8427e6e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8420112220 con 0x7f84201036e0 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8425c0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8425c0a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37132/0 (socket says 172.21.15.1:37132) 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.752+0000 7f8425c0a640 1 -- 172.21.15.1:0/303740605 learned_addr learned my addr 172.21.15.1:0/303740605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425409640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f842640b640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 0x7f842019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 -- 172.21.15.1:0/303740605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 msgr2=0x7f8420198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 -- 172.21.15.1:0/303740605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 msgr2=0x7f842019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 0x7f842019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 -- 172.21.15.1:0/303740605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842019d470 con 0x7f8420102d30 2024-09-19T05:20:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425409640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f842640b640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 0x7f842019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8425c0a640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c890 tx=0x7f841c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c004220 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f841c0043c0 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842019d760 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0049e0 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.753+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a5040 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.754+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420103110 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.755+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f841c0079b0 con 0x7f8420102d30 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.756+0000 7f8416ffd640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 0x7f840c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:29.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.756+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f841c0cff30 con 0x7f8420102d30 2024-09-19T05:20:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.756+0000 7f8425409640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 0x7f840c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.757+0000 7f8425409640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 0x7f840c0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8410005e10 tx=0x7f8410005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:29.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.760+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f841c014030 con 0x7f8420102d30 2024-09-19T05:20:29.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.938+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f8420199820 con 0x7f8420102d30 2024-09-19T05:20:29.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.938+0000 7f8416ffd640 1 -- 172.21.15.1:0/303740605 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f841c09c730 con 0x7f8420102d30 2024-09-19T05:20:29.940 INFO:teuthology.orchestra.run.smithi001.stdout:292057776164 2024-09-19T05:20:29.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 msgr2=0x7f840c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 0x7f840c0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8410005e10 tx=0x7f8410005da0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 msgr2=0x7f84201984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c890 tx=0x7f841c00cd50 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 shutdown_connections 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f840c0a3350 0x7f840c0a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84201082a0 0x7f842019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84201036e0 0x7f8420198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 --2- 172.21.15.1:0/303740605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8420102d30 0x7f84201984c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 >> 172.21.15.1:0/303740605 conn(0x7f84200fc7d0 msgr2=0x7f8420106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:29.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 shutdown_connections 2024-09-19T05:20:29.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:29.941+0000 7f8427e6e640 1 -- 172.21.15.1:0/303740605 wait complete. 2024-09-19T05:20:29.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:29 smithi001 ceph-mon[30968]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:29.953 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:29 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3135753139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:20:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:29 smithi060 ceph-mon[35058]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:29 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3135753139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:20:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:29 smithi082 ceph-mon[35195]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:29 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3135753139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:20:30.424 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790010 got 158913790013 for osd.5 2024-09-19T05:20:30.425 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:30.936 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:30 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/303740605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:20:30.984 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:31.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:30 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/303740605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:20:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:30 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/303740605' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:20:31.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528373 got 193273528375 for osd.6 2024-09-19T05:20:31.391 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:31.756 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953535 got 137438953537 for osd.4 2024-09-19T05:20:31.756 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:31.937 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:31 smithi001 ceph-mon[30968]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:31 smithi060 ceph-mon[35058]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:31 smithi082 ceph-mon[35195]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:32.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 -- 172.21.15.1:0/824043909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100d00 msgr2=0x7f6d5c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 --2- 172.21.15.1:0/824043909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100d00 0x7f6d5c106840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009930 tx=0x7f6d5002a420 comp rx=0 tx=0).stop 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 -- 172.21.15.1:0/824043909 shutdown_connections 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 --2- 172.21.15.1:0/824043909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c106f50 0x7f6d5c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 --2- 172.21.15.1:0/824043909 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100d00 0x7f6d5c106840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 --2- 172.21.15.1:0/824043909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c100350 0x7f6d5c100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 -- 172.21.15.1:0/824043909 >> 172.21.15.1:0/824043909 conn(0x7f6d5c077210 msgr2=0x7f6d5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 -- 172.21.15.1:0/824043909 shutdown_connections 2024-09-19T05:20:32.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.698+0000 7f6d6161d640 1 -- 172.21.15.1:0/824043909 wait complete. 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 Processor -- start 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 -- start start 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c100d00 0x7f6d5c101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c106f50 0x7f6d5c101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c111f60 con 0x7f6d5c100350 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c111de0 con 0x7f6d5c106f50 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.699+0000 7f6d6161d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c1120e0 con 0x7f6d5c100d00 2024-09-19T05:20:32.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37158/0 (socket says 172.21.15.1:37158) 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 -- 172.21.15.1:0/3831809042 learned_addr learned my addr 172.21.15.1:0/3831809042 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5a7fc640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c100d00 0x7f6d5c101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5b7fe640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c106f50 0x7f6d5c101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 -- 172.21.15.1:0/3831809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c100d00 msgr2=0x7f6d5c101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c100d00 0x7f6d5c101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 -- 172.21.15.1:0/3831809042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c106f50 msgr2=0x7f6d5c101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c106f50 0x7f6d5c101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 -- 172.21.15.1:0/3831809042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c1a6980 con 0x7f6d5c100350 2024-09-19T05:20:32.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d5affd640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c890 tx=0x7f6d4c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004220 con 0x7f6d5c100350 2024-09-19T05:20:32.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c1a6c70 con 0x7f6d5c100350 2024-09-19T05:20:32.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d4c0043c0 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004a00 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.700+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c1a7180 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.701+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c100730 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.703+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6d4c0079b0 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.703+0000 7f6d43fff640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 0x7f6d440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.704+0000 7f6d5a7fc640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 0x7f6d440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.704+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6d4c0cfb00 con 0x7f6d5c100350 2024-09-19T05:20:32.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.704+0000 7f6d5a7fc640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 0x7f6d440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d50004770 tx=0x7f6d500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.708+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d4c014030 con 0x7f6d5c100350 2024-09-19T05:20:32.751 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:32.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.891+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6d5c109bb0 con 0x7f6d5c100350 2024-09-19T05:20:32.893 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:32 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3286382133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:20:32.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.891+0000 7f6d43fff640 1 -- 172.21.15.1:0/3831809042 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6d4c09c360 con 0x7f6d5c100350 2024-09-19T05:20:32.893 INFO:teuthology.orchestra.run.smithi001.stdout:322122547231 2024-09-19T05:20:32.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 msgr2=0x7f6d440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 0x7f6d440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6d50004770 tx=0x7f6d500058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 msgr2=0x7f6d5c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c890 tx=0x7f6d4c00cd50 comp rx=0 tx=0).stop 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 shutdown_connections 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.893+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6d440a32d0 0x7f6d440a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d5c106f50 0x7f6d5c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d5c100d00 0x7f6d5c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 --2- 172.21.15.1:0/3831809042 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6d5c100350 0x7f6d5c1012d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 >> 172.21.15.1:0/3831809042 conn(0x7f6d5c077210 msgr2=0x7f6d5c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 shutdown_connections 2024-09-19T05:20:32.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.894+0000 7f6d6161d640 1 -- 172.21.15.1:0/3831809042 wait complete. 2024-09-19T05:20:33.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:32 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3286382133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:20:33.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:32 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3286382133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 -- 172.21.15.1:0/740217363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc101420 msgr2=0x7f49bc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/740217363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc101420 0x7f49bc10d950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009cd0 tx=0x7f49b402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 -- 172.21.15.1:0/740217363 shutdown_connections 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/740217363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc101420 0x7f49bc10d950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/740217363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 0x7f49bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/740217363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc106a80 0x7f49bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.935+0000 7f49c1ebf640 1 -- 172.21.15.1:0/740217363 >> 172.21.15.1:0/740217363 conn(0x7f49bc0fc7a0 msgr2=0x7f49bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:33.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.936+0000 7f49c1ebf640 1 -- 172.21.15.1:0/740217363 shutdown_connections 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.936+0000 7f49c1ebf640 1 -- 172.21.15.1:0/740217363 wait complete. 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.936+0000 7f49c1ebf640 1 Processor -- start 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.936+0000 7f49c1ebf640 1 -- start start 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 0x7f49bc0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc101420 0x7f49bc0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc110e80 con 0x7f49bc106a80 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc110d00 con 0x7f49bc100a80 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49c1ebf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc111000 con 0x7f49bc101420 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37152/0 (socket says 172.21.15.1:37152) 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 -- 172.21.15.1:0/3286382133 learned_addr learned my addr 172.21.15.1:0/3286382133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:33.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49b3fff640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc101420 0x7f49bc0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:33.289 INFO:teuthology.orchestra.run.smithi001.stdout:107374182469 2024-09-19T05:20:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bb7fe640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 0x7f49bc0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 -- 172.21.15.1:0/3286382133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc101420 msgr2=0x7f49bc0fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc101420 0x7f49bc0fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 -- 172.21.15.1:0/3286382133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 msgr2=0x7f49bc0fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 0x7f49bc0fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 -- 172.21.15.1:0/3286382133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc1a68f0 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.937+0000 7f49bbfff640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006010 tx=0x7f49b4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.938+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4004450 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.938+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc1a6b80 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.938+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49b4003e10 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.938+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4046480 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.938+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc1a70c0 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.939+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc100ee0 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.940+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f49b40045f0 con 0x7f49bc106a80 2024-09-19T05:20:33.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.940+0000 7f49b97fa640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 0x7f49a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.941+0000 7f49bb7fe640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 0x7f49a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.941+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f49b402e030 con 0x7f49bc106a80 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.941+0000 7f49bb7fe640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 0x7f49a80a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0058c0 tx=0x7f49ac00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:31.945+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49b404b060 con 0x7f49bc106a80 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.122+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f49bc10a000 con 0x7f49bc106a80 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.123+0000 7f49b97fa640 1 -- 172.21.15.1:0/3286382133 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f49b40bdf30 con 0x7f49bc106a80 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 msgr2=0x7f49a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 0x7f49a80a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49ac0058c0 tx=0x7f49ac00a250 comp rx=0 tx=0).stop 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 msgr2=0x7f49bc0fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f49b4006010 tx=0x7f49b4003c20 comp rx=0 tx=0).stop 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 shutdown_connections 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f49a80a32d0 0x7f49a80a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49bc106a80 0x7f49bc0fd770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49bc101420 0x7f49bc0fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 --2- 172.21.15.1:0/3286382133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49bc100a80 0x7f49bc0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 >> 172.21.15.1:0/3286382133 conn(0x7f49bc0fc7a0 msgr2=0x7f49bc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 shutdown_connections 2024-09-19T05:20:33.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.125+0000 7f49c1ebf640 1 -- 172.21.15.1:0/3286382133 wait complete. 2024-09-19T05:20:33.958 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182467 got 107374182469 for osd.3 2024-09-19T05:20:33.959 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:33 smithi060 ceph-mon[35058]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T05:20:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:33 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3831809042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:20:34.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:33 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4217829241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:20:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:33 smithi082 ceph-mon[35195]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T05:20:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:33 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3831809042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:20:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:33 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4217829241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:20:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:33 smithi001 ceph-mon[30968]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T05:20:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:33 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3831809042' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:20:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:33 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4217829241' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:20:34.148 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:34.624 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547229 got 322122547231 for osd.11 2024-09-19T05:20:34.624 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:35.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/2171906440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4106a80 msgr2=0x7fc8d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/2171906440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4106a80 0x7fc8d4106e60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009930 tx=0x7fc8c402a420 comp rx=0 tx=0).stop 2024-09-19T05:20:35.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/2171906440 shutdown_connections 2024-09-19T05:20:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/2171906440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 0x7fc8d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/2171906440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4100a80 0x7fc8d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/2171906440 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4106a80 0x7fc8d4106e60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/2171906440 >> 172.21.15.1:0/2171906440 conn(0x7fc8d40fc7a0 msgr2=0x7fc8d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:35.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/2171906440 shutdown_connections 2024-09-19T05:20:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.128+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/2171906440 wait complete. 2024-09-19T05:20:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 Processor -- start 2024-09-19T05:20:35.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 -- start start 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 0x7fc8d4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 0x7fc8d419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4110e40 con 0x7fc8d4100a80 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4110cc0 con 0x7fc8d4106a80 2024-09-19T05:20:35.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d9dbe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4110fc0 con 0x7fc8d4101420 2024-09-19T05:20:35.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33884/0 (socket says 172.21.15.1:33884) 2024-09-19T05:20:35.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.129+0000 7fc8d37fe640 1 -- 172.21.15.1:0/1755813517 learned_addr learned my addr 172.21.15.1:0/1755813517 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 0x7fc8d4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d3fff640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 0x7fc8d419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 -- 172.21.15.1:0/1755813517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 msgr2=0x7fc8d4198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 0x7fc8d4198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 -- 172.21.15.1:0/1755813517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 msgr2=0x7fc8d419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 0x7fc8d419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 -- 172.21.15.1:0/1755813517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d419d3f0 con 0x7fc8d4100a80 2024-09-19T05:20:35.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d3fff640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 0x7fc8d419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:35.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009230 tx=0x7fc8c4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:35.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c403f030 con 0x7fc8d4100a80 2024-09-19T05:20:35.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8c4003ad0 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d419d680 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4035070 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.130+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41a4fc0 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.131+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d4100ee0 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.133+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc8c4042030 con 0x7fc8d4100a80 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.133+0000 7fc8d17fa640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.133+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc8c40effd0 con 0x7fc8d4100a80 2024-09-19T05:20:35.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.133+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.134+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40ff200 tx=0x7fc8bc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:35.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.138+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8c40bc7d0 con 0x7fc8d4100a80 2024-09-19T05:20:35.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.330+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc8d41997a0 con 0x7fc8d4100a80 2024-09-19T05:20:35.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.330+0000 7fc8d17fa640 1 -- 172.21.15.1:0/1755813517 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc8c40bc0d0 con 0x7fc8d4100a80 2024-09-19T05:20:35.332 INFO:teuthology.orchestra.run.smithi001.stdout:274877906986 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 msgr2=0x7fc8c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40ff200 tx=0x7fc8bc00a2d0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 msgr2=0x7fc8d4198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009230 tx=0x7fc8c4004270 comp rx=0 tx=0).stop 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 shutdown_connections 2024-09-19T05:20:35.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4106a80 0x7fc8d419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4101420 0x7fc8d4198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 --2- 172.21.15.1:0/1755813517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4100a80 0x7fc8d4198440 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 >> 172.21.15.1:0/1755813517 conn(0x7fc8d40fc7a0 msgr2=0x7fc8d406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 shutdown_connections 2024-09-19T05:20:35.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.332+0000 7fc8d9dbe640 1 -- 172.21.15.1:0/1755813517 wait complete. 2024-09-19T05:20:35.371 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776162 got 292057776164 for osd.10 2024-09-19T05:20:35.372 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 -- 172.21.15.1:0/2316886753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc106f10 msgr2=0x7f62fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 --2- 172.21.15.1:0/2316886753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc106f10 0x7f62fc10ea90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009ca0 tx=0x7f62f402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 -- 172.21.15.1:0/2316886753 shutdown_connections 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 --2- 172.21.15.1:0/2316886753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc106f10 0x7f62fc10ea90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 --2- 172.21.15.1:0/2316886753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc102790 0x7f62fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 --2- 172.21.15.1:0/2316886753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc101de0 0x7f62fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 -- 172.21.15.1:0/2316886753 >> 172.21.15.1:0/2316886753 conn(0x7f62fc0fd8c0 msgr2=0x7f62fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:35.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.522+0000 7f6303a97640 1 -- 172.21.15.1:0/2316886753 shutdown_connections 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 -- 172.21.15.1:0/2316886753 wait complete. 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 Processor -- start 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 -- start start 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 0x7f62fc1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc106f10 0x7f62fc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc111f70 con 0x7f62fc101de0 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.523+0000 7f6303a97640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc111df0 con 0x7f62fc106f10 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6303a97640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc1120f0 con 0x7f62fc102790 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33888/0 (socket says 172.21.15.1:33888) 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 -- 172.21.15.1:0/2053719009 learned_addr learned my addr 172.21.15.1:0/2053719009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6302034640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc106f10 0x7f62fc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301032640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 0x7f62fc1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 -- 172.21.15.1:0/2053719009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 msgr2=0x7f62fc1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 0x7f62fc1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 -- 172.21.15.1:0/2053719009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc106f10 msgr2=0x7f62fc19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc106f10 0x7f62fc19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 -- 172.21.15.1:0/2053719009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc19d340 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301032640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 0x7f62fc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6301833640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f62f800d950 tx=0x7f62f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8017030 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f8004020 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc19d630 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f80047a0 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.524+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc1a4f10 con 0x7f62fc101de0 2024-09-19T05:20:35.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.525+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc1021c0 con 0x7f62fc101de0 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.527+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f62f80041d0 con 0x7f62fc101de0 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.528+0000 7f62f2ffd640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 0x7f62e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.528+0000 7f6301032640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 0x7f62e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.528+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f62f80cfee0 con 0x7f62fc101de0 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.528+0000 7f6301032640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 0x7f62e80a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005fd0 tx=0x7f62ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:35.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.531+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62f809c6e0 con 0x7f62fc101de0 2024-09-19T05:20:35.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.709+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f62fc1996f0 con 0x7f62fc101de0 2024-09-19T05:20:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.709+0000 7f62f2ffd640 1 -- 172.21.15.1:0/2053719009 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62f809bfe0 con 0x7f62fc101de0 2024-09-19T05:20:35.711 INFO:teuthology.orchestra.run.smithi001.stdout:77309411405 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 msgr2=0x7f62e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 0x7f62e80a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f62ec005fd0 tx=0x7f62ec005850 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 msgr2=0x7f62fc198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f62f800d950 tx=0x7f62f800de10 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 shutdown_connections 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f62e80a32d0 0x7f62e80a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62fc106f10 0x7f62fc19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62fc102790 0x7f62fc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 --2- 172.21.15.1:0/2053719009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62fc101de0 0x7f62fc198390 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 >> 172.21.15.1:0/2053719009 conn(0x7f62fc0fd8c0 msgr2=0x7f62fc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:35.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 shutdown_connections 2024-09-19T05:20:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:35.711+0000 7f6303a97640 1 -- 172.21.15.1:0/2053719009 wait complete. 2024-09-19T05:20:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:35 smithi001 ceph-mon[30968]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:35 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1755813517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:20:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:35 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2053719009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:20:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:35 smithi060 ceph-mon[35058]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:35 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1755813517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:20:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:35 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2053719009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:20:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:35 smithi082 ceph-mon[35195]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:35 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1755813517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:20:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:35 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2053719009' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:20:36.200 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906983 got 274877906986 for osd.9 2024-09-19T05:20:36.200 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 -- 172.21.15.1:0/3880307274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 msgr2=0x7f1e5c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 --2- 172.21.15.1:0/3880307274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c10ec40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009cd0 tx=0x7f1e5402a910 comp rx=0 tx=0).stop 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 -- 172.21.15.1:0/3880307274 shutdown_connections 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 --2- 172.21.15.1:0/3880307274 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c10ec40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 --2- 172.21.15.1:0/3880307274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c1036e0 0x7f1e5c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 --2- 172.21.15.1:0/3880307274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c102d30 0x7f1e5c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 -- 172.21.15.1:0/3880307274 >> 172.21.15.1:0/3880307274 conn(0x7f1e5c0fc7d0 msgr2=0x7f1e5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 -- 172.21.15.1:0/3880307274 shutdown_connections 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 -- 172.21.15.1:0/3880307274 wait complete. 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.935+0000 7f1e60de2640 1 Processor -- start 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 -- start start 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c102d30 0x7f1e5c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c1036e0 0x7f1e5c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c1120e0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c111f60 con 0x7f1e5c1036e0 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e60de2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c112260 con 0x7f1e5c102d30 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37180/0 (socket says 172.21.15.1:37180) 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 -- 172.21.15.1:0/4217829241 learned_addr learned my addr 172.21.15.1:0/4217829241 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5a59c640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c102d30 0x7f1e5c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e59d9b640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c1036e0 0x7f1e5c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 -- 172.21.15.1:0/4217829241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c102d30 msgr2=0x7f1e5c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c102d30 0x7f1e5c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 -- 172.21.15.1:0/4217829241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c1036e0 msgr2=0x7f1e5c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c1036e0 0x7f1e5c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 -- 172.21.15.1:0/4217829241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1a69e0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.936+0000 7f1e5ad9d640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1e54005cc0 tx=0x7f1e54031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.937+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54031850 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.937+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e54004520 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.937+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1a6c70 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.937+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5402fcd0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.937+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c1a71b0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.938+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c103110 con 0x7f1e5c1082a0 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.939+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1e540046d0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.940+0000 7f1e4b7fe640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.940+0000 7f1e5a59c640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stdout:34359738454 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.940+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1e540f1490 con 0x7f1e5c1082a0 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.940+0000 7f1e5a59c640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 0x7f1e440a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00abe0 tx=0x7f1e4c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:32.944+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e540bdda0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.123+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1e5c10a2b0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.123+0000 7f1e4b7fe640 1 -- 172.21.15.1:0/4217829241 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e540bd6a0 con 0x7f1e5c1082a0 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 msgr2=0x7f1e440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 0x7f1e440a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00abe0 tx=0x7f1e4c00a2d0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 msgr2=0x7f1e5c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1e54005cc0 tx=0x7f1e54031460 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 shutdown_connections 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e5c1082a0 0x7f1e5c101410 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e5c1036e0 0x7f1e5c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 --2- 172.21.15.1:0/4217829241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e5c102d30 0x7f1e5c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 >> 172.21.15.1:0/4217829241 conn(0x7f1e5c0fc7d0 msgr2=0x7f1e5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 shutdown_connections 2024-09-19T05:20:36.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:33.125+0000 7f1e60de2640 1 -- 172.21.15.1:0/4217829241 wait complete. 2024-09-19T05:20:36.629 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 -- 172.21.15.1:0/960811894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 msgr2=0x7f12e010bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 --2- 172.21.15.1:0/960811894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e010bb30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009900 tx=0x7f12d402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 -- 172.21.15.1:0/960811894 shutdown_connections 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 --2- 172.21.15.1:0/960811894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e010c150 0x7f12e010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 --2- 172.21.15.1:0/960811894 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e010bb30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 --2- 172.21.15.1:0/960811894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e0102d20 0x7f12e0103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 -- 172.21.15.1:0/960811894 >> 172.21.15.1:0/960811894 conn(0x7f12e00fc780 msgr2=0x7f12e00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 -- 172.21.15.1:0/960811894 shutdown_connections 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 -- 172.21.15.1:0/960811894 wait complete. 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.540+0000 7f12e62db640 1 Processor -- start 2024-09-19T05:20:37.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 -- start start 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 0x7f12e0100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e010c150 0x7f12e0101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111f50 con 0x7f12e0103640 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111dd0 con 0x7f12e0102d20 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12e62db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01120d0 con 0x7f12e010c150 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33906/0 (socket says 172.21.15.1:33906) 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 -- 172.21.15.1:0/2531103463 learned_addr learned my addr 172.21.15.1:0/2531103463 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12dffff640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 0x7f12e0100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 -- 172.21.15.1:0/2531103463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e010c150 msgr2=0x7f12e0101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e010c150 0x7f12e0101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 -- 172.21.15.1:0/2531103463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 msgr2=0x7f12e0100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 0x7f12e0100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12df7fe640 1 -- 172.21.15.1:0/2531103463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e01a6970 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.541+0000 7f12dffff640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 0x7f12e0100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12df7fe640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006010 tx=0x7f12d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d403f030 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d4003ce0 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e01a6c00 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4035070 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.542+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01a70e0 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.543+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e0103100 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.545+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f12d4042030 con 0x7f12e0103640 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.546+0000 7f12dd7fa640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 0x7f12c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.546+0000 7f12dffff640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 0x7f12c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:37.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.546+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f12d40f0670 con 0x7f12e0103640 2024-09-19T05:20:37.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.546+0000 7f12dffff640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 0x7f12c80a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12d0005fd0 tx=0x7f12d0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:37.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.549+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12d40bcf90 con 0x7f12e0103640 2024-09-19T05:20:37.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.725+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f12e0101eb0 con 0x7f12e0103640 2024-09-19T05:20:37.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.726+0000 7f12dd7fa640 1 -- 172.21.15.1:0/2531103463 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12d40bc890 con 0x7f12e0103640 2024-09-19T05:20:37.727 INFO:teuthology.orchestra.run.smithi001.stdout:55834574929 2024-09-19T05:20:37.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 msgr2=0x7f12c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:37.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 0x7f12c80a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12d0005fd0 tx=0x7f12d0005ea0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 msgr2=0x7f12e0100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f12d4006010 tx=0x7f12d40042f0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 shutdown_connections 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12c80a32d0 0x7f12c80a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12e010c150 0x7f12e0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12e0103640 0x7f12e0100ec0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 --2- 172.21.15.1:0/2531103463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12e0102d20 0x7f12e0100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 >> 172.21.15.1:0/2531103463 conn(0x7f12e00fc780 msgr2=0x7f12e00fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 shutdown_connections 2024-09-19T05:20:37.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:37.728+0000 7f12e62db640 1 -- 172.21.15.1:0/2531103463 wait complete. 2024-09-19T05:20:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:37 smithi060 ceph-mon[35058]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:38.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:37 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2531103463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:20:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:37 smithi082 ceph-mon[35195]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:37 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2531103463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:20:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:37 smithi001 ceph-mon[30968]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:37 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2531103463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:20:38.147 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411402 got 77309411405 for osd.2 2024-09-19T05:20:38.147 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:38.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738451 got 34359738454 for osd.0 2024-09-19T05:20:38.945 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.106+0000 7fe780cc2640 1 -- 172.21.15.1:0/1012717311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c1027a0 msgr2=0x7fe77c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.106+0000 7fe780cc2640 1 --2- 172.21.15.1:0/1012717311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c1027a0 0x7fe77c1067f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe764009900 tx=0x7fe76402a410 comp rx=0 tx=0).stop 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 -- 172.21.15.1:0/1012717311 shutdown_connections 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 --2- 172.21.15.1:0/1012717311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c106f20 0x7fe77c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 --2- 172.21.15.1:0/1012717311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c1027a0 0x7fe77c1067f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 --2- 172.21.15.1:0/1012717311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c101df0 0x7fe77c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 -- 172.21.15.1:0/1012717311 >> 172.21.15.1:0/1012717311 conn(0x7fe77c0fd8b0 msgr2=0x7fe77c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:39.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 -- 172.21.15.1:0/1012717311 shutdown_connections 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 -- 172.21.15.1:0/1012717311 wait complete. 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.107+0000 7fe780cc2640 1 Processor -- start 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 -- start start 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c1027a0 0x7fe77c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c106f20 0x7fe77c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c111f40 con 0x7fe77c101df0 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c111dc0 con 0x7fe77c106f20 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe780cc2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe77c1120c0 con 0x7fe77c1027a0 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33924/0 (socket says 172.21.15.1:33924) 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 -- 172.21.15.1:0/2679573151 learned_addr learned my addr 172.21.15.1:0/2679573151 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:39.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77ad9d640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c106f20 0x7fe77c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe779d9b640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c1027a0 0x7fe77c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 -- 172.21.15.1:0/2679573151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c1027a0 msgr2=0x7fe77c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c1027a0 0x7fe77c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 -- 172.21.15.1:0/2679573151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c106f20 msgr2=0x7fe77c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c106f20 0x7fe77c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.108+0000 7fe77a59c640 1 -- 172.21.15.1:0/2679573151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77c19d4d0 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe77a59c640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e9f0 tx=0x7fe76c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00cd80 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c010910 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77c19d7c0 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c018990 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.109+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77c1a50a0 con 0x7fe77c101df0 2024-09-19T05:20:39.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.110+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77c1021d0 con 0x7fe77c101df0 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.111+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe76c010ac0 con 0x7fe77c101df0 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.112+0000 7fe7737fe640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 0x7fe7680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.112+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe76c0d0110 con 0x7fe77c101df0 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.112+0000 7fe779d9b640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 0x7fe7680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.113+0000 7fe779d9b640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 0x7fe7680a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe764009230 tx=0x7fe7640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:39.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.116+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe76c09c320 con 0x7fe77c101df0 2024-09-19T05:20:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.293+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe77c10a100 con 0x7fe77c101df0 2024-09-19T05:20:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.294+0000 7fe7737fe640 1 -- 172.21.15.1:0/2679573151 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe76c0a0620 con 0x7fe77c101df0 2024-09-19T05:20:39.295 INFO:teuthology.orchestra.run.smithi001.stdout:214748364852 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 msgr2=0x7fe7680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 0x7fe7680a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe764009230 tx=0x7fe7640058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 msgr2=0x7fe77c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00e9f0 tx=0x7fe76c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 shutdown_connections 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe7680a32d0 0x7fe7680a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe77c106f20 0x7fe77c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe77c1027a0 0x7fe77c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 --2- 172.21.15.1:0/2679573151 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe77c101df0 0x7fe77c198520 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 >> 172.21.15.1:0/2679573151 conn(0x7fe77c0fd8b0 msgr2=0x7fe77c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 shutdown_connections 2024-09-19T05:20:39.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:39.296+0000 7fe780cc2640 1 -- 172.21.15.1:0/2679573151 wait complete. 2024-09-19T05:20:39.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574929 for osd.1 2024-09-19T05:20:39.633 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:39.967 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:39 smithi001 ceph-mon[30968]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:39.967 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:39 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2679573151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:20:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:39 smithi060 ceph-mon[35058]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:39 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2679573151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:20:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:39 smithi082 ceph-mon[35195]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:39 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2679573151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:20:40.422 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364849 got 214748364852 for osd.7 2024-09-19T05:20:40.422 DEBUG:teuthology.parallel:result is None 2024-09-19T05:20:40.422 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T05:20:40.422 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:20:40.690 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:41.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.187+0000 7f364eabf640 1 -- 172.21.15.1:0/73108952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648103780 msgr2=0x7f3648107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.187+0000 7f364eabf640 1 --2- 172.21.15.1:0/73108952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648103780 0x7f3648107bc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3630009930 tx=0x7f363002a420 comp rx=0 tx=0).stop 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 -- 172.21.15.1:0/73108952 shutdown_connections 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- 172.21.15.1:0/73108952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 0x7f364810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- 172.21.15.1:0/73108952 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648103780 0x7f3648107bc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- 172.21.15.1:0/73108952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648102dd0 0x7f36481031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 -- 172.21.15.1:0/73108952 >> 172.21.15.1:0/73108952 conn(0x7f36480fc7d0 msgr2=0x7f36480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 -- 172.21.15.1:0/73108952 shutdown_connections 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 -- 172.21.15.1:0/73108952 wait complete. 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 Processor -- start 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 -- start start 2024-09-19T05:20:41.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648103780 0x7f3648198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.188+0000 7f364eabf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 0x7f364819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364eabf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3648112150 con 0x7f3648102dd0 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364eabf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3648111fd0 con 0x7f3648103780 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364eabf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36481122d0 con 0x7f3648108300 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33942/0 (socket says 172.21.15.1:33942) 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 -- 172.21.15.1:0/973399814 learned_addr learned my addr 172.21.15.1:0/973399814 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f3647fff640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648103780 0x7f3648198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364d05c640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 0x7f364819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 -- 172.21.15.1:0/973399814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 msgr2=0x7f364819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 0x7f364819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 -- 172.21.15.1:0/973399814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648103780 msgr2=0x7f3648198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648103780 0x7f3648198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 -- 172.21.15.1:0/973399814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364819d700 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364c85b640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363800ba50 tx=0x7f363800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638019070 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364819d9f0 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363800cbe0 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.189+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380076e0 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.190+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481a52d0 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.191+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364806a7b0 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.192+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f363801c070 con 0x7f3648102dd0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.193+0000 7f3645ffb640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 0x7f36340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.193+0000 7f3647fff640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 0x7f36340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.193+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f36380cf2a0 con 0x7f3648102dd0 2024-09-19T05:20:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.193+0000 7f3647fff640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 0x7f36340a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3630005940 tx=0x7f36300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.197+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f363809b5c0 con 0x7f3648102dd0 2024-09-19T05:20:41.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.371+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3648062630 con 0x7f36340a32d0 2024-09-19T05:20:41.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.381+0000 7f3645ffb640 1 -- 172.21.15.1:0/973399814 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340521 (secure 0 0 0) 0x7f3648062630 con 0x7f36340a32d0 2024-09-19T05:20:41.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:41.387 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:20:41.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 msgr2=0x7f36340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 0x7f36340a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3630005940 tx=0x7f36300058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 msgr2=0x7f3648198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f363800ba50 tx=0x7f363800bf10 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 shutdown_connections 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f36340a32d0 0x7f36340a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3648108300 0x7f364819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3648103780 0x7f3648198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 --2- 172.21.15.1:0/973399814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3648102dd0 0x7f3648198750 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 >> 172.21.15.1:0/973399814 conn(0x7f36480fc7d0 msgr2=0x7f3648105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 shutdown_connections 2024-09-19T05:20:41.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:41.384+0000 7f364eabf640 1 -- 172.21.15.1:0/973399814 wait complete. 2024-09-19T05:20:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:41 smithi060 ceph-mon[35058]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:41 smithi082 ceph-mon[35195]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:42.078 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:41 smithi001 ceph-mon[30968]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:42.107 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-19T05:20:39.854192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655907,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":246,"num_read_kb":235,"num_write":269,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381912,"kb_used_data":11780,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559912,"statfs":{"total":1151940427776,"available":1151549349888,"internally_reserved":0,"allocated":12062720,"data_stored":7906127,"data_compressed":389868,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003543"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685563+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:20:11.685563+0000","last_peered":"2024-09-19T05:20:11.685563+0000","last_clean":"2024-09-19T05:20:11.685563+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:20:11.685563+0000","last_undegraded":"2024-09-19T05:20:11.685563+0000","last_fullsized":"2024-09-19T05:20:11.685563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763384+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:20:11.763384+0000","last_peered":"2024-09-19T05:20:11.763384+0000","last_clean":"2024-09-19T05:20:11.763384+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:20:11.763384+0000","last_undegraded":"2024-09-19T05:20:11.763384+0000","last_fullsized":"2024-09-19T05:20:11.763384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686511+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:20:11.686511+0000","last_peered":"2024-09-19T05:20:11.686511+0000","last_clean":"2024-09-19T05:20:11.686511+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:20:11.686511+0000","last_undegraded":"2024-09-19T05:20:11.686511+0000","last_fullsized":"2024-09-19T05:20:11.686511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763514+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:20:11.763514+0000","last_peered":"2024-09-19T05:20:11.763514+0000","last_clean":"2024-09-19T05:20:11.763514+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:20:11.763514+0000","last_undegraded":"2024-09-19T05:20:11.763514+0000","last_fullsized":"2024-09-19T05:20:11.763514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086255+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:20:12.086255+0000","last_peered":"2024-09-19T05:20:12.086255+0000","last_clean":"2024-09-19T05:20:12.086255+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:20:12.086255+0000","last_undegraded":"2024-09-19T05:20:12.086255+0000","last_fullsized":"2024-09-19T05:20:12.086255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086117+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:20:12.086117+0000","last_peered":"2024-09-19T05:20:12.086117+0000","last_clean":"2024-09-19T05:20:12.086117+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:20:12.086117+0000","last_undegraded":"2024-09-19T05:20:12.086117+0000","last_fullsized":"2024-09-19T05:20:12.086117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.092062+0000","last_change":"2024-09-19T05:20:12.092062+0000","last_active":"2024-09-19T05:20:12.092062+0000","last_peered":"2024-09-19T05:20:12.092062+0000","last_clean":"2024-09-19T05:20:12.092062+0000","last_became_active":"2024-09-19T05:20:12.088807+0000","last_became_peered":"2024-09-19T05:20:12.088807+0000","last_unstale":"2024-09-19T05:20:12.092062+0000","last_undegraded":"2024-09-19T05:20:12.092062+0000","last_fullsized":"2024-09-19T05:20:12.092062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:07.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088412+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:20:12.088412+0000","last_peered":"2024-09-19T05:20:12.088412+0000","last_clean":"2024-09-19T05:20:12.088412+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:20:12.088412+0000","last_undegraded":"2024-09-19T05:20:12.088412+0000","last_fullsized":"2024-09-19T05:20:12.088412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087193+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:20:12.087193+0000","last_peered":"2024-09-19T05:20:12.087193+0000","last_clean":"2024-09-19T05:20:12.087193+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:20:12.087193+0000","last_undegraded":"2024-09-19T05:20:12.087193+0000","last_fullsized":"2024-09-19T05:20:12.087193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688586+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:20:11.688586+0000","last_peered":"2024-09-19T05:20:11.688586+0000","last_clean":"2024-09-19T05:20:11.688586+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:20:11.688586+0000","last_undegraded":"2024-09-19T05:20:11.688586+0000","last_fullsized":"2024-09-19T05:20:11.688586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783446+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:20:11.783446+0000","last_peered":"2024-09-19T05:20:11.783446+0000","last_clean":"2024-09-19T05:20:11.783446+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:20:11.783446+0000","last_undegraded":"2024-09-19T05:20:11.783446+0000","last_fullsized":"2024-09-19T05:20:11.783446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086963+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:20:12.086963+0000","last_peered":"2024-09-19T05:20:12.086963+0000","last_clean":"2024-09-19T05:20:12.086963+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:20:12.086963+0000","last_undegraded":"2024-09-19T05:20:12.086963+0000","last_fullsized":"2024-09-19T05:20:12.086963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686897+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:20:11.686897+0000","last_peered":"2024-09-19T05:20:11.686897+0000","last_clean":"2024-09-19T05:20:11.686897+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:20:11.686897+0000","last_undegraded":"2024-09-19T05:20:11.686897+0000","last_fullsized":"2024-09-19T05:20:11.686897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688050+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:20:11.688050+0000","last_peered":"2024-09-19T05:20:11.688050+0000","last_clean":"2024-09-19T05:20:11.688050+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:20:11.688050+0000","last_undegraded":"2024-09-19T05:20:11.688050+0000","last_fullsized":"2024-09-19T05:20:11.688050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087026+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:20:12.087026+0000","last_peered":"2024-09-19T05:20:12.087026+0000","last_clean":"2024-09-19T05:20:12.087026+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:20:12.087026+0000","last_undegraded":"2024-09-19T05:20:12.087026+0000","last_fullsized":"2024-09-19T05:20:12.087026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763236+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:20:11.763236+0000","last_peered":"2024-09-19T05:20:11.763236+0000","last_clean":"2024-09-19T05:20:11.763236+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:20:11.763236+0000","last_undegraded":"2024-09-19T05:20:11.763236+0000","last_fullsized":"2024-09-19T05:20:11.763236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686096+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:20:11.686096+0000","last_peered":"2024-09-19T05:20:11.686096+0000","last_clean":"2024-09-19T05:20:11.686096+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:20:11.686096+0000","last_undegraded":"2024-09-19T05:20:11.686096+0000","last_fullsized":"2024-09-19T05:20:11.686096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087573+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:20:12.087573+0000","last_peered":"2024-09-19T05:20:12.087573+0000","last_clean":"2024-09-19T05:20:12.087573+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:20:12.087573+0000","last_undegraded":"2024-09-19T05:20:12.087573+0000","last_fullsized":"2024-09-19T05:20:12.087573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692441+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:20:11.692441+0000","last_peered":"2024-09-19T05:20:11.692441+0000","last_clean":"2024-09-19T05:20:11.692441+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:20:11.692441+0000","last_undegraded":"2024-09-19T05:20:11.692441+0000","last_fullsized":"2024-09-19T05:20:11.692441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762545+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:20:11.762545+0000","last_peered":"2024-09-19T05:20:11.762545+0000","last_clean":"2024-09-19T05:20:11.762545+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:20:11.762545+0000","last_undegraded":"2024-09-19T05:20:11.762545+0000","last_fullsized":"2024-09-19T05:20:11.762545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.785279+0000","last_change":"2024-09-19T05:20:11.784742+0000","last_active":"2024-09-19T05:20:11.785279+0000","last_peered":"2024-09-19T05:20:11.785279+0000","last_clean":"2024-09-19T05:20:11.785279+0000","last_became_active":"2024-09-19T05:20:11.784065+0000","last_became_peered":"2024-09-19T05:20:11.784065+0000","last_unstale":"2024-09-19T05:20:11.785279+0000","last_undegraded":"2024-09-19T05:20:11.785279+0000","last_fullsized":"2024-09-19T05:20:11.785279+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:28.836945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687174+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:20:11.687174+0000","last_peered":"2024-09-19T05:20:11.687174+0000","last_clean":"2024-09-19T05:20:11.687174+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:20:11.687174+0000","last_undegraded":"2024-09-19T05:20:11.687174+0000","last_fullsized":"2024-09-19T05:20:11.687174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086304+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:20:12.086304+0000","last_peered":"2024-09-19T05:20:12.086304+0000","last_clean":"2024-09-19T05:20:12.086304+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:20:12.086304+0000","last_undegraded":"2024-09-19T05:20:12.086304+0000","last_fullsized":"2024-09-19T05:20:12.086304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086966+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:20:12.086966+0000","last_peered":"2024-09-19T05:20:12.086966+0000","last_clean":"2024-09-19T05:20:12.086966+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:20:12.086966+0000","last_undegraded":"2024-09-19T05:20:12.086966+0000","last_fullsized":"2024-09-19T05:20:12.086966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086264+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:20:12.086264+0000","last_peered":"2024-09-19T05:20:12.086264+0000","last_clean":"2024-09-19T05:20:12.086264+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:20:12.086264+0000","last_undegraded":"2024-09-19T05:20:12.086264+0000","last_fullsized":"2024-09-19T05:20:12.086264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085988+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:20:12.085988+0000","last_peered":"2024-09-19T05:20:12.085988+0000","last_clean":"2024-09-19T05:20:12.085988+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:20:12.085988+0000","last_undegraded":"2024-09-19T05:20:12.085988+0000","last_fullsized":"2024-09-19T05:20:12.085988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687094+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:20:11.687094+0000","last_peered":"2024-09-19T05:20:11.687094+0000","last_clean":"2024-09-19T05:20:11.687094+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:20:11.687094+0000","last_undegraded":"2024-09-19T05:20:11.687094+0000","last_fullsized":"2024-09-19T05:20:11.687094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763487+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:20:11.763487+0000","last_peered":"2024-09-19T05:20:11.763487+0000","last_clean":"2024-09-19T05:20:11.763487+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:20:11.763487+0000","last_undegraded":"2024-09-19T05:20:11.763487+0000","last_fullsized":"2024-09-19T05:20:11.763487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685477+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:20:11.685477+0000","last_peered":"2024-09-19T05:20:11.685477+0000","last_clean":"2024-09-19T05:20:11.685477+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:20:11.685477+0000","last_undegraded":"2024-09-19T05:20:11.685477+0000","last_fullsized":"2024-09-19T05:20:11.685477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762694+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:20:11.762694+0000","last_peered":"2024-09-19T05:20:11.762694+0000","last_clean":"2024-09-19T05:20:11.762694+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:20:11.762694+0000","last_undegraded":"2024-09-19T05:20:11.762694+0000","last_fullsized":"2024-09-19T05:20:11.762694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688245+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:20:11.688245+0000","last_peered":"2024-09-19T05:20:11.688245+0000","last_clean":"2024-09-19T05:20:11.688245+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:20:11.688245+0000","last_undegraded":"2024-09-19T05:20:11.688245+0000","last_fullsized":"2024-09-19T05:20:11.688245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687278+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:20:11.687278+0000","last_peered":"2024-09-19T05:20:11.687278+0000","last_clean":"2024-09-19T05:20:11.687278+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:20:11.687278+0000","last_undegraded":"2024-09-19T05:20:11.687278+0000","last_fullsized":"2024-09-19T05:20:11.687278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691630+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:20:11.691630+0000","last_peered":"2024-09-19T05:20:11.691630+0000","last_clean":"2024-09-19T05:20:11.691630+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:20:11.691630+0000","last_undegraded":"2024-09-19T05:20:11.691630+0000","last_fullsized":"2024-09-19T05:20:11.691630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687399+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:20:11.687399+0000","last_peered":"2024-09-19T05:20:11.687399+0000","last_clean":"2024-09-19T05:20:11.687399+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:20:11.687399+0000","last_undegraded":"2024-09-19T05:20:11.687399+0000","last_fullsized":"2024-09-19T05:20:11.687399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685548+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:20:11.685548+0000","last_peered":"2024-09-19T05:20:11.685548+0000","last_clean":"2024-09-19T05:20:11.685548+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:20:11.685548+0000","last_undegraded":"2024-09-19T05:20:11.685548+0000","last_fullsized":"2024-09-19T05:20:11.685548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687329+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:20:11.687329+0000","last_peered":"2024-09-19T05:20:11.687329+0000","last_clean":"2024-09-19T05:20:11.687329+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:20:11.687329+0000","last_undegraded":"2024-09-19T05:20:11.687329+0000","last_fullsized":"2024-09-19T05:20:11.687329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687520+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:20:11.687520+0000","last_peered":"2024-09-19T05:20:11.687520+0000","last_clean":"2024-09-19T05:20:11.687520+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:20:11.687520+0000","last_undegraded":"2024-09-19T05:20:11.687520+0000","last_fullsized":"2024-09-19T05:20:11.687520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686707+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:20:11.686707+0000","last_peered":"2024-09-19T05:20:11.686707+0000","last_clean":"2024-09-19T05:20:11.686707+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:20:11.686707+0000","last_undegraded":"2024-09-19T05:20:11.686707+0000","last_fullsized":"2024-09-19T05:20:11.686707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688097+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:20:11.688097+0000","last_peered":"2024-09-19T05:20:11.688097+0000","last_clean":"2024-09-19T05:20:11.688097+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:20:11.688097+0000","last_undegraded":"2024-09-19T05:20:11.688097+0000","last_fullsized":"2024-09-19T05:20:11.688097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782743+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:20:11.782743+0000","last_peered":"2024-09-19T05:20:11.782743+0000","last_clean":"2024-09-19T05:20:11.782743+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:20:11.782743+0000","last_undegraded":"2024-09-19T05:20:11.782743+0000","last_fullsized":"2024-09-19T05:20:11.782743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688390+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:20:11.688390+0000","last_peered":"2024-09-19T05:20:11.688390+0000","last_clean":"2024-09-19T05:20:11.688390+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:20:11.688390+0000","last_undegraded":"2024-09-19T05:20:11.688390+0000","last_fullsized":"2024-09-19T05:20:11.688390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688143+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:20:11.688143+0000","last_peered":"2024-09-19T05:20:11.688143+0000","last_clean":"2024-09-19T05:20:11.688143+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:20:11.688143+0000","last_undegraded":"2024-09-19T05:20:11.688143+0000","last_fullsized":"2024-09-19T05:20:11.688143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.690531+0000","last_change":"2024-09-19T05:20:11.690531+0000","last_active":"2024-09-19T05:20:11.690531+0000","last_peered":"2024-09-19T05:20:11.690531+0000","last_clean":"2024-09-19T05:20:11.690531+0000","last_became_active":"2024-09-19T05:20:11.690170+0000","last_became_peered":"2024-09-19T05:20:11.690170+0000","last_unstale":"2024-09-19T05:20:11.690531+0000","last_undegraded":"2024-09-19T05:20:11.690531+0000","last_fullsized":"2024-09-19T05:20:11.690531+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:02.432072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686124+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:20:11.686124+0000","last_peered":"2024-09-19T05:20:11.686124+0000","last_clean":"2024-09-19T05:20:11.686124+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:20:11.686124+0000","last_undegraded":"2024-09-19T05:20:11.686124+0000","last_fullsized":"2024-09-19T05:20:11.686124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692646+0000","last_change":"2024-09-19T05:20:11.691798+0000","last_active":"2024-09-19T05:20:11.692646+0000","last_peered":"2024-09-19T05:20:11.692646+0000","last_clean":"2024-09-19T05:20:11.692646+0000","last_became_active":"2024-09-19T05:20:11.690998+0000","last_became_peered":"2024-09-19T05:20:11.690998+0000","last_unstale":"2024-09-19T05:20:11.692646+0000","last_undegraded":"2024-09-19T05:20:11.692646+0000","last_fullsized":"2024-09-19T05:20:11.692646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:51.907655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763031+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:20:11.763031+0000","last_peered":"2024-09-19T05:20:11.763031+0000","last_clean":"2024-09-19T05:20:11.763031+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:20:11.763031+0000","last_undegraded":"2024-09-19T05:20:11.763031+0000","last_fullsized":"2024-09-19T05:20:11.763031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085891+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:20:12.085891+0000","last_peered":"2024-09-19T05:20:12.085891+0000","last_clean":"2024-09-19T05:20:12.085891+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:20:12.085891+0000","last_undegraded":"2024-09-19T05:20:12.085891+0000","last_fullsized":"2024-09-19T05:20:12.085891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":346,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686272+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:20:11.686272+0000","last_peered":"2024-09-19T05:20:11.686272+0000","last_clean":"2024-09-19T05:20:11.686272+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:20:11.686272+0000","last_undegraded":"2024-09-19T05:20:11.686272+0000","last_fullsized":"2024-09-19T05:20:11.686272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688324+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:20:11.688324+0000","last_peered":"2024-09-19T05:20:11.688324+0000","last_clean":"2024-09-19T05:20:11.688324+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:20:11.688324+0000","last_undegraded":"2024-09-19T05:20:11.688324+0000","last_fullsized":"2024-09-19T05:20:11.688324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686884+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:20:11.686884+0000","last_peered":"2024-09-19T05:20:11.686884+0000","last_clean":"2024-09-19T05:20:11.686884+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:20:11.686884+0000","last_undegraded":"2024-09-19T05:20:11.686884+0000","last_fullsized":"2024-09-19T05:20:11.686884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687016+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:20:11.687016+0000","last_peered":"2024-09-19T05:20:11.687016+0000","last_clean":"2024-09-19T05:20:11.687016+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:20:11.687016+0000","last_undegraded":"2024-09-19T05:20:11.687016+0000","last_fullsized":"2024-09-19T05:20:11.687016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087823+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:20:12.087823+0000","last_peered":"2024-09-19T05:20:12.087823+0000","last_clean":"2024-09-19T05:20:12.087823+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:20:12.087823+0000","last_undegraded":"2024-09-19T05:20:12.087823+0000","last_fullsized":"2024-09-19T05:20:12.087823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686307+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:20:11.686307+0000","last_peered":"2024-09-19T05:20:11.686307+0000","last_clean":"2024-09-19T05:20:11.686307+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:20:11.686307+0000","last_undegraded":"2024-09-19T05:20:11.686307+0000","last_fullsized":"2024-09-19T05:20:11.686307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782174+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:20:11.782174+0000","last_peered":"2024-09-19T05:20:11.782174+0000","last_clean":"2024-09-19T05:20:11.782174+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:20:11.782174+0000","last_undegraded":"2024-09-19T05:20:11.782174+0000","last_fullsized":"2024-09-19T05:20:11.782174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086098+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:20:12.086098+0000","last_peered":"2024-09-19T05:20:12.086098+0000","last_clean":"2024-09-19T05:20:12.086098+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:20:12.086098+0000","last_undegraded":"2024-09-19T05:20:12.086098+0000","last_fullsized":"2024-09-19T05:20:12.086098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686582+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:20:11.686582+0000","last_peered":"2024-09-19T05:20:11.686582+0000","last_clean":"2024-09-19T05:20:11.686582+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:20:11.686582+0000","last_undegraded":"2024-09-19T05:20:11.686582+0000","last_fullsized":"2024-09-19T05:20:11.686582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688543+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:20:11.688543+0000","last_peered":"2024-09-19T05:20:11.688543+0000","last_clean":"2024-09-19T05:20:11.688543+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:20:11.688543+0000","last_undegraded":"2024-09-19T05:20:11.688543+0000","last_fullsized":"2024-09-19T05:20:11.688543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782561+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:20:11.782561+0000","last_peered":"2024-09-19T05:20:11.782561+0000","last_clean":"2024-09-19T05:20:11.782561+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:20:11.782561+0000","last_undegraded":"2024-09-19T05:20:11.782561+0000","last_fullsized":"2024-09-19T05:20:11.782561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692242+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:20:11.692242+0000","last_peered":"2024-09-19T05:20:11.692242+0000","last_clean":"2024-09-19T05:20:11.692242+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:20:11.692242+0000","last_undegraded":"2024-09-19T05:20:11.692242+0000","last_fullsized":"2024-09-19T05:20:11.692242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688864+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:20:11.688864+0000","last_peered":"2024-09-19T05:20:11.688864+0000","last_clean":"2024-09-19T05:20:11.688864+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:20:11.688864+0000","last_undegraded":"2024-09-19T05:20:11.688864+0000","last_fullsized":"2024-09-19T05:20:11.688864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783040+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:20:11.783040+0000","last_peered":"2024-09-19T05:20:11.783040+0000","last_clean":"2024-09-19T05:20:11.783040+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:20:11.783040+0000","last_undegraded":"2024-09-19T05:20:11.783040+0000","last_fullsized":"2024-09-19T05:20:11.783040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783174+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:20:11.783174+0000","last_peered":"2024-09-19T05:20:11.783174+0000","last_clean":"2024-09-19T05:20:11.783174+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:20:11.783174+0000","last_undegraded":"2024-09-19T05:20:11.783174+0000","last_fullsized":"2024-09-19T05:20:11.783174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687032+0000","last_change":"2024-09-19T05:18:59.742846+0000","last_active":"2024-09-19T05:20:11.687032+0000","last_peered":"2024-09-19T05:20:11.687032+0000","last_clean":"2024-09-19T05:20:11.687032+0000","last_became_active":"2024-09-19T05:18:59.742334+0000","last_became_peered":"2024-09-19T05:18:59.742334+0000","last_unstale":"2024-09-19T05:20:11.687032+0000","last_undegraded":"2024-09-19T05:20:11.687032+0000","last_fullsized":"2024-09-19T05:20:11.687032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:55.434122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688435+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:20:11.688435+0000","last_peered":"2024-09-19T05:20:11.688435+0000","last_clean":"2024-09-19T05:20:11.688435+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:20:11.688435+0000","last_undegraded":"2024-09-19T05:20:11.688435+0000","last_fullsized":"2024-09-19T05:20:11.688435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686030+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:20:11.686030+0000","last_peered":"2024-09-19T05:20:11.686030+0000","last_clean":"2024-09-19T05:20:11.686030+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:20:11.686030+0000","last_undegraded":"2024-09-19T05:20:11.686030+0000","last_fullsized":"2024-09-19T05:20:11.686030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085871+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:20:12.085871+0000","last_peered":"2024-09-19T05:20:12.085871+0000","last_clean":"2024-09-19T05:20:12.085871+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:20:12.085871+0000","last_undegraded":"2024-09-19T05:20:12.085871+0000","last_fullsized":"2024-09-19T05:20:12.085871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087808+0000","last_change":"2024-09-19T05:20:12.087358+0000","last_active":"2024-09-19T05:20:12.087808+0000","last_peered":"2024-09-19T05:20:12.087808+0000","last_clean":"2024-09-19T05:20:12.087808+0000","last_became_active":"2024-09-19T05:20:12.086826+0000","last_became_peered":"2024-09-19T05:20:12.086826+0000","last_unstale":"2024-09-19T05:20:12.087808+0000","last_undegraded":"2024-09-19T05:20:12.087808+0000","last_fullsized":"2024-09-19T05:20:12.087808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:54.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686434+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:20:11.686434+0000","last_peered":"2024-09-19T05:20:11.686434+0000","last_clean":"2024-09-19T05:20:11.686434+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:20:11.686434+0000","last_undegraded":"2024-09-19T05:20:11.686434+0000","last_fullsized":"2024-09-19T05:20:11.686434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782327+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:20:11.782327+0000","last_peered":"2024-09-19T05:20:11.782327+0000","last_clean":"2024-09-19T05:20:11.782327+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:20:11.782327+0000","last_undegraded":"2024-09-19T05:20:11.782327+0000","last_fullsized":"2024-09-19T05:20:11.782327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691695+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:20:11.691695+0000","last_peered":"2024-09-19T05:20:11.691695+0000","last_clean":"2024-09-19T05:20:11.691695+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:20:11.691695+0000","last_undegraded":"2024-09-19T05:20:11.691695+0000","last_fullsized":"2024-09-19T05:20:11.691695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688373+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:20:11.688373+0000","last_peered":"2024-09-19T05:20:11.688373+0000","last_clean":"2024-09-19T05:20:11.688373+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:20:11.688373+0000","last_undegraded":"2024-09-19T05:20:11.688373+0000","last_fullsized":"2024-09-19T05:20:11.688373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686547+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:20:11.686547+0000","last_peered":"2024-09-19T05:20:11.686547+0000","last_clean":"2024-09-19T05:20:11.686547+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:20:11.686547+0000","last_undegraded":"2024-09-19T05:20:11.686547+0000","last_fullsized":"2024-09-19T05:20:11.686547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783422+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:20:11.783422+0000","last_peered":"2024-09-19T05:20:11.783422+0000","last_clean":"2024-09-19T05:20:11.783422+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:20:11.783422+0000","last_undegraded":"2024-09-19T05:20:11.783422+0000","last_fullsized":"2024-09-19T05:20:11.783422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687153+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:20:11.687153+0000","last_peered":"2024-09-19T05:20:11.687153+0000","last_clean":"2024-09-19T05:20:11.687153+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:20:11.687153+0000","last_undegraded":"2024-09-19T05:20:11.687153+0000","last_fullsized":"2024-09-19T05:20:11.687153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:37.215547+0000","last_change":"2024-09-19T05:18:59.697949+0000","last_active":"2024-09-19T05:20:37.215547+0000","last_peered":"2024-09-19T05:20:37.215547+0000","last_clean":"2024-09-19T05:20:37.215547+0000","last_became_active":"2024-09-19T05:18:59.697556+0000","last_became_peered":"2024-09-19T05:18:59.697556+0000","last_unstale":"2024-09-19T05:20:37.215547+0000","last_undegraded":"2024-09-19T05:20:37.215547+0000","last_fullsized":"2024-09-19T05:20:37.215547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.995278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64507,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":120,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.784541+0000","last_change":"2024-09-19T05:20:11.784172+0000","last_active":"2024-09-19T05:20:11.784541+0000","last_peered":"2024-09-19T05:20:11.784541+0000","last_clean":"2024-09-19T05:20:11.784541+0000","last_became_active":"2024-09-19T05:20:11.783884+0000","last_became_peered":"2024-09-19T05:20:11.783884+0000","last_unstale":"2024-09-19T05:20:11.784541+0000","last_undegraded":"2024-09-19T05:20:11.784541+0000","last_fullsized":"2024-09-19T05:20:11.784541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:25.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088523+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:20:12.088523+0000","last_peered":"2024-09-19T05:20:12.088523+0000","last_clean":"2024-09-19T05:20:12.088523+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:20:12.088523+0000","last_undegraded":"2024-09-19T05:20:12.088523+0000","last_fullsized":"2024-09-19T05:20:12.088523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782268+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:20:11.782268+0000","last_peered":"2024-09-19T05:20:11.782268+0000","last_clean":"2024-09-19T05:20:11.782268+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:20:11.782268+0000","last_undegraded":"2024-09-19T05:20:11.782268+0000","last_fullsized":"2024-09-19T05:20:11.782268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087482+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:20:12.087482+0000","last_peered":"2024-09-19T05:20:12.087482+0000","last_clean":"2024-09-19T05:20:12.087482+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:20:12.087482+0000","last_undegraded":"2024-09-19T05:20:12.087482+0000","last_fullsized":"2024-09-19T05:20:12.087482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086320+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:20:12.086320+0000","last_peered":"2024-09-19T05:20:12.086320+0000","last_clean":"2024-09-19T05:20:12.086320+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:20:12.086320+0000","last_undegraded":"2024-09-19T05:20:12.086320+0000","last_fullsized":"2024-09-19T05:20:12.086320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686497+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:20:11.686497+0000","last_peered":"2024-09-19T05:20:11.686497+0000","last_clean":"2024-09-19T05:20:11.686497+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:20:11.686497+0000","last_undegraded":"2024-09-19T05:20:11.686497+0000","last_fullsized":"2024-09-19T05:20:11.686497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.684833+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:20:11.684833+0000","last_peered":"2024-09-19T05:20:11.684833+0000","last_clean":"2024-09-19T05:20:11.684833+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:20:11.684833+0000","last_undegraded":"2024-09-19T05:20:11.684833+0000","last_fullsized":"2024-09-19T05:20:11.684833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087256+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:20:12.087256+0000","last_peered":"2024-09-19T05:20:12.087256+0000","last_clean":"2024-09-19T05:20:12.087256+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:20:12.087256+0000","last_undegraded":"2024-09-19T05:20:12.087256+0000","last_fullsized":"2024-09-19T05:20:12.087256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687849+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:20:11.687849+0000","last_peered":"2024-09-19T05:20:11.687849+0000","last_clean":"2024-09-19T05:20:11.687849+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:20:11.687849+0000","last_undegraded":"2024-09-19T05:20:11.687849+0000","last_fullsized":"2024-09-19T05:20:11.687849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763013+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:20:11.763013+0000","last_peered":"2024-09-19T05:20:11.763013+0000","last_clean":"2024-09-19T05:20:11.763013+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:20:11.763013+0000","last_undegraded":"2024-09-19T05:20:11.763013+0000","last_fullsized":"2024-09-19T05:20:11.763013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086101+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:20:12.086101+0000","last_peered":"2024-09-19T05:20:12.086101+0000","last_clean":"2024-09-19T05:20:12.086101+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:20:12.086101+0000","last_undegraded":"2024-09-19T05:20:12.086101+0000","last_fullsized":"2024-09-19T05:20:12.086101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.684945+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:20:11.684945+0000","last_peered":"2024-09-19T05:20:11.684945+0000","last_clean":"2024-09-19T05:20:11.684945+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:20:11.684945+0000","last_undegraded":"2024-09-19T05:20:11.684945+0000","last_fullsized":"2024-09-19T05:20:11.684945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782101+0000","last_change":"2024-09-19T05:18:59.690280+0000","last_active":"2024-09-19T05:20:11.782101+0000","last_peered":"2024-09-19T05:20:11.782101+0000","last_clean":"2024-09-19T05:20:11.782101+0000","last_became_active":"2024-09-19T05:18:59.689990+0000","last_became_peered":"2024-09-19T05:18:59.689990+0000","last_unstale":"2024-09-19T05:20:11.782101+0000","last_undegraded":"2024-09-19T05:20:11.782101+0000","last_fullsized":"2024-09-19T05:20:11.782101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:24.937837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691703+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:20:11.691703+0000","last_peered":"2024-09-19T05:20:11.691703+0000","last_clean":"2024-09-19T05:20:11.691703+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:20:11.691703+0000","last_undegraded":"2024-09-19T05:20:11.691703+0000","last_fullsized":"2024-09-19T05:20:11.691703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763012+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:20:11.763012+0000","last_peered":"2024-09-19T05:20:11.763012+0000","last_clean":"2024-09-19T05:20:11.763012+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:20:11.763012+0000","last_undegraded":"2024-09-19T05:20:11.763012+0000","last_fullsized":"2024-09-19T05:20:11.763012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688142+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:20:11.688142+0000","last_peered":"2024-09-19T05:20:11.688142+0000","last_clean":"2024-09-19T05:20:11.688142+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:20:11.688142+0000","last_undegraded":"2024-09-19T05:20:11.688142+0000","last_fullsized":"2024-09-19T05:20:11.688142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.090144+0000","last_change":"2024-09-19T05:20:12.090144+0000","last_active":"2024-09-19T05:20:12.090144+0000","last_peered":"2024-09-19T05:20:12.090144+0000","last_clean":"2024-09-19T05:20:12.090144+0000","last_became_active":"2024-09-19T05:20:12.089669+0000","last_became_peered":"2024-09-19T05:20:12.089669+0000","last_unstale":"2024-09-19T05:20:12.090144+0000","last_undegraded":"2024-09-19T05:20:12.090144+0000","last_fullsized":"2024-09-19T05:20:12.090144+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:39.253036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782966+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:20:11.782966+0000","last_peered":"2024-09-19T05:20:11.782966+0000","last_clean":"2024-09-19T05:20:11.782966+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:20:11.782966+0000","last_undegraded":"2024-09-19T05:20:11.782966+0000","last_fullsized":"2024-09-19T05:20:11.782966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686358+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:20:11.686358+0000","last_peered":"2024-09-19T05:20:11.686358+0000","last_clean":"2024-09-19T05:20:11.686358+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:20:11.686358+0000","last_undegraded":"2024-09-19T05:20:11.686358+0000","last_fullsized":"2024-09-19T05:20:11.686358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782149+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:20:11.782149+0000","last_peered":"2024-09-19T05:20:11.782149+0000","last_clean":"2024-09-19T05:20:11.782149+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:20:11.782149+0000","last_undegraded":"2024-09-19T05:20:11.782149+0000","last_fullsized":"2024-09-19T05:20:11.782149+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687504+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:20:11.687504+0000","last_peered":"2024-09-19T05:20:11.687504+0000","last_clean":"2024-09-19T05:20:11.687504+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:20:11.687504+0000","last_undegraded":"2024-09-19T05:20:11.687504+0000","last_fullsized":"2024-09-19T05:20:11.687504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686327+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:20:11.686327+0000","last_peered":"2024-09-19T05:20:11.686327+0000","last_clean":"2024-09-19T05:20:11.686327+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:20:11.686327+0000","last_undegraded":"2024-09-19T05:20:11.686327+0000","last_fullsized":"2024-09-19T05:20:11.686327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.693523+0000","last_change":"2024-09-19T05:20:11.693523+0000","last_active":"2024-09-19T05:20:11.693523+0000","last_peered":"2024-09-19T05:20:11.693523+0000","last_clean":"2024-09-19T05:20:11.693523+0000","last_became_active":"2024-09-19T05:20:11.693018+0000","last_became_peered":"2024-09-19T05:20:11.693018+0000","last_unstale":"2024-09-19T05:20:11.693523+0000","last_undegraded":"2024-09-19T05:20:11.693523+0000","last_fullsized":"2024-09-19T05:20:11.693523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:09.595591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687006+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:20:11.687006+0000","last_peered":"2024-09-19T05:20:11.687006+0000","last_clean":"2024-09-19T05:20:11.687006+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:20:11.687006+0000","last_undegraded":"2024-09-19T05:20:11.687006+0000","last_fullsized":"2024-09-19T05:20:11.687006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686092+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:20:11.686092+0000","last_peered":"2024-09-19T05:20:11.686092+0000","last_clean":"2024-09-19T05:20:11.686092+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:20:11.686092+0000","last_undegraded":"2024-09-19T05:20:11.686092+0000","last_fullsized":"2024-09-19T05:20:11.686092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086022+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:20:12.086022+0000","last_peered":"2024-09-19T05:20:12.086022+0000","last_clean":"2024-09-19T05:20:12.086022+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:20:12.086022+0000","last_undegraded":"2024-09-19T05:20:12.086022+0000","last_fullsized":"2024-09-19T05:20:12.086022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688212+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:20:11.688212+0000","last_peered":"2024-09-19T05:20:11.688212+0000","last_clean":"2024-09-19T05:20:11.688212+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:20:11.688212+0000","last_undegraded":"2024-09-19T05:20:11.688212+0000","last_fullsized":"2024-09-19T05:20:11.688212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692049+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:20:11.692049+0000","last_peered":"2024-09-19T05:20:11.692049+0000","last_clean":"2024-09-19T05:20:11.692049+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:20:11.692049+0000","last_undegraded":"2024-09-19T05:20:11.692049+0000","last_fullsized":"2024-09-19T05:20:11.692049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686484+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:20:11.686484+0000","last_peered":"2024-09-19T05:20:11.686484+0000","last_clean":"2024-09-19T05:20:11.686484+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:20:11.686484+0000","last_undegraded":"2024-09-19T05:20:11.686484+0000","last_fullsized":"2024-09-19T05:20:11.686484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763475+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:20:11.763475+0000","last_peered":"2024-09-19T05:20:11.763475+0000","last_clean":"2024-09-19T05:20:11.763475+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:20:11.763475+0000","last_undegraded":"2024-09-19T05:20:11.763475+0000","last_fullsized":"2024-09-19T05:20:11.763475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782676+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:20:11.782676+0000","last_peered":"2024-09-19T05:20:11.782676+0000","last_clean":"2024-09-19T05:20:11.782676+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:20:11.782676+0000","last_undegraded":"2024-09-19T05:20:11.782676+0000","last_fullsized":"2024-09-19T05:20:11.782676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763206+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:20:11.763206+0000","last_peered":"2024-09-19T05:20:11.763206+0000","last_clean":"2024-09-19T05:20:11.763206+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:20:11.763206+0000","last_undegraded":"2024-09-19T05:20:11.763206+0000","last_fullsized":"2024-09-19T05:20:11.763206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088097+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:20:12.088097+0000","last_peered":"2024-09-19T05:20:12.088097+0000","last_clean":"2024-09-19T05:20:12.088097+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:20:12.088097+0000","last_undegraded":"2024-09-19T05:20:12.088097+0000","last_fullsized":"2024-09-19T05:20:12.088097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688322+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:20:11.688322+0000","last_peered":"2024-09-19T05:20:11.688322+0000","last_clean":"2024-09-19T05:20:11.688322+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:20:11.688322+0000","last_undegraded":"2024-09-19T05:20:11.688322+0000","last_fullsized":"2024-09-19T05:20:11.688322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691833+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:20:11.691833+0000","last_peered":"2024-09-19T05:20:11.691833+0000","last_clean":"2024-09-19T05:20:11.691833+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:20:11.691833+0000","last_undegraded":"2024-09-19T05:20:11.691833+0000","last_fullsized":"2024-09-19T05:20:11.691833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686543+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:20:11.686543+0000","last_peered":"2024-09-19T05:20:11.686543+0000","last_clean":"2024-09-19T05:20:11.686543+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:20:11.686543+0000","last_undegraded":"2024-09-19T05:20:11.686543+0000","last_fullsized":"2024-09-19T05:20:11.686543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685350+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:20:11.685350+0000","last_peered":"2024-09-19T05:20:11.685350+0000","last_clean":"2024-09-19T05:20:11.685350+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:20:11.685350+0000","last_undegraded":"2024-09-19T05:20:11.685350+0000","last_fullsized":"2024-09-19T05:20:11.685350+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692119+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:20:11.692119+0000","last_peered":"2024-09-19T05:20:11.692119+0000","last_clean":"2024-09-19T05:20:11.692119+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:20:11.692119+0000","last_undegraded":"2024-09-19T05:20:11.692119+0000","last_fullsized":"2024-09-19T05:20:11.692119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086535+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:20:12.086535+0000","last_peered":"2024-09-19T05:20:12.086535+0000","last_clean":"2024-09-19T05:20:12.086535+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:20:12.086535+0000","last_undegraded":"2024-09-19T05:20:12.086535+0000","last_fullsized":"2024-09-19T05:20:12.086535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086013+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:20:12.086013+0000","last_peered":"2024-09-19T05:20:12.086013+0000","last_clean":"2024-09-19T05:20:12.086013+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:20:12.086013+0000","last_undegraded":"2024-09-19T05:20:12.086013+0000","last_fullsized":"2024-09-19T05:20:12.086013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085859+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:20:12.085859+0000","last_peered":"2024-09-19T05:20:12.085859+0000","last_clean":"2024-09-19T05:20:12.085859+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:20:12.085859+0000","last_undegraded":"2024-09-19T05:20:12.085859+0000","last_fullsized":"2024-09-19T05:20:12.085859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688100+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:20:11.688100+0000","last_peered":"2024-09-19T05:20:11.688100+0000","last_clean":"2024-09-19T05:20:11.688100+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:20:11.688100+0000","last_undegraded":"2024-09-19T05:20:11.688100+0000","last_fullsized":"2024-09-19T05:20:11.688100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087791+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:20:12.087791+0000","last_peered":"2024-09-19T05:20:12.087791+0000","last_clean":"2024-09-19T05:20:12.087791+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:20:12.087791+0000","last_undegraded":"2024-09-19T05:20:12.087791+0000","last_fullsized":"2024-09-19T05:20:12.087791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686735+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:20:11.686735+0000","last_peered":"2024-09-19T05:20:11.686735+0000","last_clean":"2024-09-19T05:20:11.686735+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:20:11.686735+0000","last_undegraded":"2024-09-19T05:20:11.686735+0000","last_fullsized":"2024-09-19T05:20:11.686735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688192+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:20:11.688192+0000","last_peered":"2024-09-19T05:20:11.688192+0000","last_clean":"2024-09-19T05:20:11.688192+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:20:11.688192+0000","last_undegraded":"2024-09-19T05:20:11.688192+0000","last_fullsized":"2024-09-19T05:20:11.688192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086806+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:20:12.086806+0000","last_peered":"2024-09-19T05:20:12.086806+0000","last_clean":"2024-09-19T05:20:12.086806+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:20:12.086806+0000","last_undegraded":"2024-09-19T05:20:12.086806+0000","last_fullsized":"2024-09-19T05:20:12.086806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762838+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:20:11.762838+0000","last_peered":"2024-09-19T05:20:11.762838+0000","last_clean":"2024-09-19T05:20:11.762838+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:20:11.762838+0000","last_undegraded":"2024-09-19T05:20:11.762838+0000","last_fullsized":"2024-09-19T05:20:11.762838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686274+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:20:11.686274+0000","last_peered":"2024-09-19T05:20:11.686274+0000","last_clean":"2024-09-19T05:20:11.686274+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:20:11.686274+0000","last_undegraded":"2024-09-19T05:20:11.686274+0000","last_fullsized":"2024-09-19T05:20:11.686274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691043+0000","last_change":"2024-09-19T05:20:11.691043+0000","last_active":"2024-09-19T05:20:11.691043+0000","last_peered":"2024-09-19T05:20:11.691043+0000","last_clean":"2024-09-19T05:20:11.691043+0000","last_became_active":"2024-09-19T05:20:11.690672+0000","last_became_peered":"2024-09-19T05:20:11.690672+0000","last_unstale":"2024-09-19T05:20:11.691043+0000","last_undegraded":"2024-09-19T05:20:11.691043+0000","last_fullsized":"2024-09-19T05:20:11.691043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:01.913488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688020+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:20:11.688020+0000","last_peered":"2024-09-19T05:20:11.688020+0000","last_clean":"2024-09-19T05:20:11.688020+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:20:11.688020+0000","last_undegraded":"2024-09-19T05:20:11.688020+0000","last_fullsized":"2024-09-19T05:20:11.688020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.690487+0000","last_change":"2024-09-19T05:20:11.690113+0000","last_active":"2024-09-19T05:20:11.690487+0000","last_peered":"2024-09-19T05:20:11.690487+0000","last_clean":"2024-09-19T05:20:11.690487+0000","last_became_active":"2024-09-19T05:20:11.689729+0000","last_became_peered":"2024-09-19T05:20:11.689729+0000","last_unstale":"2024-09-19T05:20:11.690487+0000","last_undegraded":"2024-09-19T05:20:11.690487+0000","last_fullsized":"2024-09-19T05:20:11.690487+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:14.762934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086163+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:20:12.086163+0000","last_peered":"2024-09-19T05:20:12.086163+0000","last_clean":"2024-09-19T05:20:12.086163+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:20:12.086163+0000","last_undegraded":"2024-09-19T05:20:12.086163+0000","last_fullsized":"2024-09-19T05:20:12.086163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086255+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:20:12.086255+0000","last_peered":"2024-09-19T05:20:12.086255+0000","last_clean":"2024-09-19T05:20:12.086255+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:20:12.086255+0000","last_undegraded":"2024-09-19T05:20:12.086255+0000","last_fullsized":"2024-09-19T05:20:12.086255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691994+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:20:11.691994+0000","last_peered":"2024-09-19T05:20:11.691994+0000","last_clean":"2024-09-19T05:20:11.691994+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:20:11.691994+0000","last_undegraded":"2024-09-19T05:20:11.691994+0000","last_fullsized":"2024-09-19T05:20:11.691994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65305,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":120,"num_read_kb":126,"num_write":86,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":195915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547233,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":496291,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776166,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1101824,"data_stored":1147264,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":978944,"data_stored":500969,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135919,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":496895,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":1091337,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528378,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":492195,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790015,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":1086841,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":496313,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182471,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":492299,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":556736,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":556702,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":492285,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:20:42.113 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:20:42.372 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 -- 172.21.15.1:0/2359734751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 msgr2=0x7ff2d010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:42.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2359734751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d010d950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009cd0 tx=0x7ff2c802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 -- 172.21.15.1:0/2359734751 shutdown_connections 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2359734751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d010d950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2359734751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0100a80 0x7ff2d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2359734751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0106a80 0x7ff2d0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 -- 172.21.15.1:0/2359734751 >> 172.21.15.1:0/2359734751 conn(0x7ff2d00fc7a0 msgr2=0x7ff2d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 -- 172.21.15.1:0/2359734751 shutdown_connections 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.879+0000 7ff2d7494640 1 -- 172.21.15.1:0/2359734751 wait complete. 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 Processor -- start 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 -- start start 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 0x7ff2d00fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0106a80 0x7ff2d00fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:42.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110e80 con 0x7ff2d0101420 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110d00 con 0x7ff2d0100a80 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d7494640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0111000 con 0x7ff2d0106a80 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.880+0000 7ff2d4a2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33966/0 (socket says 172.21.15.1:33966) 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 -- 172.21.15.1:0/2723263280 learned_addr learned my addr 172.21.15.1:0/2723263280 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d5a31640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0106a80 0x7ff2d00fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d5230640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 0x7ff2d00fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 -- 172.21.15.1:0/2723263280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0106a80 msgr2=0x7ff2d00fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0106a80 0x7ff2d00fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 -- 172.21.15.1:0/2723263280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 msgr2=0x7ff2d00fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 0x7ff2d00fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 -- 172.21.15.1:0/2723263280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d01a68c0 con 0x7ff2d0101420 2024-09-19T05:20:42.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d5230640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 0x7ff2d00fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d4a2f640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00d950 tx=0x7ff2cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc017070 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2cc009c30 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00f6b0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d01a6bb0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.881+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01a70f0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.882+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0100ee0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.883+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff2cc0109d0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.884+0000 7ff2c67fc640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 0x7ff2bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.884+0000 7ff2d5230640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 0x7ff2bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.884+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff2cc0cfab0 con 0x7ff2d0101420 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.885+0000 7ff2d5230640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 0x7ff2bc0a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009ab0 tx=0x7ff2c00094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:42.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:42.889+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2cc009de0 con 0x7ff2d0101420 2024-09-19T05:20:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:42 smithi060 ceph-mon[35058]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:43.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:42 smithi082 ceph-mon[35195]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:43.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.062+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2d0062630 con 0x7ff2bc0a32d0 2024-09-19T05:20:43.064 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:42 smithi001 ceph-mon[30968]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:43.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.071+0000 7ff2c67fc640 1 -- 172.21.15.1:0/2723263280 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340521 (secure 0 0 0) 0x7ff2d0062630 con 0x7ff2bc0a32d0 2024-09-19T05:20:43.075 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:43.077 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 msgr2=0x7ff2bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 0x7ff2bc0a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009ab0 tx=0x7ff2c00094b0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 msgr2=0x7ff2d00fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00d950 tx=0x7ff2cc00de10 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 shutdown_connections 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2bc0a32d0 0x7ff2bc0a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2d0106a80 0x7ff2d00fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2d0101420 0x7ff2d00fd320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 --2- 172.21.15.1:0/2723263280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2d0100a80 0x7ff2d00fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 >> 172.21.15.1:0/2723263280 conn(0x7ff2d00fc7a0 msgr2=0x7ff2d006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:43.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 shutdown_connections 2024-09-19T05:20:43.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:43.075+0000 7ff2d7494640 1 -- 172.21.15.1:0/2723263280 wait complete. 2024-09-19T05:20:43.869 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-19T05:20:41.854807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655907,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":246,"num_read_kb":235,"num_write":269,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381912,"kb_used_data":11780,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559912,"statfs":{"total":1151940427776,"available":1151549349888,"internally_reserved":0,"allocated":12062720,"data_stored":7906127,"data_compressed":389868,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19140,"internal_metadata":378713404},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003510"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685563+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:20:11.685563+0000","last_peered":"2024-09-19T05:20:11.685563+0000","last_clean":"2024-09-19T05:20:11.685563+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:20:11.685563+0000","last_undegraded":"2024-09-19T05:20:11.685563+0000","last_fullsized":"2024-09-19T05:20:11.685563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763384+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:20:11.763384+0000","last_peered":"2024-09-19T05:20:11.763384+0000","last_clean":"2024-09-19T05:20:11.763384+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:20:11.763384+0000","last_undegraded":"2024-09-19T05:20:11.763384+0000","last_fullsized":"2024-09-19T05:20:11.763384+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686511+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:20:11.686511+0000","last_peered":"2024-09-19T05:20:11.686511+0000","last_clean":"2024-09-19T05:20:11.686511+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:20:11.686511+0000","last_undegraded":"2024-09-19T05:20:11.686511+0000","last_fullsized":"2024-09-19T05:20:11.686511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763514+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:20:11.763514+0000","last_peered":"2024-09-19T05:20:11.763514+0000","last_clean":"2024-09-19T05:20:11.763514+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:20:11.763514+0000","last_undegraded":"2024-09-19T05:20:11.763514+0000","last_fullsized":"2024-09-19T05:20:11.763514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086255+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:20:12.086255+0000","last_peered":"2024-09-19T05:20:12.086255+0000","last_clean":"2024-09-19T05:20:12.086255+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:20:12.086255+0000","last_undegraded":"2024-09-19T05:20:12.086255+0000","last_fullsized":"2024-09-19T05:20:12.086255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086117+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:20:12.086117+0000","last_peered":"2024-09-19T05:20:12.086117+0000","last_clean":"2024-09-19T05:20:12.086117+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:20:12.086117+0000","last_undegraded":"2024-09-19T05:20:12.086117+0000","last_fullsized":"2024-09-19T05:20:12.086117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.092062+0000","last_change":"2024-09-19T05:20:12.092062+0000","last_active":"2024-09-19T05:20:12.092062+0000","last_peered":"2024-09-19T05:20:12.092062+0000","last_clean":"2024-09-19T05:20:12.092062+0000","last_became_active":"2024-09-19T05:20:12.088807+0000","last_became_peered":"2024-09-19T05:20:12.088807+0000","last_unstale":"2024-09-19T05:20:12.092062+0000","last_undegraded":"2024-09-19T05:20:12.092062+0000","last_fullsized":"2024-09-19T05:20:12.092062+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:07.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088412+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:20:12.088412+0000","last_peered":"2024-09-19T05:20:12.088412+0000","last_clean":"2024-09-19T05:20:12.088412+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:20:12.088412+0000","last_undegraded":"2024-09-19T05:20:12.088412+0000","last_fullsized":"2024-09-19T05:20:12.088412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087193+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:20:12.087193+0000","last_peered":"2024-09-19T05:20:12.087193+0000","last_clean":"2024-09-19T05:20:12.087193+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:20:12.087193+0000","last_undegraded":"2024-09-19T05:20:12.087193+0000","last_fullsized":"2024-09-19T05:20:12.087193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688586+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:20:11.688586+0000","last_peered":"2024-09-19T05:20:11.688586+0000","last_clean":"2024-09-19T05:20:11.688586+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:20:11.688586+0000","last_undegraded":"2024-09-19T05:20:11.688586+0000","last_fullsized":"2024-09-19T05:20:11.688586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783446+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:20:11.783446+0000","last_peered":"2024-09-19T05:20:11.783446+0000","last_clean":"2024-09-19T05:20:11.783446+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:20:11.783446+0000","last_undegraded":"2024-09-19T05:20:11.783446+0000","last_fullsized":"2024-09-19T05:20:11.783446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086963+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:20:12.086963+0000","last_peered":"2024-09-19T05:20:12.086963+0000","last_clean":"2024-09-19T05:20:12.086963+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:20:12.086963+0000","last_undegraded":"2024-09-19T05:20:12.086963+0000","last_fullsized":"2024-09-19T05:20:12.086963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686897+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:20:11.686897+0000","last_peered":"2024-09-19T05:20:11.686897+0000","last_clean":"2024-09-19T05:20:11.686897+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:20:11.686897+0000","last_undegraded":"2024-09-19T05:20:11.686897+0000","last_fullsized":"2024-09-19T05:20:11.686897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688050+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:20:11.688050+0000","last_peered":"2024-09-19T05:20:11.688050+0000","last_clean":"2024-09-19T05:20:11.688050+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:20:11.688050+0000","last_undegraded":"2024-09-19T05:20:11.688050+0000","last_fullsized":"2024-09-19T05:20:11.688050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087026+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:20:12.087026+0000","last_peered":"2024-09-19T05:20:12.087026+0000","last_clean":"2024-09-19T05:20:12.087026+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:20:12.087026+0000","last_undegraded":"2024-09-19T05:20:12.087026+0000","last_fullsized":"2024-09-19T05:20:12.087026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763236+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:20:11.763236+0000","last_peered":"2024-09-19T05:20:11.763236+0000","last_clean":"2024-09-19T05:20:11.763236+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:20:11.763236+0000","last_undegraded":"2024-09-19T05:20:11.763236+0000","last_fullsized":"2024-09-19T05:20:11.763236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686096+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:20:11.686096+0000","last_peered":"2024-09-19T05:20:11.686096+0000","last_clean":"2024-09-19T05:20:11.686096+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:20:11.686096+0000","last_undegraded":"2024-09-19T05:20:11.686096+0000","last_fullsized":"2024-09-19T05:20:11.686096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087573+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:20:12.087573+0000","last_peered":"2024-09-19T05:20:12.087573+0000","last_clean":"2024-09-19T05:20:12.087573+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:20:12.087573+0000","last_undegraded":"2024-09-19T05:20:12.087573+0000","last_fullsized":"2024-09-19T05:20:12.087573+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692441+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:20:11.692441+0000","last_peered":"2024-09-19T05:20:11.692441+0000","last_clean":"2024-09-19T05:20:11.692441+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:20:11.692441+0000","last_undegraded":"2024-09-19T05:20:11.692441+0000","last_fullsized":"2024-09-19T05:20:11.692441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762545+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:20:11.762545+0000","last_peered":"2024-09-19T05:20:11.762545+0000","last_clean":"2024-09-19T05:20:11.762545+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:20:11.762545+0000","last_undegraded":"2024-09-19T05:20:11.762545+0000","last_fullsized":"2024-09-19T05:20:11.762545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.785279+0000","last_change":"2024-09-19T05:20:11.784742+0000","last_active":"2024-09-19T05:20:11.785279+0000","last_peered":"2024-09-19T05:20:11.785279+0000","last_clean":"2024-09-19T05:20:11.785279+0000","last_became_active":"2024-09-19T05:20:11.784065+0000","last_became_peered":"2024-09-19T05:20:11.784065+0000","last_unstale":"2024-09-19T05:20:11.785279+0000","last_undegraded":"2024-09-19T05:20:11.785279+0000","last_fullsized":"2024-09-19T05:20:11.785279+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:28.836945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687174+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:20:11.687174+0000","last_peered":"2024-09-19T05:20:11.687174+0000","last_clean":"2024-09-19T05:20:11.687174+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:20:11.687174+0000","last_undegraded":"2024-09-19T05:20:11.687174+0000","last_fullsized":"2024-09-19T05:20:11.687174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086304+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:20:12.086304+0000","last_peered":"2024-09-19T05:20:12.086304+0000","last_clean":"2024-09-19T05:20:12.086304+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:20:12.086304+0000","last_undegraded":"2024-09-19T05:20:12.086304+0000","last_fullsized":"2024-09-19T05:20:12.086304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086966+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:20:12.086966+0000","last_peered":"2024-09-19T05:20:12.086966+0000","last_clean":"2024-09-19T05:20:12.086966+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:20:12.086966+0000","last_undegraded":"2024-09-19T05:20:12.086966+0000","last_fullsized":"2024-09-19T05:20:12.086966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086264+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:20:12.086264+0000","last_peered":"2024-09-19T05:20:12.086264+0000","last_clean":"2024-09-19T05:20:12.086264+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:20:12.086264+0000","last_undegraded":"2024-09-19T05:20:12.086264+0000","last_fullsized":"2024-09-19T05:20:12.086264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085988+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:20:12.085988+0000","last_peered":"2024-09-19T05:20:12.085988+0000","last_clean":"2024-09-19T05:20:12.085988+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:20:12.085988+0000","last_undegraded":"2024-09-19T05:20:12.085988+0000","last_fullsized":"2024-09-19T05:20:12.085988+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687094+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:20:11.687094+0000","last_peered":"2024-09-19T05:20:11.687094+0000","last_clean":"2024-09-19T05:20:11.687094+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:20:11.687094+0000","last_undegraded":"2024-09-19T05:20:11.687094+0000","last_fullsized":"2024-09-19T05:20:11.687094+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763487+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:20:11.763487+0000","last_peered":"2024-09-19T05:20:11.763487+0000","last_clean":"2024-09-19T05:20:11.763487+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:20:11.763487+0000","last_undegraded":"2024-09-19T05:20:11.763487+0000","last_fullsized":"2024-09-19T05:20:11.763487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'9","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685477+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:20:11.685477+0000","last_peered":"2024-09-19T05:20:11.685477+0000","last_clean":"2024-09-19T05:20:11.685477+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:20:11.685477+0000","last_undegraded":"2024-09-19T05:20:11.685477+0000","last_fullsized":"2024-09-19T05:20:11.685477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762694+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:20:11.762694+0000","last_peered":"2024-09-19T05:20:11.762694+0000","last_clean":"2024-09-19T05:20:11.762694+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:20:11.762694+0000","last_undegraded":"2024-09-19T05:20:11.762694+0000","last_fullsized":"2024-09-19T05:20:11.762694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688245+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:20:11.688245+0000","last_peered":"2024-09-19T05:20:11.688245+0000","last_clean":"2024-09-19T05:20:11.688245+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:20:11.688245+0000","last_undegraded":"2024-09-19T05:20:11.688245+0000","last_fullsized":"2024-09-19T05:20:11.688245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687278+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:20:11.687278+0000","last_peered":"2024-09-19T05:20:11.687278+0000","last_clean":"2024-09-19T05:20:11.687278+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:20:11.687278+0000","last_undegraded":"2024-09-19T05:20:11.687278+0000","last_fullsized":"2024-09-19T05:20:11.687278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691630+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:20:11.691630+0000","last_peered":"2024-09-19T05:20:11.691630+0000","last_clean":"2024-09-19T05:20:11.691630+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:20:11.691630+0000","last_undegraded":"2024-09-19T05:20:11.691630+0000","last_fullsized":"2024-09-19T05:20:11.691630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687399+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:20:11.687399+0000","last_peered":"2024-09-19T05:20:11.687399+0000","last_clean":"2024-09-19T05:20:11.687399+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:20:11.687399+0000","last_undegraded":"2024-09-19T05:20:11.687399+0000","last_fullsized":"2024-09-19T05:20:11.687399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685548+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:20:11.685548+0000","last_peered":"2024-09-19T05:20:11.685548+0000","last_clean":"2024-09-19T05:20:11.685548+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:20:11.685548+0000","last_undegraded":"2024-09-19T05:20:11.685548+0000","last_fullsized":"2024-09-19T05:20:11.685548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687329+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:20:11.687329+0000","last_peered":"2024-09-19T05:20:11.687329+0000","last_clean":"2024-09-19T05:20:11.687329+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:20:11.687329+0000","last_undegraded":"2024-09-19T05:20:11.687329+0000","last_fullsized":"2024-09-19T05:20:11.687329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687520+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:20:11.687520+0000","last_peered":"2024-09-19T05:20:11.687520+0000","last_clean":"2024-09-19T05:20:11.687520+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:20:11.687520+0000","last_undegraded":"2024-09-19T05:20:11.687520+0000","last_fullsized":"2024-09-19T05:20:11.687520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686707+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:20:11.686707+0000","last_peered":"2024-09-19T05:20:11.686707+0000","last_clean":"2024-09-19T05:20:11.686707+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:20:11.686707+0000","last_undegraded":"2024-09-19T05:20:11.686707+0000","last_fullsized":"2024-09-19T05:20:11.686707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688097+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:20:11.688097+0000","last_peered":"2024-09-19T05:20:11.688097+0000","last_clean":"2024-09-19T05:20:11.688097+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:20:11.688097+0000","last_undegraded":"2024-09-19T05:20:11.688097+0000","last_fullsized":"2024-09-19T05:20:11.688097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782743+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:20:11.782743+0000","last_peered":"2024-09-19T05:20:11.782743+0000","last_clean":"2024-09-19T05:20:11.782743+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:20:11.782743+0000","last_undegraded":"2024-09-19T05:20:11.782743+0000","last_fullsized":"2024-09-19T05:20:11.782743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688390+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:20:11.688390+0000","last_peered":"2024-09-19T05:20:11.688390+0000","last_clean":"2024-09-19T05:20:11.688390+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:20:11.688390+0000","last_undegraded":"2024-09-19T05:20:11.688390+0000","last_fullsized":"2024-09-19T05:20:11.688390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688143+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:20:11.688143+0000","last_peered":"2024-09-19T05:20:11.688143+0000","last_clean":"2024-09-19T05:20:11.688143+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:20:11.688143+0000","last_undegraded":"2024-09-19T05:20:11.688143+0000","last_fullsized":"2024-09-19T05:20:11.688143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.690531+0000","last_change":"2024-09-19T05:20:11.690531+0000","last_active":"2024-09-19T05:20:11.690531+0000","last_peered":"2024-09-19T05:20:11.690531+0000","last_clean":"2024-09-19T05:20:11.690531+0000","last_became_active":"2024-09-19T05:20:11.690170+0000","last_became_peered":"2024-09-19T05:20:11.690170+0000","last_unstale":"2024-09-19T05:20:11.690531+0000","last_undegraded":"2024-09-19T05:20:11.690531+0000","last_fullsized":"2024-09-19T05:20:11.690531+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:02.432072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686124+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:20:11.686124+0000","last_peered":"2024-09-19T05:20:11.686124+0000","last_clean":"2024-09-19T05:20:11.686124+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:20:11.686124+0000","last_undegraded":"2024-09-19T05:20:11.686124+0000","last_fullsized":"2024-09-19T05:20:11.686124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692646+0000","last_change":"2024-09-19T05:20:11.691798+0000","last_active":"2024-09-19T05:20:11.692646+0000","last_peered":"2024-09-19T05:20:11.692646+0000","last_clean":"2024-09-19T05:20:11.692646+0000","last_became_active":"2024-09-19T05:20:11.690998+0000","last_became_peered":"2024-09-19T05:20:11.690998+0000","last_unstale":"2024-09-19T05:20:11.692646+0000","last_undegraded":"2024-09-19T05:20:11.692646+0000","last_fullsized":"2024-09-19T05:20:11.692646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:51.907655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763031+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:20:11.763031+0000","last_peered":"2024-09-19T05:20:11.763031+0000","last_clean":"2024-09-19T05:20:11.763031+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:20:11.763031+0000","last_undegraded":"2024-09-19T05:20:11.763031+0000","last_fullsized":"2024-09-19T05:20:11.763031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085891+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:20:12.085891+0000","last_peered":"2024-09-19T05:20:12.085891+0000","last_clean":"2024-09-19T05:20:12.085891+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:20:12.085891+0000","last_undegraded":"2024-09-19T05:20:12.085891+0000","last_fullsized":"2024-09-19T05:20:12.085891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":346,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686272+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:20:11.686272+0000","last_peered":"2024-09-19T05:20:11.686272+0000","last_clean":"2024-09-19T05:20:11.686272+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:20:11.686272+0000","last_undegraded":"2024-09-19T05:20:11.686272+0000","last_fullsized":"2024-09-19T05:20:11.686272+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688324+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:20:11.688324+0000","last_peered":"2024-09-19T05:20:11.688324+0000","last_clean":"2024-09-19T05:20:11.688324+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:20:11.688324+0000","last_undegraded":"2024-09-19T05:20:11.688324+0000","last_fullsized":"2024-09-19T05:20:11.688324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686884+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:20:11.686884+0000","last_peered":"2024-09-19T05:20:11.686884+0000","last_clean":"2024-09-19T05:20:11.686884+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:20:11.686884+0000","last_undegraded":"2024-09-19T05:20:11.686884+0000","last_fullsized":"2024-09-19T05:20:11.686884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687016+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:20:11.687016+0000","last_peered":"2024-09-19T05:20:11.687016+0000","last_clean":"2024-09-19T05:20:11.687016+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:20:11.687016+0000","last_undegraded":"2024-09-19T05:20:11.687016+0000","last_fullsized":"2024-09-19T05:20:11.687016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087823+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:20:12.087823+0000","last_peered":"2024-09-19T05:20:12.087823+0000","last_clean":"2024-09-19T05:20:12.087823+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:20:12.087823+0000","last_undegraded":"2024-09-19T05:20:12.087823+0000","last_fullsized":"2024-09-19T05:20:12.087823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686307+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:20:11.686307+0000","last_peered":"2024-09-19T05:20:11.686307+0000","last_clean":"2024-09-19T05:20:11.686307+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:20:11.686307+0000","last_undegraded":"2024-09-19T05:20:11.686307+0000","last_fullsized":"2024-09-19T05:20:11.686307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782174+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:20:11.782174+0000","last_peered":"2024-09-19T05:20:11.782174+0000","last_clean":"2024-09-19T05:20:11.782174+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:20:11.782174+0000","last_undegraded":"2024-09-19T05:20:11.782174+0000","last_fullsized":"2024-09-19T05:20:11.782174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086098+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:20:12.086098+0000","last_peered":"2024-09-19T05:20:12.086098+0000","last_clean":"2024-09-19T05:20:12.086098+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:20:12.086098+0000","last_undegraded":"2024-09-19T05:20:12.086098+0000","last_fullsized":"2024-09-19T05:20:12.086098+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686582+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:20:11.686582+0000","last_peered":"2024-09-19T05:20:11.686582+0000","last_clean":"2024-09-19T05:20:11.686582+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:20:11.686582+0000","last_undegraded":"2024-09-19T05:20:11.686582+0000","last_fullsized":"2024-09-19T05:20:11.686582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688543+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:20:11.688543+0000","last_peered":"2024-09-19T05:20:11.688543+0000","last_clean":"2024-09-19T05:20:11.688543+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:20:11.688543+0000","last_undegraded":"2024-09-19T05:20:11.688543+0000","last_fullsized":"2024-09-19T05:20:11.688543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782561+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:20:11.782561+0000","last_peered":"2024-09-19T05:20:11.782561+0000","last_clean":"2024-09-19T05:20:11.782561+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:20:11.782561+0000","last_undegraded":"2024-09-19T05:20:11.782561+0000","last_fullsized":"2024-09-19T05:20:11.782561+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692242+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:20:11.692242+0000","last_peered":"2024-09-19T05:20:11.692242+0000","last_clean":"2024-09-19T05:20:11.692242+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:20:11.692242+0000","last_undegraded":"2024-09-19T05:20:11.692242+0000","last_fullsized":"2024-09-19T05:20:11.692242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688864+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:20:11.688864+0000","last_peered":"2024-09-19T05:20:11.688864+0000","last_clean":"2024-09-19T05:20:11.688864+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:20:11.688864+0000","last_undegraded":"2024-09-19T05:20:11.688864+0000","last_fullsized":"2024-09-19T05:20:11.688864+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783040+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:20:11.783040+0000","last_peered":"2024-09-19T05:20:11.783040+0000","last_clean":"2024-09-19T05:20:11.783040+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:20:11.783040+0000","last_undegraded":"2024-09-19T05:20:11.783040+0000","last_fullsized":"2024-09-19T05:20:11.783040+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783174+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:20:11.783174+0000","last_peered":"2024-09-19T05:20:11.783174+0000","last_clean":"2024-09-19T05:20:11.783174+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:20:11.783174+0000","last_undegraded":"2024-09-19T05:20:11.783174+0000","last_fullsized":"2024-09-19T05:20:11.783174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687032+0000","last_change":"2024-09-19T05:18:59.742846+0000","last_active":"2024-09-19T05:20:11.687032+0000","last_peered":"2024-09-19T05:20:11.687032+0000","last_clean":"2024-09-19T05:20:11.687032+0000","last_became_active":"2024-09-19T05:18:59.742334+0000","last_became_peered":"2024-09-19T05:18:59.742334+0000","last_unstale":"2024-09-19T05:20:11.687032+0000","last_undegraded":"2024-09-19T05:20:11.687032+0000","last_fullsized":"2024-09-19T05:20:11.687032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:55.434122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688435+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:20:11.688435+0000","last_peered":"2024-09-19T05:20:11.688435+0000","last_clean":"2024-09-19T05:20:11.688435+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:20:11.688435+0000","last_undegraded":"2024-09-19T05:20:11.688435+0000","last_fullsized":"2024-09-19T05:20:11.688435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686030+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:20:11.686030+0000","last_peered":"2024-09-19T05:20:11.686030+0000","last_clean":"2024-09-19T05:20:11.686030+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:20:11.686030+0000","last_undegraded":"2024-09-19T05:20:11.686030+0000","last_fullsized":"2024-09-19T05:20:11.686030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085871+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:20:12.085871+0000","last_peered":"2024-09-19T05:20:12.085871+0000","last_clean":"2024-09-19T05:20:12.085871+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:20:12.085871+0000","last_undegraded":"2024-09-19T05:20:12.085871+0000","last_fullsized":"2024-09-19T05:20:12.085871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087808+0000","last_change":"2024-09-19T05:20:12.087358+0000","last_active":"2024-09-19T05:20:12.087808+0000","last_peered":"2024-09-19T05:20:12.087808+0000","last_clean":"2024-09-19T05:20:12.087808+0000","last_became_active":"2024-09-19T05:20:12.086826+0000","last_became_peered":"2024-09-19T05:20:12.086826+0000","last_unstale":"2024-09-19T05:20:12.087808+0000","last_undegraded":"2024-09-19T05:20:12.087808+0000","last_fullsized":"2024-09-19T05:20:12.087808+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:54.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686434+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:20:11.686434+0000","last_peered":"2024-09-19T05:20:11.686434+0000","last_clean":"2024-09-19T05:20:11.686434+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:20:11.686434+0000","last_undegraded":"2024-09-19T05:20:11.686434+0000","last_fullsized":"2024-09-19T05:20:11.686434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782327+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:20:11.782327+0000","last_peered":"2024-09-19T05:20:11.782327+0000","last_clean":"2024-09-19T05:20:11.782327+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:20:11.782327+0000","last_undegraded":"2024-09-19T05:20:11.782327+0000","last_fullsized":"2024-09-19T05:20:11.782327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691695+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:20:11.691695+0000","last_peered":"2024-09-19T05:20:11.691695+0000","last_clean":"2024-09-19T05:20:11.691695+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:20:11.691695+0000","last_undegraded":"2024-09-19T05:20:11.691695+0000","last_fullsized":"2024-09-19T05:20:11.691695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688373+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:20:11.688373+0000","last_peered":"2024-09-19T05:20:11.688373+0000","last_clean":"2024-09-19T05:20:11.688373+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:20:11.688373+0000","last_undegraded":"2024-09-19T05:20:11.688373+0000","last_fullsized":"2024-09-19T05:20:11.688373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686547+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:20:11.686547+0000","last_peered":"2024-09-19T05:20:11.686547+0000","last_clean":"2024-09-19T05:20:11.686547+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:20:11.686547+0000","last_undegraded":"2024-09-19T05:20:11.686547+0000","last_fullsized":"2024-09-19T05:20:11.686547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.783422+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:20:11.783422+0000","last_peered":"2024-09-19T05:20:11.783422+0000","last_clean":"2024-09-19T05:20:11.783422+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:20:11.783422+0000","last_undegraded":"2024-09-19T05:20:11.783422+0000","last_fullsized":"2024-09-19T05:20:11.783422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687153+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:20:11.687153+0000","last_peered":"2024-09-19T05:20:11.687153+0000","last_clean":"2024-09-19T05:20:11.687153+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:20:11.687153+0000","last_undegraded":"2024-09-19T05:20:11.687153+0000","last_fullsized":"2024-09-19T05:20:11.687153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'30","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:37.215547+0000","last_change":"2024-09-19T05:18:59.697949+0000","last_active":"2024-09-19T05:20:37.215547+0000","last_peered":"2024-09-19T05:20:37.215547+0000","last_clean":"2024-09-19T05:20:37.215547+0000","last_became_active":"2024-09-19T05:18:59.697556+0000","last_became_peered":"2024-09-19T05:18:59.697556+0000","last_unstale":"2024-09-19T05:20:37.215547+0000","last_undegraded":"2024-09-19T05:20:37.215547+0000","last_fullsized":"2024-09-19T05:20:37.215547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.995278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64507,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":114,"num_read_kb":120,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.784541+0000","last_change":"2024-09-19T05:20:11.784172+0000","last_active":"2024-09-19T05:20:11.784541+0000","last_peered":"2024-09-19T05:20:11.784541+0000","last_clean":"2024-09-19T05:20:11.784541+0000","last_became_active":"2024-09-19T05:20:11.783884+0000","last_became_peered":"2024-09-19T05:20:11.783884+0000","last_unstale":"2024-09-19T05:20:11.784541+0000","last_undegraded":"2024-09-19T05:20:11.784541+0000","last_fullsized":"2024-09-19T05:20:11.784541+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:25.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088523+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:20:12.088523+0000","last_peered":"2024-09-19T05:20:12.088523+0000","last_clean":"2024-09-19T05:20:12.088523+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:20:12.088523+0000","last_undegraded":"2024-09-19T05:20:12.088523+0000","last_fullsized":"2024-09-19T05:20:12.088523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782268+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:20:11.782268+0000","last_peered":"2024-09-19T05:20:11.782268+0000","last_clean":"2024-09-19T05:20:11.782268+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:20:11.782268+0000","last_undegraded":"2024-09-19T05:20:11.782268+0000","last_fullsized":"2024-09-19T05:20:11.782268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087482+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:20:12.087482+0000","last_peered":"2024-09-19T05:20:12.087482+0000","last_clean":"2024-09-19T05:20:12.087482+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:20:12.087482+0000","last_undegraded":"2024-09-19T05:20:12.087482+0000","last_fullsized":"2024-09-19T05:20:12.087482+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086320+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:20:12.086320+0000","last_peered":"2024-09-19T05:20:12.086320+0000","last_clean":"2024-09-19T05:20:12.086320+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:20:12.086320+0000","last_undegraded":"2024-09-19T05:20:12.086320+0000","last_fullsized":"2024-09-19T05:20:12.086320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686497+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:20:11.686497+0000","last_peered":"2024-09-19T05:20:11.686497+0000","last_clean":"2024-09-19T05:20:11.686497+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:20:11.686497+0000","last_undegraded":"2024-09-19T05:20:11.686497+0000","last_fullsized":"2024-09-19T05:20:11.686497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.684833+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:20:11.684833+0000","last_peered":"2024-09-19T05:20:11.684833+0000","last_clean":"2024-09-19T05:20:11.684833+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:20:11.684833+0000","last_undegraded":"2024-09-19T05:20:11.684833+0000","last_fullsized":"2024-09-19T05:20:11.684833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087256+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:20:12.087256+0000","last_peered":"2024-09-19T05:20:12.087256+0000","last_clean":"2024-09-19T05:20:12.087256+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:20:12.087256+0000","last_undegraded":"2024-09-19T05:20:12.087256+0000","last_fullsized":"2024-09-19T05:20:12.087256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687849+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:20:11.687849+0000","last_peered":"2024-09-19T05:20:11.687849+0000","last_clean":"2024-09-19T05:20:11.687849+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:20:11.687849+0000","last_undegraded":"2024-09-19T05:20:11.687849+0000","last_fullsized":"2024-09-19T05:20:11.687849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763013+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:20:11.763013+0000","last_peered":"2024-09-19T05:20:11.763013+0000","last_clean":"2024-09-19T05:20:11.763013+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:20:11.763013+0000","last_undegraded":"2024-09-19T05:20:11.763013+0000","last_fullsized":"2024-09-19T05:20:11.763013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086101+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:20:12.086101+0000","last_peered":"2024-09-19T05:20:12.086101+0000","last_clean":"2024-09-19T05:20:12.086101+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:20:12.086101+0000","last_undegraded":"2024-09-19T05:20:12.086101+0000","last_fullsized":"2024-09-19T05:20:12.086101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.684945+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:20:11.684945+0000","last_peered":"2024-09-19T05:20:11.684945+0000","last_clean":"2024-09-19T05:20:11.684945+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:20:11.684945+0000","last_undegraded":"2024-09-19T05:20:11.684945+0000","last_fullsized":"2024-09-19T05:20:11.684945+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782101+0000","last_change":"2024-09-19T05:18:59.690280+0000","last_active":"2024-09-19T05:20:11.782101+0000","last_peered":"2024-09-19T05:20:11.782101+0000","last_clean":"2024-09-19T05:20:11.782101+0000","last_became_active":"2024-09-19T05:18:59.689990+0000","last_became_peered":"2024-09-19T05:18:59.689990+0000","last_unstale":"2024-09-19T05:20:11.782101+0000","last_undegraded":"2024-09-19T05:20:11.782101+0000","last_fullsized":"2024-09-19T05:20:11.782101+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:24.937837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691703+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:20:11.691703+0000","last_peered":"2024-09-19T05:20:11.691703+0000","last_clean":"2024-09-19T05:20:11.691703+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:20:11.691703+0000","last_undegraded":"2024-09-19T05:20:11.691703+0000","last_fullsized":"2024-09-19T05:20:11.691703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763012+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:20:11.763012+0000","last_peered":"2024-09-19T05:20:11.763012+0000","last_clean":"2024-09-19T05:20:11.763012+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:20:11.763012+0000","last_undegraded":"2024-09-19T05:20:11.763012+0000","last_fullsized":"2024-09-19T05:20:11.763012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688142+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:20:11.688142+0000","last_peered":"2024-09-19T05:20:11.688142+0000","last_clean":"2024-09-19T05:20:11.688142+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:20:11.688142+0000","last_undegraded":"2024-09-19T05:20:11.688142+0000","last_fullsized":"2024-09-19T05:20:11.688142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.090144+0000","last_change":"2024-09-19T05:20:12.090144+0000","last_active":"2024-09-19T05:20:12.090144+0000","last_peered":"2024-09-19T05:20:12.090144+0000","last_clean":"2024-09-19T05:20:12.090144+0000","last_became_active":"2024-09-19T05:20:12.089669+0000","last_became_peered":"2024-09-19T05:20:12.089669+0000","last_unstale":"2024-09-19T05:20:12.090144+0000","last_undegraded":"2024-09-19T05:20:12.090144+0000","last_fullsized":"2024-09-19T05:20:12.090144+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:39.253036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782966+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:20:11.782966+0000","last_peered":"2024-09-19T05:20:11.782966+0000","last_clean":"2024-09-19T05:20:11.782966+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:20:11.782966+0000","last_undegraded":"2024-09-19T05:20:11.782966+0000","last_fullsized":"2024-09-19T05:20:11.782966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686358+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:20:11.686358+0000","last_peered":"2024-09-19T05:20:11.686358+0000","last_clean":"2024-09-19T05:20:11.686358+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:20:11.686358+0000","last_undegraded":"2024-09-19T05:20:11.686358+0000","last_fullsized":"2024-09-19T05:20:11.686358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782149+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:20:11.782149+0000","last_peered":"2024-09-19T05:20:11.782149+0000","last_clean":"2024-09-19T05:20:11.782149+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:20:11.782149+0000","last_undegraded":"2024-09-19T05:20:11.782149+0000","last_fullsized":"2024-09-19T05:20:11.782149+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687504+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:20:11.687504+0000","last_peered":"2024-09-19T05:20:11.687504+0000","last_clean":"2024-09-19T05:20:11.687504+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:20:11.687504+0000","last_undegraded":"2024-09-19T05:20:11.687504+0000","last_fullsized":"2024-09-19T05:20:11.687504+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686327+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:20:11.686327+0000","last_peered":"2024-09-19T05:20:11.686327+0000","last_clean":"2024-09-19T05:20:11.686327+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:20:11.686327+0000","last_undegraded":"2024-09-19T05:20:11.686327+0000","last_fullsized":"2024-09-19T05:20:11.686327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.693523+0000","last_change":"2024-09-19T05:20:11.693523+0000","last_active":"2024-09-19T05:20:11.693523+0000","last_peered":"2024-09-19T05:20:11.693523+0000","last_clean":"2024-09-19T05:20:11.693523+0000","last_became_active":"2024-09-19T05:20:11.693018+0000","last_became_peered":"2024-09-19T05:20:11.693018+0000","last_unstale":"2024-09-19T05:20:11.693523+0000","last_undegraded":"2024-09-19T05:20:11.693523+0000","last_fullsized":"2024-09-19T05:20:11.693523+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:09.595591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.687006+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:20:11.687006+0000","last_peered":"2024-09-19T05:20:11.687006+0000","last_clean":"2024-09-19T05:20:11.687006+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:20:11.687006+0000","last_undegraded":"2024-09-19T05:20:11.687006+0000","last_fullsized":"2024-09-19T05:20:11.687006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686092+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:20:11.686092+0000","last_peered":"2024-09-19T05:20:11.686092+0000","last_clean":"2024-09-19T05:20:11.686092+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:20:11.686092+0000","last_undegraded":"2024-09-19T05:20:11.686092+0000","last_fullsized":"2024-09-19T05:20:11.686092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086022+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:20:12.086022+0000","last_peered":"2024-09-19T05:20:12.086022+0000","last_clean":"2024-09-19T05:20:12.086022+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:20:12.086022+0000","last_undegraded":"2024-09-19T05:20:12.086022+0000","last_fullsized":"2024-09-19T05:20:12.086022+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688212+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:20:11.688212+0000","last_peered":"2024-09-19T05:20:11.688212+0000","last_clean":"2024-09-19T05:20:11.688212+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:20:11.688212+0000","last_undegraded":"2024-09-19T05:20:11.688212+0000","last_fullsized":"2024-09-19T05:20:11.688212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692049+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:20:11.692049+0000","last_peered":"2024-09-19T05:20:11.692049+0000","last_clean":"2024-09-19T05:20:11.692049+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:20:11.692049+0000","last_undegraded":"2024-09-19T05:20:11.692049+0000","last_fullsized":"2024-09-19T05:20:11.692049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686484+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:20:11.686484+0000","last_peered":"2024-09-19T05:20:11.686484+0000","last_clean":"2024-09-19T05:20:11.686484+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:20:11.686484+0000","last_undegraded":"2024-09-19T05:20:11.686484+0000","last_fullsized":"2024-09-19T05:20:11.686484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763475+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:20:11.763475+0000","last_peered":"2024-09-19T05:20:11.763475+0000","last_clean":"2024-09-19T05:20:11.763475+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:20:11.763475+0000","last_undegraded":"2024-09-19T05:20:11.763475+0000","last_fullsized":"2024-09-19T05:20:11.763475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.782676+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:20:11.782676+0000","last_peered":"2024-09-19T05:20:11.782676+0000","last_clean":"2024-09-19T05:20:11.782676+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:20:11.782676+0000","last_undegraded":"2024-09-19T05:20:11.782676+0000","last_fullsized":"2024-09-19T05:20:11.782676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.763206+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:20:11.763206+0000","last_peered":"2024-09-19T05:20:11.763206+0000","last_clean":"2024-09-19T05:20:11.763206+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:20:11.763206+0000","last_undegraded":"2024-09-19T05:20:11.763206+0000","last_fullsized":"2024-09-19T05:20:11.763206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.088097+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:20:12.088097+0000","last_peered":"2024-09-19T05:20:12.088097+0000","last_clean":"2024-09-19T05:20:12.088097+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:20:12.088097+0000","last_undegraded":"2024-09-19T05:20:12.088097+0000","last_fullsized":"2024-09-19T05:20:12.088097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688322+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:20:11.688322+0000","last_peered":"2024-09-19T05:20:11.688322+0000","last_clean":"2024-09-19T05:20:11.688322+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:20:11.688322+0000","last_undegraded":"2024-09-19T05:20:11.688322+0000","last_fullsized":"2024-09-19T05:20:11.688322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691833+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:20:11.691833+0000","last_peered":"2024-09-19T05:20:11.691833+0000","last_clean":"2024-09-19T05:20:11.691833+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:20:11.691833+0000","last_undegraded":"2024-09-19T05:20:11.691833+0000","last_fullsized":"2024-09-19T05:20:11.691833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686543+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:20:11.686543+0000","last_peered":"2024-09-19T05:20:11.686543+0000","last_clean":"2024-09-19T05:20:11.686543+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:20:11.686543+0000","last_undegraded":"2024-09-19T05:20:11.686543+0000","last_fullsized":"2024-09-19T05:20:11.686543+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.685350+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:20:11.685350+0000","last_peered":"2024-09-19T05:20:11.685350+0000","last_clean":"2024-09-19T05:20:11.685350+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:20:11.685350+0000","last_undegraded":"2024-09-19T05:20:11.685350+0000","last_fullsized":"2024-09-19T05:20:11.685350+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.692119+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:20:11.692119+0000","last_peered":"2024-09-19T05:20:11.692119+0000","last_clean":"2024-09-19T05:20:11.692119+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:20:11.692119+0000","last_undegraded":"2024-09-19T05:20:11.692119+0000","last_fullsized":"2024-09-19T05:20:11.692119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086535+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:20:12.086535+0000","last_peered":"2024-09-19T05:20:12.086535+0000","last_clean":"2024-09-19T05:20:12.086535+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:20:12.086535+0000","last_undegraded":"2024-09-19T05:20:12.086535+0000","last_fullsized":"2024-09-19T05:20:12.086535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086013+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:20:12.086013+0000","last_peered":"2024-09-19T05:20:12.086013+0000","last_clean":"2024-09-19T05:20:12.086013+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:20:12.086013+0000","last_undegraded":"2024-09-19T05:20:12.086013+0000","last_fullsized":"2024-09-19T05:20:12.086013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.085859+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:20:12.085859+0000","last_peered":"2024-09-19T05:20:12.085859+0000","last_clean":"2024-09-19T05:20:12.085859+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:20:12.085859+0000","last_undegraded":"2024-09-19T05:20:12.085859+0000","last_fullsized":"2024-09-19T05:20:12.085859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688100+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:20:11.688100+0000","last_peered":"2024-09-19T05:20:11.688100+0000","last_clean":"2024-09-19T05:20:11.688100+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:20:11.688100+0000","last_undegraded":"2024-09-19T05:20:11.688100+0000","last_fullsized":"2024-09-19T05:20:11.688100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.087791+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:20:12.087791+0000","last_peered":"2024-09-19T05:20:12.087791+0000","last_clean":"2024-09-19T05:20:12.087791+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:20:12.087791+0000","last_undegraded":"2024-09-19T05:20:12.087791+0000","last_fullsized":"2024-09-19T05:20:12.087791+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686735+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:20:11.686735+0000","last_peered":"2024-09-19T05:20:11.686735+0000","last_clean":"2024-09-19T05:20:11.686735+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:20:11.686735+0000","last_undegraded":"2024-09-19T05:20:11.686735+0000","last_fullsized":"2024-09-19T05:20:11.686735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688192+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:20:11.688192+0000","last_peered":"2024-09-19T05:20:11.688192+0000","last_clean":"2024-09-19T05:20:11.688192+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:20:11.688192+0000","last_undegraded":"2024-09-19T05:20:11.688192+0000","last_fullsized":"2024-09-19T05:20:11.688192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086806+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:20:12.086806+0000","last_peered":"2024-09-19T05:20:12.086806+0000","last_clean":"2024-09-19T05:20:12.086806+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:20:12.086806+0000","last_undegraded":"2024-09-19T05:20:12.086806+0000","last_fullsized":"2024-09-19T05:20:12.086806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.762838+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:20:11.762838+0000","last_peered":"2024-09-19T05:20:11.762838+0000","last_clean":"2024-09-19T05:20:11.762838+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:20:11.762838+0000","last_undegraded":"2024-09-19T05:20:11.762838+0000","last_fullsized":"2024-09-19T05:20:11.762838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.686274+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:20:11.686274+0000","last_peered":"2024-09-19T05:20:11.686274+0000","last_clean":"2024-09-19T05:20:11.686274+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:20:11.686274+0000","last_undegraded":"2024-09-19T05:20:11.686274+0000","last_fullsized":"2024-09-19T05:20:11.686274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691043+0000","last_change":"2024-09-19T05:20:11.691043+0000","last_active":"2024-09-19T05:20:11.691043+0000","last_peered":"2024-09-19T05:20:11.691043+0000","last_clean":"2024-09-19T05:20:11.691043+0000","last_became_active":"2024-09-19T05:20:11.690672+0000","last_became_peered":"2024-09-19T05:20:11.690672+0000","last_unstale":"2024-09-19T05:20:11.691043+0000","last_undegraded":"2024-09-19T05:20:11.691043+0000","last_fullsized":"2024-09-19T05:20:11.691043+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:01.913488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.688020+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:20:11.688020+0000","last_peered":"2024-09-19T05:20:11.688020+0000","last_clean":"2024-09-19T05:20:11.688020+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:20:11.688020+0000","last_undegraded":"2024-09-19T05:20:11.688020+0000","last_fullsized":"2024-09-19T05:20:11.688020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.690487+0000","last_change":"2024-09-19T05:20:11.690113+0000","last_active":"2024-09-19T05:20:11.690487+0000","last_peered":"2024-09-19T05:20:11.690487+0000","last_clean":"2024-09-19T05:20:11.690487+0000","last_became_active":"2024-09-19T05:20:11.689729+0000","last_became_peered":"2024-09-19T05:20:11.689729+0000","last_unstale":"2024-09-19T05:20:11.690487+0000","last_undegraded":"2024-09-19T05:20:11.690487+0000","last_fullsized":"2024-09-19T05:20:11.690487+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:14.762934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086163+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:20:12.086163+0000","last_peered":"2024-09-19T05:20:12.086163+0000","last_clean":"2024-09-19T05:20:12.086163+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:20:12.086163+0000","last_undegraded":"2024-09-19T05:20:12.086163+0000","last_fullsized":"2024-09-19T05:20:12.086163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:12.086255+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:20:12.086255+0000","last_peered":"2024-09-19T05:20:12.086255+0000","last_clean":"2024-09-19T05:20:12.086255+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:20:12.086255+0000","last_undegraded":"2024-09-19T05:20:12.086255+0000","last_fullsized":"2024-09-19T05:20:12.086255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T05:20:11.691994+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:20:11.691994+0000","last_peered":"2024-09-19T05:20:11.691994+0000","last_clean":"2024-09-19T05:20:11.691994+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:20:11.691994+0000","last_undegraded":"2024-09-19T05:20:11.691994+0000","last_fullsized":"2024-09-19T05:20:11.691994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65305,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":120,"num_read_kb":126,"num_write":86,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":195915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547233,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":496291,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776166,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1101824,"data_stored":1147264,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":978944,"data_stored":500969,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135920,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":496895,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":1091337,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528379,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":492195,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":1086841,"data_compressed":59525,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":496313,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":492299,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":556736,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":556702,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":492285,"data_compressed":23477,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:20:43.875 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T05:20:43.875 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T05:20:43.875 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T05:20:43.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T05:20:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:43 smithi060 ceph-mon[35058]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:43 smithi082 ceph-mon[35195]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:43 smithi001 ceph-mon[30968]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:44.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.629+0000 7f68f8fac640 1 -- 172.21.15.1:0/2134551694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4102780 msgr2=0x7f68f41067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.629+0000 7f68f8fac640 1 --2- 172.21.15.1:0/2134551694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4102780 0x7f68f41067d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009900 tx=0x7f68e802a410 comp rx=0 tx=0).stop 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 -- 172.21.15.1:0/2134551694 shutdown_connections 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 --2- 172.21.15.1:0/2134551694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4106f00 0x7f68f410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 --2- 172.21.15.1:0/2134551694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4102780 0x7f68f41067d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 --2- 172.21.15.1:0/2134551694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 0x7f68f41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 -- 172.21.15.1:0/2134551694 >> 172.21.15.1:0/2134551694 conn(0x7f68f40fd890 msgr2=0x7f68f40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 -- 172.21.15.1:0/2134551694 shutdown_connections 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 -- 172.21.15.1:0/2134551694 wait complete. 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 Processor -- start 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.630+0000 7f68f8fac640 1 -- start start 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 0x7f68f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 0x7f68f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4111f80 con 0x7f68f4106f00 2024-09-19T05:20:44.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4111e00 con 0x7f68f4101dd0 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4112100 con 0x7f68f4102780 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34076/0 (socket says 172.21.15.1:34076) 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 -- 172.21.15.1:0/4146298618 learned_addr learned my addr 172.21.15.1:0/4146298618 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f259c640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 0x7f68f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f1d9b640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 0x7f68f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 -- 172.21.15.1:0/4146298618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 msgr2=0x7f68f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 0x7f68f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 -- 172.21.15.1:0/4146298618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 msgr2=0x7f68f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 0x7f68f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 -- 172.21.15.1:0/4146298618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f41a6960 con 0x7f68f4106f00 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f1d9b640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 0x7f68f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:44.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f2d9d640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00b970 tx=0x7f68ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec019070 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ec00cb40 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.631+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f41a6c50 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.632+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007650 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.632+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f41a7140 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.633+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f41021b0 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.634+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f68ec01c070 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.634+0000 7f68e37fe640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 0x7f68dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.634+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f68ec0cf2d0 con 0x7f68f4106f00 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.634+0000 7f68f259c640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 0x7f68dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.635+0000 7f68f259c640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 0x7f68dc0a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68e400bbe0 tx=0x7f68e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.639+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68ec09b5f0 con 0x7f68f4106f00 2024-09-19T05:20:44.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:44 smithi001 ceph-mon[30968]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:44.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.854+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68f402d7c0 con 0x7f68f4106f00 2024-09-19T05:20:44.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.854+0000 7f68e37fe640 1 -- 172.21.15.1:0/4146298618 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f68ec09f8f0 con 0x7f68f4106f00 2024-09-19T05:20:44.856 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:44.856 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 msgr2=0x7f68dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 0x7f68dc0a5790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68e400bbe0 tx=0x7f68e400b390 comp rx=0 tx=0).stop 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 msgr2=0x7f68f4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00b970 tx=0x7f68ec00be30 comp rx=0 tx=0).stop 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 shutdown_connections 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68dc0a32d0 0x7f68dc0a5790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68f4106f00 0x7f68f4074f70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68f4102780 0x7f68f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 --2- 172.21.15.1:0/4146298618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68f4101dd0 0x7f68f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:44.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 >> 172.21.15.1:0/4146298618 conn(0x7f68f40fd890 msgr2=0x7f68f40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:44.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 shutdown_connections 2024-09-19T05:20:44.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:44.856+0000 7f68f8fac640 1 -- 172.21.15.1:0/4146298618 wait complete. 2024-09-19T05:20:45.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:44 smithi082 ceph-mon[35195]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:45.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:44 smithi060 ceph-mon[35058]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:20:45.537 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T05:20:45.537 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:20:45.795 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:45 smithi082 ceph-mon[35195]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4146298618' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:20:46.054 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:45 smithi001 ceph-mon[30968]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:46.055 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:45 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4146298618' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:20:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:45 smithi060 ceph-mon[35058]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:46.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:45 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4146298618' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.316+0000 7ff2f490e640 1 -- 172.21.15.1:0/3952914284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 msgr2=0x7ff2f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.316+0000 7ff2f490e640 1 --2- 172.21.15.1:0/3952914284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f010ea90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009ca0 tx=0x7ff2e802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 -- 172.21.15.1:0/3952914284 shutdown_connections 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 --2- 172.21.15.1:0/3952914284 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f010ea90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 --2- 172.21.15.1:0/3952914284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0102790 0x7ff2f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 --2- 172.21.15.1:0/3952914284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0101de0 0x7ff2f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 -- 172.21.15.1:0/3952914284 >> 172.21.15.1:0/3952914284 conn(0x7ff2f00fd8c0 msgr2=0x7ff2f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 -- 172.21.15.1:0/3952914284 shutdown_connections 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 -- 172.21.15.1:0/3952914284 wait complete. 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.317+0000 7ff2f490e640 1 Processor -- start 2024-09-19T05:20:46.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 -- start start 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0101de0 0x7ff2f01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0102790 0x7ff2f0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0112010 con 0x7ff2f0106f10 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0111e90 con 0x7ff2f0102790 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2f490e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0112190 con 0x7ff2f0101de0 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34108/0 (socket says 172.21.15.1:34108) 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 -- 172.21.15.1:0/223134751 learned_addr learned my addr 172.21.15.1:0/223134751 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2ee59c640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0101de0 0x7ff2f01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2edd9b640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0102790 0x7ff2f0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 -- 172.21.15.1:0/223134751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0101de0 msgr2=0x7ff2f01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0101de0 0x7ff2f01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 -- 172.21.15.1:0/223134751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0102790 msgr2=0x7ff2f0198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0102790 0x7ff2f0198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 -- 172.21.15.1:0/223134751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f019d5a0 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.318+0000 7ff2eed9d640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8031a60 tx=0x7ff2e8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.319+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003b70 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.319+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2e8003d10 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.319+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f019d830 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.319+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004770 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.319+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f01a5170 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.320+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f0102240 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.321+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff2e802f790 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.322+0000 7ff2df7fe640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 0x7ff2d80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.322+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff2e80f1140 con 0x7ff2f0106f10 2024-09-19T05:20:46.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.322+0000 7ff2ee59c640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 0x7ff2d80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.322+0000 7ff2ee59c640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 0x7ff2d80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009990 tx=0x7ff2e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.325+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2e80bdab0 con 0x7ff2f0106f10 2024-09-19T05:20:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.539+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f0199950 con 0x7ff2f0106f10 2024-09-19T05:20:46.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.540+0000 7ff2df7fe640 1 -- 172.21.15.1:0/223134751 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7ff2f0199950 con 0x7ff2f0106f10 2024-09-19T05:20:46.542 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:46.542 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:20:46.542 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:20:46.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 msgr2=0x7ff2d80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 0x7ff2d80a5810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009990 tx=0x7ff2e0009110 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 msgr2=0x7ff2f019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8031a60 tx=0x7ff2e8031a90 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 shutdown_connections 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff2d80a3350 0x7ff2d80a5810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2f0106f10 0x7ff2f019cec0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2f0102790 0x7ff2f0198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 --2- 172.21.15.1:0/223134751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2f0101de0 0x7ff2f01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 >> 172.21.15.1:0/223134751 conn(0x7ff2f00fd8c0 msgr2=0x7ff2f00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 shutdown_connections 2024-09-19T05:20:46.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:46.542+0000 7ff2f490e640 1 -- 172.21.15.1:0/223134751 wait complete. 2024-09-19T05:20:46.934 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:46 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/223134751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:47.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:46 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/223134751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:47.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:46 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/223134751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:47.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:20:47.580 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:47.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:47 smithi001 ceph-mon[30968]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:48.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 -- 172.21.15.1:0/1786534626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec100e20 msgr2=0x7f05ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 --2- 172.21.15.1:0/1786534626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec100e20 0x7f05ec101200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009900 tx=0x7f05dc02a480 comp rx=0 tx=0).stop 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 -- 172.21.15.1:0/1786534626 shutdown_connections 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 --2- 172.21.15.1:0/1786534626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec102ef0 0x7f05ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 --2- 172.21.15.1:0/1786534626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 0x7f05ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 --2- 172.21.15.1:0/1786534626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec100e20 0x7f05ec101200 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 -- 172.21.15.1:0/1786534626 >> 172.21.15.1:0/1786534626 conn(0x7f05ec0fc7d0 msgr2=0x7f05ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 -- 172.21.15.1:0/1786534626 shutdown_connections 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 -- 172.21.15.1:0/1786534626 wait complete. 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.050+0000 7f05f1761640 1 Processor -- start 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 -- start start 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec100e20 0x7f05ec19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 0x7f05ec19ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec110f80 con 0x7f05ec102ef0 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec110e00 con 0x7f05ec102570 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05f1761640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec111100 con 0x7f05ec100e20 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34128/0 (socket says 172.21.15.1:34128) 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 -- 172.21.15.1:0/2437952219 learned_addr learned my addr 172.21.15.1:0/2437952219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eaffd640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec100e20 0x7f05ec19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05ea7fc640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 0x7f05ec19ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 -- 172.21.15.1:0/2437952219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec100e20 msgr2=0x7f05ec19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec100e20 0x7f05ec19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 -- 172.21.15.1:0/2437952219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 msgr2=0x7f05ec19ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 0x7f05ec19ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 -- 172.21.15.1:0/2437952219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec19e710 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.051+0000 7f05eb7fe640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.052+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4017070 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.052+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05e4003e50 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.052+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec19ea00 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.052+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e40106c0 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.052+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec1a7370 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.053+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec101200 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.055+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f05e4003970 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.055+0000 7f05e3fff640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 0x7f05d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.056+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f05e40cfb10 con 0x7f05ec102ef0 2024-09-19T05:20:48.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.056+0000 7f05eaffd640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 0x7f05d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.056+0000 7f05eaffd640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 0x7f05d80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009230 tx=0x7f05dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.059+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05e409c370 con 0x7f05ec102ef0 2024-09-19T05:20:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:47 smithi060 ceph-mon[35058]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:47 smithi082 ceph-mon[35195]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:48.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.272+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05ec1a7540 con 0x7f05ec102ef0 2024-09-19T05:20:48.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.272+0000 7f05e3fff640 1 -- 172.21.15.1:0/2437952219 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f05e409bc70 con 0x7f05ec102ef0 2024-09-19T05:20:48.274 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:48.274 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:20:48.275 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 msgr2=0x7f05d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 0x7f05d80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009230 tx=0x7f05dc0058d0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 msgr2=0x7f05ec19dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e400b260 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 shutdown_connections 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f05d80a32d0 0x7f05d80a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05ec102ef0 0x7f05ec19dfe0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05ec102570 0x7f05ec19ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 --2- 172.21.15.1:0/2437952219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ec100e20 0x7f05ec19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 >> 172.21.15.1:0/2437952219 conn(0x7f05ec0fc7d0 msgr2=0x7f05ec06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 shutdown_connections 2024-09-19T05:20:48.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:48.275+0000 7f05f1761640 1 -- 172.21.15.1:0/2437952219 wait complete. 2024-09-19T05:20:49.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2437952219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:49.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:20:49.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2437952219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2437952219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:49.354 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:49.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 -- 172.21.15.1:0/4215581226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102570 msgr2=0x7fa6441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 --2- 172.21.15.1:0/4215581226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102570 0x7fa6441029b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa634009900 tx=0x7fa63402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 -- 172.21.15.1:0/4215581226 shutdown_connections 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 --2- 172.21.15.1:0/4215581226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644102ef0 0x7fa64410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 --2- 172.21.15.1:0/4215581226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102570 0x7fa6441029b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 --2- 172.21.15.1:0/4215581226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644100e20 0x7fa644101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.832+0000 7fa64c441640 1 -- 172.21.15.1:0/4215581226 >> 172.21.15.1:0/4215581226 conn(0x7fa6440fc7d0 msgr2=0x7fa6440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.833+0000 7fa64c441640 1 -- 172.21.15.1:0/4215581226 shutdown_connections 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.833+0000 7fa64c441640 1 -- 172.21.15.1:0/4215581226 wait complete. 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.833+0000 7fa64c441640 1 Processor -- start 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.833+0000 7fa64c441640 1 -- start start 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644100e20 0x7fa644199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:49.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644102570 0x7fa644199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa644110f80 con 0x7fa644102ef0 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa644110e00 con 0x7fa644102570 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa644111100 con 0x7fa644100e20 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34142/0 (socket says 172.21.15.1:34142) 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 -- 172.21.15.1:0/904902426 learned_addr learned my addr 172.21.15.1:0/904902426 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a1dd640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644100e20 0x7fa644199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa6499dc640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644102570 0x7fa644199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 -- 172.21.15.1:0/904902426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644100e20 msgr2=0x7fa644199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644100e20 0x7fa644199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 -- 172.21.15.1:0/904902426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644102570 msgr2=0x7fa644199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644102570 0x7fa644199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 -- 172.21.15.1:0/904902426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6441a48f0 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64a9de640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00cad0 tx=0x7fa63c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00ae20 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63c005020 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6441a4ac0 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.834+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00f6f0 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.835+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6441a4fd0 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.835+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa644101200 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.837+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa63c0051d0 con 0x7fa644102ef0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.837+0000 7fa63b7fe640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 0x7fa6300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.837+0000 7fa64a1dd640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 0x7fa6300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.837+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa63c0d0090 con 0x7fa644102ef0 2024-09-19T05:20:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.838+0000 7fa64a1dd640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 0x7fa6300a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa640009bd0 tx=0x7fa640005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:49.841+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa63c014030 con 0x7fa644102ef0 2024-09-19T05:20:50.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.019+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa64406a560 con 0x7fa644102ef0 2024-09-19T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:49 smithi001 ceph-mon[30968]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:50.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.021+0000 7fa63b7fe640 1 -- 172.21.15.1:0/904902426 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24550 (secure 0 0 0) 0x7fa64406a560 con 0x7fa644102ef0 2024-09-19T05:20:50.023 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:50.024 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":89,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:20:11.682030+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:20:50.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 msgr2=0x7fa6300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:50.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 0x7fa6300a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa640009bd0 tx=0x7fa640005f90 comp rx=0 tx=0).stop 2024-09-19T05:20:50.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 msgr2=0x7fa6441a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00cad0 tx=0x7fa63c00cf90 comp rx=0 tx=0).stop 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 shutdown_connections 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa6300a32d0 0x7fa6300a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa644102ef0 0x7fa6441a43b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa644102570 0x7fa644199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 --2- 172.21.15.1:0/904902426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa644100e20 0x7fa644199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 >> 172.21.15.1:0/904902426 conn(0x7fa6440fc7d0 msgr2=0x7fa6440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 shutdown_connections 2024-09-19T05:20:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:50.023+0000 7fa64c441640 1 -- 172.21.15.1:0/904902426 wait complete. 2024-09-19T05:20:50.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:49 smithi060 ceph-mon[35058]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:49 smithi082 ceph-mon[35195]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:50.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:20:51.047 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:51.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:50 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/904902426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:51.151 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:50 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/904902426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:51.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:50 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/904902426' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:20:51.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 -- 172.21.15.1:0/234644973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 msgr2=0x7f6fd0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/234644973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd0103120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009900 tx=0x7f6fc402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 -- 172.21.15.1:0/234644973 shutdown_connections 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/234644973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 0x7f6fd010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/234644973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 0x7f6fd010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/234644973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd0103120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 -- 172.21.15.1:0/234644973 >> 172.21.15.1:0/234644973 conn(0x7f6fd00fc7a0 msgr2=0x7f6fd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 -- 172.21.15.1:0/234644973 shutdown_connections 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.542+0000 7f6fd6e13640 1 -- 172.21.15.1:0/234644973 wait complete. 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 Processor -- start 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 -- start start 2024-09-19T05:20:51.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 0x7f6fd01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 0x7f6fd019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0111f70 con 0x7f6fd0102d40 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0111df0 con 0x7f6fd0103660 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd6e13640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01120f0 con 0x7f6fd010c170 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd4baf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd4baf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34160/0 (socket says 172.21.15.1:34160) 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fd4baf640 1 -- 172.21.15.1:0/2387763344 learned_addr learned my addr 172.21.15.1:0/2387763344 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.543+0000 7f6fcffff640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 0x7f6fd01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd53b0640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 0x7f6fd019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 -- 172.21.15.1:0/2387763344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 msgr2=0x7f6fd019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 0x7f6fd019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 -- 172.21.15.1:0/2387763344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 msgr2=0x7f6fd01988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 0x7f6fd01988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 -- 172.21.15.1:0/2387763344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd019d350 con 0x7f6fd0102d40 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd4baf640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4006010 tx=0x7f6fc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc403f030 con 0x7f6fd0102d40 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fc4003ce0 con 0x7f6fd0102d40 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd019d5e0 con 0x7f6fd0102d40 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.544+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4035070 con 0x7f6fd0102d40 2024-09-19T05:20:51.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.545+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd01a4f20 con 0x7f6fd0102d40 2024-09-19T05:20:51.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.546+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd006b070 con 0x7f6fd0102d40 2024-09-19T05:20:51.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.547+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6fc4042030 con 0x7f6fd0102d40 2024-09-19T05:20:51.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.548+0000 7f6fcdffb640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 0x7f6fc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.548+0000 7f6fcffff640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 0x7f6fc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.548+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6fc40eff90 con 0x7f6fd0102d40 2024-09-19T05:20:51.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.548+0000 7f6fcffff640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 0x7f6fc00a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fd010d540 tx=0x7f6fbc00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.552+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6fc40bc200 con 0x7f6fd0102d40 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.765+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fd0107210 con 0x7f6fd0102d40 2024-09-19T05:20:51.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.766+0000 7f6fcdffb640 1 -- 172.21.15.1:0/2387763344 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f6fc40c0500 con 0x7f6fd0102d40 2024-09-19T05:20:51.769 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:20:51.769 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:20:51.769 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 msgr2=0x7f6fc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 0x7f6fc00a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fd010d540 tx=0x7f6fbc00b2e0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 msgr2=0x7f6fd01983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4006010 tx=0x7f6fc40042f0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 shutdown_connections 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fc00a32d0 0x7f6fc00a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fd010c170 0x7f6fd019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd0103660 0x7f6fd01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 --2- 172.21.15.1:0/2387763344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fd0102d40 0x7f6fd01983a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 >> 172.21.15.1:0/2387763344 conn(0x7f6fd00fc7a0 msgr2=0x7f6fd00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 shutdown_connections 2024-09-19T05:20:51.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:51.768+0000 7f6fd6e13640 1 -- 172.21.15.1:0/2387763344 wait complete. 2024-09-19T05:20:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:51 smithi001 ceph-mon[30968]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:51 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2387763344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:52.179 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:51 smithi082 ceph-mon[35195]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:52.180 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:51 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2387763344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:52.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:51 smithi060 ceph-mon[35058]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:51 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2387763344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:52.550 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:19:02.579382+0000', 'modified': '2024-09-19T05:19:46.933700+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/1625002585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1625002585}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1625002585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6839/1656123730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1656123730}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1656123730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T05:20:52.550 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:20:52.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:20:52.810 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 -- 172.21.15.1:0/871631447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4102e00 msgr2=0x7fc8d41031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 --2- 172.21.15.1:0/871631447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4102e00 0x7fc8d41031e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009900 tx=0x7fc8c402a480 comp rx=0 tx=0).stop 2024-09-19T05:20:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 -- 172.21.15.1:0/871631447 shutdown_connections 2024-09-19T05:20:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 --2- 172.21.15.1:0/871631447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d410c1a0 0x7fc8d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 --2- 172.21.15.1:0/871631447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d4103720 0x7fc8d410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 --2- 172.21.15.1:0/871631447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4102e00 0x7fc8d41031e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 -- 172.21.15.1:0/871631447 >> 172.21.15.1:0/871631447 conn(0x7fc8d40fc7a0 msgr2=0x7fc8d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 -- 172.21.15.1:0/871631447 shutdown_connections 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.320+0000 7fc8d9652640 1 -- 172.21.15.1:0/871631447 wait complete. 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 Processor -- start 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 -- start start 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4102e00 0x7fc8d4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d410c1a0 0x7fc8d419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4111f70 con 0x7fc8d4103720 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4111df0 con 0x7fc8d4102e00 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8d9652640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d41120f0 con 0x7fc8d410c1a0 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34180/0 (socket says 172.21.15.1:34180) 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.321+0000 7fc8cbfff640 1 -- 172.21.15.1:0/428040710 learned_addr learned my addr 172.21.15.1:0/428040710 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4102e00 0x7fc8d4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d410c1a0 0x7fc8d419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 -- 172.21.15.1:0/428040710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d410c1a0 msgr2=0x7fc8d419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d410c1a0 0x7fc8d419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 -- 172.21.15.1:0/428040710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4102e00 msgr2=0x7fc8d4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4102e00 0x7fc8d4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 -- 172.21.15.1:0/428040710 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d419d440 con 0x7fc8d4103720 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d0ff9640 1 -- 172.21.15.1:0/428040710 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00cd80 con 0x7fc8d4103720 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d0ff9640 1 -- 172.21.15.1:0/428040710 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc005500 con 0x7fc8d4103720 2024-09-19T05:20:53.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d419d730 con 0x7fc8d4103720 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d0ff9640 1 -- 172.21.15.1:0/428040710 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc010690 con 0x7fc8d4103720 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.322+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41a5010 con 0x7fc8d4103720 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.324+0000 7fc8d0ff9640 1 -- 172.21.15.1:0/428040710 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc8bc0046c0 con 0x7fc8d4103720 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 Processor -- start 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 -- start start 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f377670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f379fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f2d3090 con 0x55bd5f36c9d0 2024-09-19T05:20:53.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f27aa70 con 0x55bd5f36d2f0 2024-09-19T05:20:53.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f2cf050 con 0x55bd5f377bb0 2024-09-19T05:20:53.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34184/0 (socket says 172.21.15.1:34184) 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8d37fe640 1 -- 172.21.15.1:0/3193901739 learned_addr learned my addr 172.21.15.1:0/3193901739 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f379fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.325+0000 7fc8d0ff9640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 -- 172.21.15.1:0/3193901739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 msgr2=0x55bd5f379fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f379fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 -- 172.21.15.1:0/3193901739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 msgr2=0x55bd5f377670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f377670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f377670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d0ff9640 1 -- 172.21.15.1:0/428040710 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc8bc0d01e0 con 0x7fc8d4103720 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 -- 172.21.15.1:0/3193901739 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd5f287130 con 0x55bd5f36c9d0 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f377670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:53.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0139d0 tx=0x7fc8cc013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c723ac0251581b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8c97fa640 1 -- 172.21.15.1:0/3193901739 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc013050 con 0x55bd5f36c9d0 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8c97fa640 1 -- 172.21.15.1:0/3193901739 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8cc022070 con 0x55bd5f36c9d0 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8c97fa640 1 -- 172.21.15.1:0/3193901739 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc012690 con 0x55bd5f36c9d0 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.326+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc021000 tx=0x7fc8cc01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3193901739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 msgr2=0x55bd5f36cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc0139d0 tx=0x7fc8cc013e90 comp rx=0 tx=0).stop 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3193901739 shutdown_connections 2024-09-19T05:20:53.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f379fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f377670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3193901739 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f36cdb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3193901739 >> 172.21.15.1:0/3193901739 conn(0x55bd5f368f60 msgr2=0x55bd5f369340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3193901739 shutdown_connections 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.327+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3193901739 wait complete. 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 -- start start 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 Processor -- start 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36c9d0 0x55bd5f377470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f374d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f37a780 con 0x55bd5f36d2f0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f28df20 con 0x55bd5f36c9d0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f37a900 con 0x55bd5f377bb0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8dba2b740 10 client.0 _ll_register_callbacks cb 0x55bd5f257030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34190/0 (socket says 172.21.15.1:34190) 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 -- 172.21.15.1:0/2244466762 learned_addr learned my addr 172.21.15.1:0/2244466762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36c9d0 0x55bd5f377470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f374d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 -- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 msgr2=0x55bd5f374d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f374d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 -- 172.21.15.1:0/2244466762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36c9d0 msgr2=0x55bd5f377470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36c9d0 0x55bd5f377470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.328+0000 7fc8cbfff640 1 -- 172.21.15.1:0/2244466762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd5f0442b0 con 0x55bd5f36d2f0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc09c2d0 tx=0x7fc8bc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb9bdb5f9c6b061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc09bca0 con 0x55bd5f36d2f0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc8bc0a4b20 con 0x55bd5f36d2f0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8cc022070 con 0x55bd5f36d2f0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc09ca40 con 0x55bd5f36d2f0 2024-09-19T05:20:53.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 10 client.15054 fetch_fsmap learned FSMap version 21 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bd5f386040 con 0x55bd5f36d2f0 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8cc022070 con 0x55bd5f36d2f0 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc8bc09b790 con 0x55bd5f36d2f0 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 10 client.15054 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 10 client.15054 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 20 client.15054 populate_metadata read hostname 'smithi001' 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f388640 0x55bd5f389ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 4 client.15054 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.329+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd5f2e0600 con 0x55bd5f388640 2024-09-19T05:20:53.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.330+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f388640 0x55bd5f389ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.330+0000 7fc8ba7fc640 10 client.15054 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.330+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f388640 0x55bd5f389ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b5dff30c2fd50e server_cookie=1cdb43c68b108a21 in_seq=0 out_seq=0 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/2244466762 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd5f2e0600 con 0x55bd5f388640 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8ba7fc640 10 client.15054 handle_command_reply: tid=0 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 client.15054 shutdown 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 msgr2=0x55bd5f3747c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc09c2d0 tx=0x7fc8bc005f10 comp rx=0 tx=0).stop 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 shutdown_connections 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f388640 0x55bd5f389ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f374d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3747c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/2244466762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36c9d0 0x55bd5f377470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 >> 172.21.15.1:0/2244466762 conn(0x55bd5f368f60 msgr2=0x55bd5f36ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8ba7fc640 0 client.15054 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:20:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 shutdown_connections 2024-09-19T05:20:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 1 -- 172.21.15.1:0/2244466762 wait complete. 2024-09-19T05:20:53.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.331+0000 7fc8dba2b740 20 client.15054 trim_cache size 0 max 16384 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 Processor -- start 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 -- start start 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3893e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 0x55bd5f374780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f387df0 con 0x55bd5f36c9d0 2024-09-19T05:20:53.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f3884c0 con 0x55bd5f377bb0 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.349+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f388b90 con 0x55bd5f36d2f0 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3893e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34196/0 (socket says 172.21.15.1:34196) 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d2ffd640 1 -- 172.21.15.1:0/1171225600 learned_addr learned my addr 172.21.15.1:0/1171225600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 0x55bd5f374780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 -- 172.21.15.1:0/1171225600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 msgr2=0x55bd5f374780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 0x55bd5f374780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 -- 172.21.15.1:0/1171225600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 msgr2=0x55bd5f387f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 -- 172.21.15.1:0/1171225600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd5f377090 con 0x55bd5f36d2f0 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 0x55bd5f374780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3893e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c6a0 tx=0x7fc8bc09a850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ccc92ece258b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8c8ff9640 1 -- 172.21.15.1:0/1171225600 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc09bca0 con 0x55bd5f36d2f0 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8c8ff9640 1 -- 172.21.15.1:0/1171225600 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc0b9020 con 0x55bd5f36d2f0 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.350+0000 7fc8c8ff9640 1 -- 172.21.15.1:0/1171225600 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc09c340 con 0x55bd5f36d2f0 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 -- 172.21.15.1:0/1171225600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 msgr2=0x55bd5f3893e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3893e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c6a0 tx=0x7fc8bc09a850 comp rx=0 tx=0).stop 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 -- 172.21.15.1:0/1171225600 shutdown_connections 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f377bb0 0x55bd5f374780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f36d2f0 0x55bd5f3893e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/1171225600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f387f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 -- 172.21.15.1:0/1171225600 >> 172.21.15.1:0/1171225600 conn(0x55bd5f368f60 msgr2=0x55bd5f363ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 -- 172.21.15.1:0/1171225600 shutdown_connections 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.351+0000 7fc8dba2b740 1 -- 172.21.15.1:0/1171225600 wait complete. 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 -- start start 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 Processor -- start 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f38cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f38d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f389930 con 0x55bd5f36c9d0 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f389260 con 0x55bd5f36d2f0 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bd5f38a000 con 0x55bd5f377bb0 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8dba2b740 10 client.0 _ll_register_callbacks cb 0x7fc8bc00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:53.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34200/0 (socket says 172.21.15.1:34200) 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 -- 172.21.15.1:0/3305863312 learned_addr learned my addr 172.21.15.1:0/3305863312 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f38cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d37fe640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f38d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 -- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 msgr2=0x55bd5f38d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f38d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 -- 172.21.15.1:0/3305863312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 msgr2=0x55bd5f38cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f38cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.352+0000 7fc8d2ffd640 1 -- 172.21.15.1:0/3305863312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd5f3f0d70 con 0x55bd5f36c9d0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8d2ffd640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005940 tx=0x7fc8c4031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b00ec1c47455bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:20:53.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4035040 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc8c4004240 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc0b9020 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc8c4004440 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 10 client.15060 fetch_fsmap learned FSMap version 21 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bd5f3f2090 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc0b9020 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc8c403c740 con 0x55bd5f36c9d0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 10 client.15060 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 10 client.15060 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 20 client.15060 populate_metadata read hostname 'smithi001' 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.353+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f3f6ca0 0x55bd5f3f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 4 client.15060 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "status"}) -- 0x55bd5f2dab10 con 0x55bd5f3f6ca0 2024-09-19T05:20:53.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f3f6ca0 0x55bd5f3f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8ba7fc640 10 client.15060 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8cbfff640 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f3f6ca0 0x55bd5f3f59b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90fa89409caa0e66 server_cookie=49425d5c22f66256 in_seq=0 out_seq=0 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8ba7fc640 1 -- 172.21.15.1:0/3305863312 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bd5f2dab10 con 0x55bd5f3f6ca0 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8ba7fc640 10 client.15060 handle_command_reply: tid=0 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 client.15060 shutdown 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 msgr2=0x55bd5f38ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005940 tx=0x7fc8c4031af0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 shutdown_connections 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55bd5f3f6ca0 0x55bd5f3f59b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bd5f377bb0 0x55bd5f38d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bd5f36d2f0 0x55bd5f38cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 --2- 172.21.15.1:0/3305863312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd5f36c9d0 0x55bd5f38ca70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 >> 172.21.15.1:0/3305863312 conn(0x55bd5f368f60 msgr2=0x55bd5f374780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8ba7fc640 0 client.15060 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 shutdown_connections 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.354+0000 7fc8dba2b740 1 -- 172.21.15.1:0/3305863312 wait complete. 2024-09-19T05:20:53.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8dba2b740 20 client.15060 trim_cache size 0 max 16384 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24472, 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T05:20:53.368 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 110.38474705500001, 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 21, 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 89, 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 130.62215584200001 2024-09-19T05:20:53.369 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 msgr2=0x7fc8c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc021000 tx=0x7fc8cc01f000 comp rx=0 tx=0).stop 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 msgr2=0x7fc8d41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00edf0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 shutdown_connections 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8c00a32d0 0x7fc8c00a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8d410c1a0 0x7fc8d419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8d4103720 0x7fc8d41989d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 --2- 172.21.15.1:0/428040710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8d4102e00 0x7fc8d4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 >> 172.21.15.1:0/428040710 conn(0x7fc8d40fc7a0 msgr2=0x7fc8d40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 shutdown_connections 2024-09-19T05:20:53.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:53.355+0000 7fc8d9652640 1 -- 172.21.15.1:0/428040710 wait complete. 2024-09-19T05:20:54.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:53 smithi001 ceph-mon[30968]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:54.058 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T05:20:54.058 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T05:20:54.067 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T05:20:54.067 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T05:20:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:53 smithi060 ceph-mon[35058]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:53 smithi082 ceph-mon[35195]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:54.324 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2607622565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04102e00 msgr2=0x7f5b04103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2607622565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04102e00 0x7f5b04103280 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009900 tx=0x7f5af402a410 comp rx=0 tx=0).stop 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2607622565 shutdown_connections 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2607622565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b041037c0 0x7f5b0410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2607622565 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04102e00 0x7f5b04103280 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2607622565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b04101c00 0x7f5b04102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2607622565 >> 172.21.15.1:0/2607622565 conn(0x7f5b040fd390 msgr2=0x7f5b040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2607622565 shutdown_connections 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2607622565 wait complete. 2024-09-19T05:20:54.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.813+0000 7f5b0bd84640 1 Processor -- start 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 -- start start 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b04102e00 0x7f5b0419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 0x7f5b041a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0410d8e0 con 0x7f5b04101c00 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0410d760 con 0x7f5b041037c0 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0bd84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0410da60 con 0x7f5b04102e00 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35766/0 (socket says 172.21.15.1:35766) 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 -- 172.21.15.1:0/2411727246 learned_addr learned my addr 172.21.15.1:0/2411727246 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0931f640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b04102e00 0x7f5b0419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0a321640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 0x7f5b041a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:54.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 -- 172.21.15.1:0/2411727246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b04102e00 msgr2=0x7f5b0419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b04102e00 0x7f5b0419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 -- 172.21.15.1:0/2411727246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 msgr2=0x7f5b041a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 0x7f5b041a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 -- 172.21.15.1:0/2411727246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b041a1db0 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b0a321640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 0x7f5b041a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.814+0000 7f5b09b20640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d950 tx=0x7f5b0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.815+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00017020 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.815+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b00009c30 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.815+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b041a20a0 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.815+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000f720 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.815+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b041a25b0 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.816+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b041a2870 con 0x7f5b04101c00 2024-09-19T05:20:54.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.817+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5b0001a020 con 0x7f5b04101c00 2024-09-19T05:20:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.817+0000 7f5afaffd640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 0x7f5af00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.818+0000 7f5b0931f640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 0x7f5af00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.818+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5b000cfd60 con 0x7f5b04101c00 2024-09-19T05:20:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.818+0000 7f5b0931f640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 0x7f5af00a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5af40314e0 tx=0x7f5af4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:54.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:54.822+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b00021020 con 0x7f5b04101c00 2024-09-19T05:20:55.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.012+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5b04075b40 con 0x7f5af00a3300 2024-09-19T05:20:55.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.013+0000 7f5afaffd640 1 -- 172.21.15.1:0/2411727246 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5b04075b40 con 0x7f5af00a3300 2024-09-19T05:20:55.016 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-19T05:20:55.016 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-19T05:20:55.016 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 msgr2=0x7f5af00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 0x7f5af00a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5af40314e0 tx=0x7f5af4000bc0 comp rx=0 tx=0).stop 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 msgr2=0x7f5b0419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d950 tx=0x7f5b0000de10 comp rx=0 tx=0).stop 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 shutdown_connections 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5af00a3300 0x7f5af00a57c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:55.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b041037c0 0x7f5b041a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:55.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b04102e00 0x7f5b0419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:55.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 --2- 172.21.15.1:0/2411727246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5b04101c00 0x7f5b0419a180 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:55.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 >> 172.21.15.1:0/2411727246 conn(0x7f5b040fd390 msgr2=0x7f5b04074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:55.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.015+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 shutdown_connections 2024-09-19T05:20:55.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:55.016+0000 7f5b0bd84640 1 -- 172.21.15.1:0/2411727246 wait complete. 2024-09-19T05:20:55.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T05:20:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:55 smithi001 ceph-mon[30968]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:56.091 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:55 smithi060 ceph-mon[35058]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:55 smithi082 ceph-mon[35195]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:20:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 -- 172.21.15.1:0/823598878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 msgr2=0x7f44a410bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 --2- 172.21.15.1:0/823598878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a410bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f449c009ca0 tx=0x7f449c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 -- 172.21.15.1:0/823598878 shutdown_connections 2024-09-19T05:20:56.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 --2- 172.21.15.1:0/823598878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a410bf30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 --2- 172.21.15.1:0/823598878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a4074b40 0x7f44a4074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 --2- 172.21.15.1:0/823598878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a40761a0 0x7f44a4074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 -- 172.21.15.1:0/823598878 >> 172.21.15.1:0/823598878 conn(0x7f44a40fd390 msgr2=0x7f44a40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 -- 172.21.15.1:0/823598878 shutdown_connections 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.563+0000 7f44aa751640 1 -- 172.21.15.1:0/823598878 wait complete. 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 Processor -- start 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 -- start start 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4074b40 0x7f44a419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 0x7f44a419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410fad0 con 0x7f44a4109a70 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410f950 con 0x7f44a4074b40 2024-09-19T05:20:56.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44aa751640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44a410fc50 con 0x7f44a40761a0 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35780/0 (socket says 172.21.15.1:35780) 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 -- 172.21.15.1:0/2178846878 learned_addr learned my addr 172.21.15.1:0/2178846878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a3fff640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4074b40 0x7f44a419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a37fe640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 0x7f44a419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 -- 172.21.15.1:0/2178846878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 msgr2=0x7f44a419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 0x7f44a419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.564+0000 7f44a8cee640 1 -- 172.21.15.1:0/2178846878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4074b40 msgr2=0x7f44a419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a8cee640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4074b40 0x7f44a419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a8cee640 1 -- 172.21.15.1:0/2178846878 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a41a1cf0 con 0x7f44a4109a70 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a37fe640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 0x7f44a419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:56.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a8cee640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f449c005e30 tx=0x7f449c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c003c30 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f449c003dd0 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a41a1f80 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c02fde0 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.565+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a41a24b0 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.566+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a4108880 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.567+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f449c004050 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.568+0000 7f44a17fa640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.568+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f449c0f1150 con 0x7f44a4109a70 2024-09-19T05:20:56.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.568+0000 7f44a3fff640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.568+0000 7f44a3fff640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 0x7f448c0a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f449400bbe0 tx=0x7f449400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:56.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.571+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f449c0bdac0 con 0x7f44a4109a70 2024-09-19T05:20:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.755+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f44a4062630 con 0x7f448c0a3300 2024-09-19T05:20:56.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.767+0000 7f44a17fa640 1 -- 172.21.15.1:0/2178846878 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f44a4062630 con 0x7f448c0a3300 2024-09-19T05:20:56.770 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T05:20:56.770 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (2m) 57s ago 2m 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 6aa7dd50c5c7 2024-09-19T05:20:56.770 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi060 running (2m) 58s ago 2m 16.1M - 19.1.1-361-g2f599a46 d2baa855c067 6b4807a11670 2024-09-19T05:20:56.770 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi082 running (2m) 58s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 e7dc0c56d504 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 57s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 00f2f7a7c7fc 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi060 running (2m) 58s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 d4fe43146d23 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi082 running (2m) 58s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 670403dcc101 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (2m) 57s ago 2m 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 9fafa7b1172b 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi060 running (2m) 58s ago 2m 14.0M - 19.1.1-361-g2f599a46 d2baa855c067 48867725096b 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi082 running (2m) 58s ago 2m 25.5M - 19.1.1-361-g2f599a46 d2baa855c067 0e0b73651429 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 57s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 abf5fd1236f4 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi060 running (2m) 58s ago 2m 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 edb9ec87f22d 2024-09-19T05:20:56.771 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi082 running (2m) 58s ago 2m 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 3d29327389f7 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (9m) 57s ago 9m 506M - 19.1.1-361-g2f599a46 d2baa855c067 d9275f4b4c11 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi060 *:8443,8765 running (7m) 58s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 a4fcf6ba826d 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi082 *:8443,8765 running (7m) 58s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 0f9c3518cba5 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (9m) 57s ago 9m 50.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 17bf5b3fba5e 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi060 running (8m) 58s ago 8m 41.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 39084cdb32da 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi082 running (8m) 58s ago 8m 40.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c422e25bdeae 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 57s ago 7m 45.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 90c4b81f63ca 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi060 running (7m) 58s ago 7m 45.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a36fc5f200fb 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi082 running (6m) 58s ago 6m 56.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 5062b9079a2f 2024-09-19T05:20:56.772 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (6m) 57s ago 6m 53.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 60c120c3d635 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi060 running (5m) 58s ago 5m 52.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 0e4d04694e71 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi082 running (5m) 58s ago 5m 56.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ab134441ae19 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (5m) 57s ago 4m 52.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d959a6592d1f 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi060 running (4m) 58s ago 4m 44.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3046aa329903 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi082 running (4m) 58s ago 4m 42.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c3b50d567a08 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 57s ago 3m 52.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 0a0e8fc1b20a 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi060 running (3m) 58s ago 3m 55.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 412c49b66ed0 2024-09-19T05:20:56.773 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi082 running (2m) 58s ago 2m 41.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 452ebe63f75c 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.769+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 msgr2=0x7f448c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.769+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 0x7f448c0a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f449400bbe0 tx=0x7f449400b390 comp rx=0 tx=0).stop 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.769+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 msgr2=0x7f44a41a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.769+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f449c005e30 tx=0x7f449c031ee0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 shutdown_connections 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f448c0a3300 0x7f448c0a57c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44a4109a70 0x7f44a41a1680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a40761a0 0x7f44a419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 --2- 172.21.15.1:0/2178846878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4074b40 0x7f44a419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:56.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 >> 172.21.15.1:0/2178846878 conn(0x7f44a40fd390 msgr2=0x7f44a4105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:56.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 shutdown_connections 2024-09-19T05:20:56.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:56.770+0000 7f44aa751640 1 -- 172.21.15.1:0/2178846878 wait complete. 2024-09-19T05:20:57.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:56 smithi001 ceph-mon[30968]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:57.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:56 smithi060 ceph-mon[35058]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:56 smithi082 ceph-mon[35195]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:57.608 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T05:20:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:57 smithi001 ceph-mon[30968]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:57 smithi001 ceph-mon[30968]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:57.869 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:57 smithi060 ceph-mon[35058]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:57 smithi060 ceph-mon[35058]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:57 smithi082 ceph-mon[35195]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:20:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:57 smithi082 ceph-mon[35195]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 -- 172.21.15.1:0/2327692017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 msgr2=0x7f0840100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 --2- 172.21.15.1:0/2327692017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f0840100f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0830009900 tx=0x7f083002a410 comp rx=0 tx=0).stop 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 -- 172.21.15.1:0/2327692017 shutdown_connections 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 --2- 172.21.15.1:0/2327692017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f0840108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 --2- 172.21.15.1:0/2327692017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f0840102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 --2- 172.21.15.1:0/2327692017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f0840100f10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 -- 172.21.15.1:0/2327692017 >> 172.21.15.1:0/2327692017 conn(0x7f08400fc2a0 msgr2=0x7f08400fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 -- 172.21.15.1:0/2327692017 shutdown_connections 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.391+0000 7f0844c46640 1 -- 172.21.15.1:0/2327692017 wait complete. 2024-09-19T05:20:58.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 Processor -- start 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 -- start start 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f084019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f084019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f084010c7c0 con 0x7f0840100b10 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f084010c640 con 0x7f0840101d10 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f0844c46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f084010c940 con 0x7f08401026d0 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f083e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f083e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35800/0 (socket says 172.21.15.1:35800) 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.392+0000 7f083e59c640 1 -- 172.21.15.1:0/2548750648 learned_addr learned my addr 172.21.15.1:0/2548750648 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083dd9b640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f084019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083ed9d640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f084019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:58.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 -- 172.21.15.1:0/2548750648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 msgr2=0x7f084019f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f084019f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 -- 172.21.15.1:0/2548750648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 msgr2=0x7f084019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f084019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 -- 172.21.15.1:0/2548750648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084019fbd0 con 0x7f0840100b10 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083dd9b640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f084019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083ed9d640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f084019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f083e59c640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0830031440 tx=0x7f0830032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083003f030 con 0x7f0840100b10 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084019fe00 con 0x7f0840100b10 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0830003ce0 con 0x7f0840100b10 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830035070 con 0x7f0840100b10 2024-09-19T05:20:58.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.393+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08401a0250 con 0x7f0840100b10 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.394+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0840107f10 con 0x7f0840100b10 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.395+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0830042030 con 0x7f0840100b10 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.396+0000 7f082f7fe640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 0x7f08280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.396+0000 7f083dd9b640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 0x7f08280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.396+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f08300f0970 con 0x7f0840100b10 2024-09-19T05:20:58.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.397+0000 7f083dd9b640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 0x7f08280a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f084006b870 tx=0x7f0834005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:58.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.400+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08300bd170 con 0x7f0840100b10 2024-09-19T05:20:58.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.582+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0840062630 con 0x7f08280a32d0 2024-09-19T05:20:58.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.588+0000 7f082f7fe640 1 -- 172.21.15.1:0/2548750648 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0840062630 con 0x7f08280a32d0 2024-09-19T05:20:58.590 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T05:20:58.590 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 60s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi082=c;smithi082=f;smithi082=i;smithi082=l;count:12 2024-09-19T05:20:58.591 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 60s ago 7m smithi001=x;smithi060=y;smithi082=z;count:3 2024-09-19T05:20:58.591 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 60s ago 8m smithi001:172.21.15.1=a;smithi060:172.21.15.60=b;smithi082:172.21.15.82=c;count:3 2024-09-19T05:20:58.591 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 60s ago - 2024-09-19T05:20:58.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 msgr2=0x7f08280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:58.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 0x7f08280a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f084006b870 tx=0x7f0834005d30 comp rx=0 tx=0).stop 2024-09-19T05:20:58.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 msgr2=0x7f084006b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0830031440 tx=0x7f0830032e20 comp rx=0 tx=0).stop 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 shutdown_connections 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f08280a32d0 0x7f08280a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08401026d0 0x7f084019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0840101d10 0x7f084019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 --2- 172.21.15.1:0/2548750648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0840100b10 0x7f084006b2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 >> 172.21.15.1:0/2548750648 conn(0x7f08400fc2a0 msgr2=0x7f08401050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 shutdown_connections 2024-09-19T05:20:58.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:20:58.590+0000 7f0844c46640 1 -- 172.21.15.1:0/2548750648 wait complete. 2024-09-19T05:20:59.373 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T05:20:59.634 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:00.062 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:59 smithi001 ceph-mon[30968]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:00.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:59 smithi001 ceph-mon[30968]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:00.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:20:59 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:00.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 -- 172.21.15.1:0/1159546957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44101cd0 msgr2=0x7f3b44102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/1159546957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44101cd0 0x7f3b44102150 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009900 tx=0x7f3b3402a410 comp rx=0 tx=0).stop 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 -- 172.21.15.1:0/1159546957 shutdown_connections 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/1159546957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 0x7f3b44108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/1159546957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44101cd0 0x7f3b44102150 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/1159546957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44100ad0 0x7f3b44100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 -- 172.21.15.1:0/1159546957 >> 172.21.15.1:0/1159546957 conn(0x7f3b440fc280 msgr2=0x7f3b440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 -- 172.21.15.1:0/1159546957 shutdown_connections 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 -- 172.21.15.1:0/1159546957 wait complete. 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.145+0000 7f3b4b69d640 1 Processor -- start 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 -- start start 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44101cd0 0x7f3b44197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 0x7f3b4419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4410c730 con 0x7f3b44100ad0 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4410c5b0 con 0x7f3b44101cd0 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b4b69d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4410c8b0 con 0x7f3b44102690 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35808/0 (socket says 172.21.15.1:35808) 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 -- 172.21.15.1:0/3723680714 learned_addr learned my addr 172.21.15.1:0/3723680714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49c3a640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 0x7f3b4419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b48c38640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44101cd0 0x7f3b44197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 -- 172.21.15.1:0/3723680714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 msgr2=0x7f3b4419e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 0x7f3b4419e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 -- 172.21.15.1:0/3723680714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44101cd0 msgr2=0x7f3b44197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44101cd0 0x7f3b44197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 -- 172.21.15.1:0/3723680714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4419ea40 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b49439640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000ead0 tx=0x7f3b4000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.146+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4000bbd0 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.147+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b4000bd70 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.147+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b44069fd0 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.147+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40017410 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.147+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4406a530 con 0x7f3b44100ad0 2024-09-19T05:21:00.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.148+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b44100ed0 con 0x7f3b44100ad0 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.149+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3b4001e020 con 0x7f3b44100ad0 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.149+0000 7f3b3a7fc640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 0x7f3b300a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.150+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3b400d1640 con 0x7f3b44100ad0 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.150+0000 7f3b48c38640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 0x7f3b300a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.150+0000 7f3b48c38640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 0x7f3b300a5840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b340314e0 tx=0x7f3b34000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.152+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b4009de40 con 0x7f3b44100ad0 2024-09-19T05:21:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:59 smithi060 ceph-mon[35058]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:00.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:59 smithi060 ceph-mon[35058]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:00.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:20:59 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:00.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:59 smithi082 ceph-mon[35195]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:00.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:59 smithi082 ceph-mon[35195]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:00.262 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:20:59 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:00.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.339+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f3b4406a790 con 0x7f3b300a3380 2024-09-19T05:21:00.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.341+0000 7f3b3a7fc640 1 -- 172.21.15.1:0/3723680714 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f3b4406a790 con 0x7f3b300a3380 2024-09-19T05:21:00.344 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-19T05:21:00.344 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-19T05:21:00.344 INFO:teuthology.orchestra.run.smithi001.stdout:smithi060 172.21.15.60 2024-09-19T05:21:00.344 INFO:teuthology.orchestra.run.smithi001.stdout:smithi082 172.21.15.82 2024-09-19T05:21:00.344 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-19T05:21:00.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 msgr2=0x7f3b300a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 0x7f3b300a5840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b340314e0 tx=0x7f3b34000bc0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 msgr2=0x7f3b44196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000ead0 tx=0x7f3b4000ef90 comp rx=0 tx=0).stop 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 shutdown_connections 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b300a3380 0x7f3b300a5840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b44102690 0x7f3b4419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b44101cd0 0x7f3b44197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 --2- 172.21.15.1:0/3723680714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b44100ad0 0x7f3b44196e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 >> 172.21.15.1:0/3723680714 conn(0x7f3b440fc280 msgr2=0x7f3b44105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 shutdown_connections 2024-09-19T05:21:00.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:00.344+0000 7f3b4b69d640 1 -- 172.21.15.1:0/3723680714 wait complete. 2024-09-19T05:21:01.097 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T05:21:01.806 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:01.957 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:01 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:01 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:01 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 -- 172.21.15.1:0/1608283551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 msgr2=0x7f13741086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 --2- 172.21.15.1:0/1608283551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f13741086e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f136c00adb0 tx=0x7f136c02b7a0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 -- 172.21.15.1:0/1608283551 shutdown_connections 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 --2- 172.21.15.1:0/1608283551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f13741086e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 --2- 172.21.15.1:0/1608283551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374101490 0x7f1374101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 --2- 172.21.15.1:0/1608283551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374100290 0x7f1374100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.300+0000 7f137b448640 1 -- 172.21.15.1:0/1608283551 >> 172.21.15.1:0/1608283551 conn(0x7f13740fba40 msgr2=0x7f13740fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- 172.21.15.1:0/1608283551 shutdown_connections 2024-09-19T05:21:02.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- 172.21.15.1:0/1608283551 wait complete. 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 Processor -- start 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- start start 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374100290 0x7f1374195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374101490 0x7f1374196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f137410b700 con 0x7f1374101e50 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f137410b580 con 0x7f1374101490 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f137b448640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f137410b880 con 0x7f1374100290 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f13799e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.301+0000 7f13799e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35816/0 (socket says 172.21.15.1:35816) 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 -- 172.21.15.1:0/907673939 learned_addr learned my addr 172.21.15.1:0/907673939 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:02.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13791e4640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374100290 0x7f1374195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13789e3640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374101490 0x7f1374196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 -- 172.21.15.1:0/907673939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374100290 msgr2=0x7f1374195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374100290 0x7f1374195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 -- 172.21.15.1:0/907673939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374101490 msgr2=0x7f1374196220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374101490 0x7f1374196220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 -- 172.21.15.1:0/907673939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137419d900 con 0x7f1374101e50 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f13799e5640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f136c032630 tx=0x7f136c032660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c041070 con 0x7f1374101e50 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f136c004040 con 0x7f1374101e50 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137419db90 con 0x7f1374101e50 2024-09-19T05:21:02.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c030bf0 con 0x7f1374101e50 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.302+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137419e0c0 con 0x7f1374101e50 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.303+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1374107640 con 0x7f1374101e50 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.305+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f136c03a040 con 0x7f1374101e50 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.305+0000 7f136a7fc640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 0x7f13600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.305+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f136c0f22b0 con 0x7f1374101e50 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.305+0000 7f13791e4640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 0x7f13600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.306+0000 7f13791e4640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 0x7f13600a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f13741971c0 tx=0x7f1370005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:02.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.309+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f136c082210 con 0x7f1374101e50 2024-09-19T05:21:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.509+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f1374062630 con 0x7f13600a3350 2024-09-19T05:21:02.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.511+0000 7f136a7fc640 1 -- 172.21.15.1:0/907673939 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f1374062630 con 0x7f13600a3350 2024-09-19T05:21:02.514 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T05:21:02.514 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T05:21:02.514 INFO:teuthology.orchestra.run.smithi001.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T05:21:02.514 INFO:teuthology.orchestra.run.smithi001.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T05:21:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.514+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 msgr2=0x7f13600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.514+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 0x7f13600a5810 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f13741971c0 tx=0x7f1370005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.514+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 msgr2=0x7f137419d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.514+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f136c032630 tx=0x7f136c032660 comp rx=0 tx=0).stop 2024-09-19T05:21:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 shutdown_connections 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13600a3350 0x7f13600a5810 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1374101e50 0x7f137419d260 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1374101490 0x7f1374196220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 --2- 172.21.15.1:0/907673939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1374100290 0x7f1374195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 >> 172.21.15.1:0/907673939 conn(0x7f13740fba40 msgr2=0x7f1374104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 shutdown_connections 2024-09-19T05:21:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:02.515+0000 7f137b448640 1 -- 172.21.15.1:0/907673939 wait complete. 2024-09-19T05:21:03.457 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T05:21:03.467 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T05:21:03.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T05:21:03.737 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:04.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:03 smithi001 ceph-mon[30968]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:04.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:03 smithi001 ceph-mon[30968]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:04.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:03 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.112 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:03 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:03 smithi060 ceph-mon[35058]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:03 smithi060 ceph-mon[35058]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:03 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:03 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:03 smithi082 ceph-mon[35195]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:03 smithi082 ceph-mon[35195]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:21:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:03 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:03 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:04.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 -- 172.21.15.1:0/305711140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 msgr2=0x7f8ffc109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:04.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 --2- 172.21.15.1:0/305711140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc109d50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009ca0 tx=0x7f8ff402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 -- 172.21.15.1:0/305711140 shutdown_connections 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 --2- 172.21.15.1:0/305711140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc109d50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 --2- 172.21.15.1:0/305711140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc104fd0 0x7f8ffc1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 --2- 172.21.15.1:0/305711140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc1026a0 0x7f8ffc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 -- 172.21.15.1:0/305711140 >> 172.21.15.1:0/305711140 conn(0x7f8ffc0fc2a0 msgr2=0x7f8ffc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 -- 172.21.15.1:0/305711140 shutdown_connections 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.253+0000 7f9002b41640 1 -- 172.21.15.1:0/305711140 wait complete. 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 Processor -- start 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 -- start start 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc1026a0 0x7f8ffc102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc104fd0 0x7f8ffc100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:04.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10d910 con 0x7f8ffc107900 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10d790 con 0x7f8ffc104fd0 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f9002b41640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10da90 con 0x7f8ffc1026a0 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37414/0 (socket says 172.21.15.1:37414) 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 -- 172.21.15.1:0/4233028862 learned_addr learned my addr 172.21.15.1:0/4233028862 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90008dd640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc1026a0 0x7f8ffc102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f8ffbfff640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc104fd0 0x7f8ffc100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 -- 172.21.15.1:0/4233028862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc1026a0 msgr2=0x7f8ffc102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:04.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc1026a0 0x7f8ffc102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 -- 172.21.15.1:0/4233028862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc104fd0 msgr2=0x7f8ffc100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc104fd0 0x7f8ffc100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.254+0000 7f90010de640 1 -- 172.21.15.1:0/4233028862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc101450 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f90010de640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009430 tx=0x7f8ff40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4003b70 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ff4003d10 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc1a2010 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff402fc50 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.255+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc1a2570 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.256+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc0fdd90 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.257+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8ff4004040 con 0x7f8ffc107900 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.258+0000 7f8ff9ffb640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 0x7f8fe40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:04.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.258+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f8ff40f10f0 con 0x7f8ffc107900 2024-09-19T05:21:04.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.258+0000 7f90008dd640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 0x7f8fe40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:04.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.259+0000 7f90008dd640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 0x7f8fe40a5810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009bd0 tx=0x7f8fec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:04.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.262+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ff40bda60 con 0x7f8ffc107900 2024-09-19T05:21:04.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.477+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8ffc062df0 con 0x7f8ffc107900 2024-09-19T05:21:04.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.477+0000 7f8ff9ffb640 1 -- 172.21.15.1:0/4233028862 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3032 (secure 0 0 0) 0x7f8ff40bd360 con 0x7f8ffc107900 2024-09-19T05:21:04.480 INFO:teuthology.orchestra.run.smithi001.stdout:e21 2024-09-19T05:21:04.480 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-19T05:19:47:132667+0000 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 21 2024-09-19T05:21:04.481 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T05:19:02.579382+0000 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T05:19:46.933700+0000 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-19T05:21:04.482 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 1 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:in 0 2024-09-19T05:21:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24472} 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3,4] 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-19T05:21:04.484 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24472 members: 24472 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{0:24472} state up:active seq 7 addr [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24455} state up:standby-replay seq 1 addr [v2:172.21.15.60:6838/1625002585,v1:172.21.15.60:6839/1625002585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:04.486 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-19T05:21:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:04.486 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.1:6834/499392248,v1:172.21.15.1:6835/499392248] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.1:6836/4202429907,v1:172.21.15.1:6837/4202429907] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{-1:14598} state up:standby seq 1 addr [v2:172.21.15.1:6838/3689811065,v1:172.21.15.1:6839/3689811065] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{-1:14610} state up:standby seq 1 addr [v2:172.21.15.1:6840/3860921021,v1:172.21.15.1:6841/3860921021] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{-1:24386} state up:standby seq 1 addr [v2:172.21.15.60:6832/3384631993,v1:172.21.15.60:6833/3384631993] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{-1:24407} state up:standby seq 1 addr [v2:172.21.15.60:6834/2252846405,v1:172.21.15.60:6835/2252846405] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{-1:24409} state up:standby seq 1 addr [v2:172.21.15.82:6832/4115388228,v1:172.21.15.82:6833/4115388228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.487 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{-1:24431} state up:standby seq 1 addr [v2:172.21.15.60:6836/1092440333,v1:172.21.15.60:6837/1092440333] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.488 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{-1:24445} state up:standby seq 1 addr [v2:172.21.15.82:6834/3661072126,v1:172.21.15.82:6835/3661072126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.488 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{-1:24451} state up:standby seq 1 addr [v2:172.21.15.82:6836/3379829204,v1:172.21.15.82:6837/3379829204] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:21:04.490 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:04.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 msgr2=0x7f8fe40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:04.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 0x7f8fe40a5810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009bd0 tx=0x7f8fec005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:04.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 msgr2=0x7f8ffc100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:04.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009430 tx=0x7f8ff40319f0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 shutdown_connections 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8fe40a3350 0x7f8fe40a5810 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8ffc107900 0x7f8ffc100b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ffc104fd0 0x7f8ffc100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 --2- 172.21.15.1:0/4233028862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ffc1026a0 0x7f8ffc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:04.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.480+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 >> 172.21.15.1:0/4233028862 conn(0x7f8ffc0fc2a0 msgr2=0x7f8ffc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:04.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.481+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 shutdown_connections 2024-09-19T05:21:04.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:04.481+0000 7f9002b41640 1 -- 172.21.15.1:0/4233028862 wait complete. 2024-09-19T05:21:05.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:05.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:05.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:05.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:04 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4233028862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:21:05.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T05:21:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:04 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4233028862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:21:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:21:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:04 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4233028862' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:21:05.411 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:05.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.909+0000 7fb612781640 1 -- 172.21.15.1:0/2970272493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c102e00 msgr2=0x7fb60c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.909+0000 7fb612781640 1 --2- 172.21.15.1:0/2970272493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c102e00 0x7fb60c103280 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009900 tx=0x7fb5f402a410 comp rx=0 tx=0).stop 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- 172.21.15.1:0/2970272493 shutdown_connections 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- 172.21.15.1:0/2970272493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c1037c0 0x7fb60c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- 172.21.15.1:0/2970272493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c102e00 0x7fb60c103280 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- 172.21.15.1:0/2970272493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c101c00 0x7fb60c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- 172.21.15.1:0/2970272493 >> 172.21.15.1:0/2970272493 conn(0x7fb60c0fd390 msgr2=0x7fb60c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- 172.21.15.1:0/2970272493 shutdown_connections 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- 172.21.15.1:0/2970272493 wait complete. 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 Processor -- start 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- start start 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:05.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102e00 0x7fb60c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 0x7fb60c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10d860 con 0x7fb60c101c00 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.910+0000 7fb612781640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10d6e0 con 0x7fb60c1037c0 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb612781640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb60c10d9e0 con 0x7fb60c102e00 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37438/0 (socket says 172.21.15.1:37438) 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 -- 172.21.15.1:0/124314152 learned_addr learned my addr 172.21.15.1:0/124314152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb603fff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102e00 0x7fb60c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:05.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb610d1e640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 0x7fb60c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 -- 172.21.15.1:0/124314152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102e00 msgr2=0x7fb60c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102e00 0x7fb60c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 -- 172.21.15.1:0/124314152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 msgr2=0x7fb60c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 0x7fb60c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 -- 172.21.15.1:0/124314152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60c0753e0 con 0x7fb60c101c00 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb610d1e640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 0x7fb60c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb60bfff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d770 tx=0x7fb5fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc017070 con 0x7fb60c101c00 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5fc009c30 con 0x7fb60c101c00 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60c1a1fb0 con 0x7fb60c101c00 2024-09-19T05:21:05.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.911+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc003dd0 con 0x7fb60c101c00 2024-09-19T05:21:05.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.912+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60c1a2400 con 0x7fb60c101c00 2024-09-19T05:21:05.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.913+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60c108fd0 con 0x7fb60c101c00 2024-09-19T05:21:05.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.914+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb5fc003fb0 con 0x7fb60c101c00 2024-09-19T05:21:05.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.914+0000 7fb609ffb640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 0x7fb5f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:05.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.914+0000 7fb603fff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 0x7fb5f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:05.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.914+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5fc0cf7b0 con 0x7fb60c101c00 2024-09-19T05:21:05.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.915+0000 7fb603fff640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 0x7fb5f80a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40314e0 tx=0x7fb5f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:05.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:05.919+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5fc09c010 con 0x7fb60c101c00 2024-09-19T05:21:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:05 smithi001 ceph-mon[30968]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:06.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.096+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb60c062ec0 con 0x7fb60c101c00 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.096+0000 7fb609ffb640 1 -- 172.21.15.1:0/124314152 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5545 (secure 0 0 0) 0x7fb5fc009de0 con 0x7fb60c101c00 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 89 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T05:11:21.229693+0000 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T05:20:11.682030+0000 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 27 2024-09-19T05:21:06.099 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/1004052295,v1:172.21.15.1:6803/1004052295] [v2:172.21.15.1:6804/1004052295,v1:172.21.15.1:6805/1004052295] exists,up a55e2ad0-856c-4327-b992-1d8269cb4822 2024-09-19T05:21:06.100 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/2687395785,v1:172.21.15.60:6801/2687395785] [v2:172.21.15.60:6802/2687395785,v1:172.21.15.60:6803/2687395785] exists,up 8ab3f0a0-9572-420a-a9bd-b0bf499761b0 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/1735149029,v1:172.21.15.82:6801/1735149029] [v2:172.21.15.82:6802/1735149029,v1:172.21.15.82:6803/1735149029] exists,up d8f3e5ee-cf96-490f-b3e1-125f018ed9ee 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 25 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/1943710877,v1:172.21.15.1:6811/1943710877] [v2:172.21.15.1:6812/1943710877,v1:172.21.15.1:6813/1943710877] exists,up a561d3ad-02a1-4328-8553-d1974ff00b0d 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 32 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/2639203045,v1:172.21.15.60:6809/2639203045] [v2:172.21.15.60:6810/2639203045,v1:172.21.15.60:6811/2639203045] exists,up fc98f99a-3a3b-471f-b883-2288983fea40 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 37 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6808/3813280468,v1:172.21.15.82:6809/3813280468] [v2:172.21.15.82:6810/3813280468,v1:172.21.15.82:6811/3813280468] exists,up 41f74801-2f20-401e-832b-dda19c19dc0b 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 45 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/362262349,v1:172.21.15.1:6819/362262349] [v2:172.21.15.1:6820/362262349,v1:172.21.15.1:6821/362262349] exists,up 8042adc6-6495-4a69-b68d-80eb89b0bb10 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 50 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/2153188266,v1:172.21.15.60:6817/2153188266] [v2:172.21.15.60:6818/2153188266,v1:172.21.15.60:6819/2153188266] exists,up 92e56ba4-2266-4114-ae5a-b1ad70466a80 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 57 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6816/500561278,v1:172.21.15.82:6817/500561278] [v2:172.21.15.82:6818/500561278,v1:172.21.15.82:6819/500561278] exists,up 92651b21-a5b1-4a2c-9184-f7b0aba6d80b 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 64 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/2188836925,v1:172.21.15.1:6827/2188836925] [v2:172.21.15.1:6828/2188836925,v1:172.21.15.1:6829/2188836925] exists,up 79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 68 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/1005024509,v1:172.21.15.60:6825/1005024509] [v2:172.21.15.60:6826/1005024509,v1:172.21.15.60:6827/1005024509] exists,up 2d933695-bb7f-45e0-a78b-63c8c46416cb 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 75 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6824/2019890108,v1:172.21.15.82:6825/2019890108] [v2:172.21.15.82:6826/2019890108,v1:172.21.15.82:6827/2019890108] exists,up 6a116c52-7fb1-4b79-af77-9624f9bf686e 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1a [8,1] 2024-09-19T05:21:06.101 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1d [2,4] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1 [4,9] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.3a [4,8] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.3c [4,9] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 4.6 [5,8] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 4.f [9,8] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 4.12 [9,10] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 4.17 [9,8] 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/809983124 expires 2024-09-20T05:12:09.745993+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/2966742919 expires 2024-09-20T05:12:09.745993+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/2966742919 expires 2024-09-20T05:12:09.745993+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2268063463 expires 2024-09-20T05:12:09.745993+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/449595009 expires 2024-09-20T05:12:09.745993+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/3800466162 expires 2024-09-20T05:11:44.793185+0000 2024-09-19T05:21:06.102 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/3800466162 expires 2024-09-20T05:11:44.793185+0000 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/899239314 expires 2024-09-20T05:11:44.793185+0000 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1905634441 expires 2024-09-20T05:11:44.793185+0000 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/149790801 expires 2024-09-20T05:11:44.793185+0000 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 msgr2=0x7fb5f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 0x7fb5f80a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40314e0 tx=0x7fb5f4000bc0 comp rx=0 tx=0).stop 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 msgr2=0x7fb60c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:06.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d770 tx=0x7fb5fc00dc30 comp rx=0 tx=0).stop 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 shutdown_connections 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb5f80a32d0 0x7fb5f80a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb60c1037c0 0x7fb60c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb60c102e00 0x7fb60c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 --2- 172.21.15.1:0/124314152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb60c101c00 0x7fb60c075f90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.098+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 >> 172.21.15.1:0/124314152 conn(0x7fb60c0fd390 msgr2=0x7fb60c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.099+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 shutdown_connections 2024-09-19T05:21:06.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:06.099+0000 7fb612781640 1 -- 172.21.15.1:0/124314152 wait complete. 2024-09-19T05:21:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:05 smithi060 ceph-mon[35058]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:05 smithi082 ceph-mon[35195]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:06.832 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T05:21:06.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:06 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/124314152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:21:07.217 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:07.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:06 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/124314152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:21:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:06 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/124314152' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 -- 172.21.15.1:0/3484756407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 msgr2=0x7fd88010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 --2- 172.21.15.1:0/3484756407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88010eaa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd878009ca0 tx=0x7fd87802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 -- 172.21.15.1:0/3484756407 shutdown_connections 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 --2- 172.21.15.1:0/3484756407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88010eaa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 --2- 172.21.15.1:0/3484756407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 0x7fd8801067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 --2- 172.21.15.1:0/3484756407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 0x7fd8801021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 -- 172.21.15.1:0/3484756407 >> 172.21.15.1:0/3484756407 conn(0x7fd8800fd8f0 msgr2=0x7fd8800ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 -- 172.21.15.1:0/3484756407 shutdown_connections 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.696+0000 7fd887827640 1 -- 172.21.15.1:0/3484756407 wait complete. 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.697+0000 7fd887827640 1 Processor -- start 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.697+0000 7fd887827640 1 -- start start 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.697+0000 7fd887827640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 0x7fd8801983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 0x7fd880198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd880111f80 con 0x7fd880106f20 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd880111e00 con 0x7fd880101df0 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd880112100 con 0x7fd8801027a0 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:07.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37458/0 (socket says 172.21.15.1:37458) 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 -- 172.21.15.1:0/3040032350 learned_addr learned my addr 172.21.15.1:0/3040032350 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd8855c3640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 0x7fd8801983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd884dc2640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 0x7fd880198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 -- 172.21.15.1:0/3040032350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 msgr2=0x7fd880198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 0x7fd880198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 -- 172.21.15.1:0/3040032350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 msgr2=0x7fd8801983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 0x7fd8801983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 -- 172.21.15.1:0/3040032350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88019d390 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd885dc4640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd878031a20 tx=0x7fd878031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878003b70 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd878003d10 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88019d620 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.698+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87802fc40 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.699+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8801a4f60 con 0x7fd880106f20 2024-09-19T05:21:07.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.699+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8801021d0 con 0x7fd880106f20 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.701+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd878004050 con 0x7fd880106f20 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.701+0000 7fd8767fc640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 0x7fd86c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.701+0000 7fd8855c3640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 0x7fd86c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.702+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd8780f0e90 con 0x7fd880106f20 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.702+0000 7fd8855c3640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 0x7fd86c0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009bd0 tx=0x7fd87c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:07.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.706+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8780bd890 con 0x7fd880106f20 2024-09-19T05:21:07.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.919+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd88010a160 con 0x7fd880106f20 2024-09-19T05:21:07.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:07 smithi001 ceph-mon[30968]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:07.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.920+0000 7fd8767fc640 1 -- 172.21.15.1:0/3040032350 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fd8780bd190 con 0x7fd880106f20 2024-09-19T05:21:07.923 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:07.923 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:07.923 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:07.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 msgr2=0x7fd86c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:07.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 0x7fd86c0a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009bd0 tx=0x7fd87c005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 msgr2=0x7fd88019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd878031a20 tx=0x7fd878031a50 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 shutdown_connections 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd86c0a32d0 0x7fd86c0a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd880106f20 0x7fd88019ccb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8801027a0 0x7fd880198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 --2- 172.21.15.1:0/3040032350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd880101df0 0x7fd8801983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 >> 172.21.15.1:0/3040032350 conn(0x7fd8800fd8f0 msgr2=0x7fd8800febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 shutdown_connections 2024-09-19T05:21:07.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:07.922+0000 7fd887827640 1 -- 172.21.15.1:0/3040032350 wait complete. 2024-09-19T05:21:08.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:07 smithi060 ceph-mon[35058]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:07 smithi082 ceph-mon[35195]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:08.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:08.909 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:09.030 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:08 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3040032350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:09.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:08 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3040032350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:08 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3040032350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/2625884639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58101de0 msgr2=0x7f9c581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/2625884639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58101de0 0x7f9c581021c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009900 tx=0x7f9c4802a410 comp rx=0 tx=0).stop 2024-09-19T05:21:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/2625884639 shutdown_connections 2024-09-19T05:21:09.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/2625884639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58106f10 0x7f9c5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/2625884639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 0x7f9c581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/2625884639 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58101de0 0x7f9c581021c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/2625884639 >> 172.21.15.1:0/2625884639 conn(0x7f9c580fd8c0 msgr2=0x7f9c580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/2625884639 shutdown_connections 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.384+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/2625884639 wait complete. 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 Processor -- start 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 -- start start 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 0x7f9c581961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 0x7f9c58196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810feb0 con 0x7f9c58106f10 2024-09-19T05:21:09.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58076360 con 0x7f9c58102790 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c5cb7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58110030 con 0x7f9c58101de0 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c56d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c56d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37476/0 (socket says 172.21.15.1:37476) 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.385+0000 7f9c56d9d640 1 -- 172.21.15.1:0/3727939568 learned_addr learned my addr 172.21.15.1:0/3727939568 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c5659c640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 0x7f9c581961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c4ffff640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 0x7f9c58196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 -- 172.21.15.1:0/3727939568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 msgr2=0x7f9c581961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 0x7f9c581961c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 -- 172.21.15.1:0/3727939568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 msgr2=0x7f9c58196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 0x7f9c58196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 -- 172.21.15.1:0/3727939568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5819b170 con 0x7f9c58106f10 2024-09-19T05:21:09.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c5659c640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 0x7f9c581961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c56d9d640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000cce0 tx=0x7f9c5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000f450 con 0x7f9c58106f10 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c5000fad0 con 0x7f9c58106f10 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5819b460 con 0x7f9c58106f10 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50018c10 con 0x7f9c58106f10 2024-09-19T05:21:09.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.386+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a2d40 con 0x7f9c58106f10 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.387+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c581021c0 con 0x7f9c58106f10 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.388+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9c5000f5f0 con 0x7f9c58106f10 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.389+0000 7f9c4f7fe640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 0x7f9c440a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.389+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f9c500d0490 con 0x7f9c58106f10 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.389+0000 7f9c5659c640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 0x7f9c440a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:09.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.390+0000 7f9c5659c640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 0x7f9c440a9c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c48032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:09.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.393+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c50014030 con 0x7f9c58106f10 2024-09-19T05:21:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.606+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c5802d7c0 con 0x7f9c58106f10 2024-09-19T05:21:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.607+0000 7f9c4f7fe640 1 -- 172.21.15.1:0/3727939568 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f9c5009cc90 con 0x7f9c58106f10 2024-09-19T05:21:09.609 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:09.610 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 msgr2=0x7f9c440a9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 0x7f9c440a9c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9c48000c00 tx=0x7f9c48032c70 comp rx=0 tx=0).stop 2024-09-19T05:21:09.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 msgr2=0x7f9c5819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000cce0 tx=0x7f9c5000a620 comp rx=0 tx=0).stop 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 shutdown_connections 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9c440a7760 0x7f9c440a9c20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c58106f10 0x7f9c5819aa90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58102790 0x7f9c58196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 --2- 172.21.15.1:0/3727939568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c58101de0 0x7f9c581961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 >> 172.21.15.1:0/3727939568 conn(0x7f9c580fd8c0 msgr2=0x7f9c580feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 shutdown_connections 2024-09-19T05:21:09.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:09.609+0000 7f9c5cb7a640 1 -- 172.21.15.1:0/3727939568 wait complete. 2024-09-19T05:21:09.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:09 smithi001 ceph-mon[30968]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:09.943 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:09 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3727939568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:10.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:09 smithi060 ceph-mon[35058]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:10.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:09 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3727939568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:09 smithi082 ceph-mon[35195]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:09 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3727939568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:10.282 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:21:10.539 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:10.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T05:21:10.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T05:21:10.981 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2024-09-19T05:21:11.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 -- 172.21.15.1:0/3119126111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90106ba0 msgr2=0x7fad90106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 --2- 172.21.15.1:0/3119126111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90106ba0 0x7fad90106f80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fad80009ca0 tx=0x7fad8002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 -- 172.21.15.1:0/3119126111 shutdown_connections 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 --2- 172.21.15.1:0/3119126111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad90100a70 0x7fad9010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 --2- 172.21.15.1:0/3119126111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad901000d0 0x7fad90100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 --2- 172.21.15.1:0/3119126111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90106ba0 0x7fad90106f80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 -- 172.21.15.1:0/3119126111 >> 172.21.15.1:0/3119126111 conn(0x7fad90077210 msgr2=0x7fad900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 -- 172.21.15.1:0/3119126111 shutdown_connections 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.061+0000 7fad9746c640 1 -- 172.21.15.1:0/3119126111 wait complete. 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 Processor -- start 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 -- start start 2024-09-19T05:21:11.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 0x7fad901012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 0x7fad90101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad90112130 con 0x7fad90100a70 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad90111fb0 con 0x7fad901000d0 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad9746c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad901122b0 con 0x7fad90106ba0 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad94a07640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad94a07640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37494/0 (socket says 172.21.15.1:37494) 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad94a07640 1 -- 172.21.15.1:0/339201547 learned_addr learned my addr 172.21.15.1:0/339201547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad95208640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 0x7fad901012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.062+0000 7fad95a09640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 0x7fad90101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 -- 172.21.15.1:0/339201547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 msgr2=0x7fad90101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:11.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 0x7fad90101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 -- 172.21.15.1:0/339201547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 msgr2=0x7fad901012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 0x7fad901012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 -- 172.21.15.1:0/339201547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901a6a90 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad95208640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 0x7fad901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad95a09640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 0x7fad90101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad94a07640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fad8400b4a0 tx=0x7fad8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84014070 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad84010af0 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad901a6d80 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84017d10 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.063+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad901a7210 con 0x7fad90100a70 2024-09-19T05:21:11.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.064+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90100530 con 0x7fad90100a70 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.065+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fad84017070 con 0x7fad90100a70 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.066+0000 7fad8e7fc640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 0x7fad780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.066+0000 7fad95208640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 0x7fad780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.066+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9179+0+0 (secure 0 0 0) 0x7fad840cf140 con 0x7fad90100a70 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.067+0000 7fad95208640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 0x7fad780a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad8002f540 tx=0x7fad800099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:11.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.071+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad8409bab0 con 0x7fad90100a70 2024-09-19T05:21:11.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T05:21:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T05:21:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2024-09-19T05:21:11.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.253+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad90109b00 con 0x7fad90100a70 2024-09-19T05:21:11.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.254+0000 7fad8e7fc640 1 -- 172.21.15.1:0/339201547 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24749 (secure 0 0 0) 0x7fad8409b3b0 con 0x7fad90100a70 2024-09-19T05:21:11.258 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:11.258 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":90,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:21:10.824976+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:21:11.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-19T05:21:11.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T05:21:11.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]: dispatch 2024-09-19T05:21:11.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 msgr2=0x7fad780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:11.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 0x7fad780a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fad8002f540 tx=0x7fad800099a0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 msgr2=0x7fad901017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fad8400b4a0 tx=0x7fad8400b960 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 shutdown_connections 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fad780a3240 0x7fad780a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad90106ba0 0x7fad90101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad90100a70 0x7fad901017f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 --2- 172.21.15.1:0/339201547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad901000d0 0x7fad901012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 >> 172.21.15.1:0/339201547 conn(0x7fad90077210 msgr2=0x7fad90104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 shutdown_connections 2024-09-19T05:21:11.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:11.257+0000 7fad9746c640 1 -- 172.21.15.1:0/339201547 wait complete. 2024-09-19T05:21:11.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:11.954 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T05:21:11.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T05:21:11.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2024-09-19T05:21:11.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:21:11.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T05:21:11.955 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:11 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/339201547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:11.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:19:02.579382+0000', 'modified': '2024-09-19T05:19:46.933700+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/1625002585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1625002585}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1625002585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6839/1656123730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1656123730}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1656123730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T05:21:11.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:21:11.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:21:12.213 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:12.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T05:21:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:11 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/339201547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11]}]': finished 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T05:21:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:11 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/339201547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 -- 172.21.15.1:0/3163086507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 msgr2=0x7f944c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 --2- 172.21.15.1:0/3163086507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c1031b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f943c009cd0 tx=0x7f943c02a8f0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 -- 172.21.15.1:0/3163086507 shutdown_connections 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 --2- 172.21.15.1:0/3163086507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c108300 0x7f944c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 --2- 172.21.15.1:0/3163086507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c103780 0x7f944c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 --2- 172.21.15.1:0/3163086507 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c1031b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 -- 172.21.15.1:0/3163086507 >> 172.21.15.1:0/3163086507 conn(0x7f944c0fc7d0 msgr2=0x7f944c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 -- 172.21.15.1:0/3163086507 shutdown_connections 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.707+0000 7f94509a4640 1 -- 172.21.15.1:0/3163086507 wait complete. 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 Processor -- start 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 -- start start 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c103780 0x7f944c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c108300 0x7f944c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f944c112140 con 0x7f944c102dd0 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f944c111fc0 con 0x7f944c103780 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f94509a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1122c0 con 0x7f944c108300 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37518/0 (socket says 172.21.15.1:37518) 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f944a59c640 1 -- 172.21.15.1:0/2511822400 learned_addr learned my addr 172.21.15.1:0/2511822400 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.708+0000 7f9449d9b640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c103780 0x7f944c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944ad9d640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c108300 0x7f944c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 -- 172.21.15.1:0/2511822400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c108300 msgr2=0x7f944c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c108300 0x7f944c19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 -- 172.21.15.1:0/2511822400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c103780 msgr2=0x7f944c198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c103780 0x7f944c198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 -- 172.21.15.1:0/2511822400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c19d5b0 con 0x7f944c102dd0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f944a59c640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f80 tx=0x7f943c030b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f943b7fe640 1 -- 172.21.15.1:0/2511822400 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c004240 con 0x7f944c102dd0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c19d840 con 0x7f944c102dd0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f943b7fe640 1 -- 172.21.15.1:0/2511822400 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f943c040070 con 0x7f944c102dd0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f943b7fe640 1 -- 172.21.15.1:0/2511822400 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c045c20 con 0x7f944c102dd0 2024-09-19T05:21:12.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.709+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a5180 con 0x7f944c102dd0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.711+0000 7f943b7fe640 1 -- 172.21.15.1:0/2511822400 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f943c0043e0 con 0x7f944c102dd0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 Processor -- start 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 -- start start 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f9a408090 con 0x559f9a4b0fc0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559f9a3afa70 con 0x559f9a4a18b0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9452d7d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f9a404050 con 0x559f9a4a21d0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f943b7fe640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9449d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9449d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37534/0 (socket says 172.21.15.1:37534) 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f9449d9b640 1 -- 172.21.15.1:0/3605408764 learned_addr learned my addr 172.21.15.1:0/3605408764 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:12.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f944ad9d640 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f944a59c640 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.712+0000 7f944ad9d640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 -- 172.21.15.1:0/3605408764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 msgr2=0x559f9a4b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f943b7fe640 1 -- 172.21.15.1:0/2511822400 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f943c0f0eb0 con 0x7f944c102dd0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 -- 172.21.15.1:0/3605408764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 msgr2=0x559f9a4a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 -- 172.21.15.1:0/3605408764 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9a3bc130 con 0x559f9a4b0fc0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f944ad9d640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9444005fd0 tx=0x7f94440046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9449d9b640 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f94400099d0 tx=0x7f9440009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2bb3012d3e4f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9438ff9640 1 -- 172.21.15.1:0/3605408764 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440017070 con 0x559f9a4b0fc0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9438ff9640 1 -- 172.21.15.1:0/3605408764 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9440013470 con 0x559f9a4b0fc0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.713+0000 7f9438ff9640 1 -- 172.21.15.1:0/3605408764 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440012610 con 0x559f9a4b0fc0 2024-09-19T05:21:12.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- 172.21.15.1:0/3605408764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 msgr2=0x559f9a4b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f94400099d0 tx=0x7f9440009e90 comp rx=0 tx=0).stop 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- 172.21.15.1:0/3605408764 shutdown_connections 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4b33b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 --2- 172.21.15.1:0/3605408764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- 172.21.15.1:0/3605408764 >> 172.21.15.1:0/3605408764 conn(0x559f9a49df60 msgr2=0x559f9a49e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- 172.21.15.1:0/3605408764 shutdown_connections 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- 172.21.15.1:0/3605408764 wait complete. 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.714+0000 7f9452d7d740 1 -- start start 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 Processor -- start 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4b3b90 con 0x559f9a4b0fc0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559f9a3c2f20 con 0x559f9a4a18b0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4b3d10 con 0x559f9a4a21d0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9452d7d740 10 client.0 _ll_register_callbacks cb 0x559f9a38c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37550/0 (socket says 172.21.15.1:37550) 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 -- 172.21.15.1:0/977873801 learned_addr learned my addr 172.21.15.1:0/977873801 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9449d9b640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944a59c640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 -- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 msgr2=0x559f9a4adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 -- 172.21.15.1:0/977873801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 msgr2=0x559f9a4b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 -- 172.21.15.1:0/977873801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9a1792b0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944a59c640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f944ad9d640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9444010d00 tx=0x7f9444004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b13144816e65a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.715+0000 7f9431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444005220 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f94440053c0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9440013470 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f94440055c0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 10 client.15132 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559f9a4bf4d0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9440013470 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f944401c040 con 0x559f9a4b0fc0 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 10 client.15132 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:12.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 20 client.15132 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a4c1ba0 0x559f9a4c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 4 client.15132 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.716+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9a415600 con 0x559f9a4c1ba0 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.717+0000 7f944a59c640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a4c1ba0 0x559f9a4c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.717+0000 7f944a59c640 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a4c1ba0 0x559f9a4c3010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db8e0f4928f7a7f server_cookie=e80e135847fb5f9a in_seq=0 out_seq=0 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.717+0000 7f9431ffb640 10 client.15132 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9431ffb640 1 -- 172.21.15.1:0/977873801 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f9a415600 con 0x559f9a4c1ba0 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9431ffb640 10 client.15132 handle_command_reply: tid=0 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 client.15132 shutdown 2024-09-19T05:21:12.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 msgr2=0x559f9a4ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9444010d00 tx=0x7f9444004730 comp rx=0 tx=0).stop 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 shutdown_connections 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a4c1ba0 0x559f9a4c3010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 --2- 172.21.15.1:0/977873801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a18b0 0x559f9a4b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 >> 172.21.15.1:0/977873801 conn(0x559f9a49df60 msgr2=0x559f9a4a3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9431ffb640 0 client.15132 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 shutdown_connections 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 1 -- 172.21.15.1:0/977873801 wait complete. 2024-09-19T05:21:12.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.718+0000 7f9452d7d740 20 client.15132 trim_cache size 0 max 16384 2024-09-19T05:21:12.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 Processor -- start 2024-09-19T05:21:12.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 -- start start 2024-09-19T05:21:12.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a21d0 0x559f9a4c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c1350 con 0x559f9a4a18b0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c1a20 con 0x559f9a4a21d0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.736+0000 7f9452d7d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c20f0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37552/0 (socket says 172.21.15.1:37552) 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 -- 172.21.15.1:0/2012310028 learned_addr learned my addr 172.21.15.1:0/2012310028 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f9449d9b640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a21d0 0x559f9a4c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944ad9d640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 -- 172.21.15.1:0/2012310028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 msgr2=0x559f9a4ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 -- 172.21.15.1:0/2012310028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a21d0 msgr2=0x559f9a4c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a21d0 0x559f9a4c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 -- 172.21.15.1:0/2012310028 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9a4c25a0 con 0x559f9a4a18b0 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944ad9d640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f944a59c640 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f943c0bd000 tx=0x7f943c08ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cd44494d4919cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f9433fff640 1 -- 172.21.15.1:0/2012310028 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c087f60 con 0x559f9a4a18b0 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f9433fff640 1 -- 172.21.15.1:0/2012310028 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f943c036040 con 0x559f9a4a18b0 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.737+0000 7f9433fff640 1 -- 172.21.15.1:0/2012310028 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c045dc0 con 0x559f9a4a18b0 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- 172.21.15.1:0/2012310028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 msgr2=0x559f9a4c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f943c0bd000 tx=0x7f943c08ff40 comp rx=0 tx=0).stop 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- 172.21.15.1:0/2012310028 shutdown_connections 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4b0fc0 0x559f9a4ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4a21d0 0x559f9a4c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 --2- 172.21.15.1:0/2012310028 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c14d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- 172.21.15.1:0/2012310028 >> 172.21.15.1:0/2012310028 conn(0x559f9a49df60 msgr2=0x559f9a49e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- 172.21.15.1:0/2012310028 shutdown_connections 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- 172.21.15.1:0/2012310028 wait complete. 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 -- start start 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.738+0000 7f9452d7d740 1 Processor -- start 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4b0fc0 0x559f9a4c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c2e90 con 0x559f9a4a18b0 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c27c0 con 0x559f9a4b0fc0 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f9a4c3560 con 0x559f9a4a21d0 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 10 client.0 _ll_register_callbacks cb 0x7f9444013480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37562/0 (socket says 172.21.15.1:37562) 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 -- 172.21.15.1:0/1041018092 learned_addr learned my addr 172.21.15.1:0/1041018092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944ad9d640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4b0fc0 0x559f9a4c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9449d9b640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 -- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 msgr2=0x559f9a4c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 -- 172.21.15.1:0/1041018092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4b0fc0 msgr2=0x559f9a4c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4b0fc0 0x559f9a4c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 -- 172.21.15.1:0/1041018092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9a52a2a0 con 0x559f9a4a18b0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f944a59c640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f943c003ed0 tx=0x7f943c0bd0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe13b9158980518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9431ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0c5d30 con 0x559f9a4a18b0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f943c045dc0 con 0x559f9a4a18b0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.739+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f943c036040 con 0x559f9a4a18b0 2024-09-19T05:21:12.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f943c0d60c0 con 0x559f9a4a18b0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 10 client.15138 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559f9a52b480 con 0x559f9a4a18b0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f943c036040 con 0x559f9a4a18b0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f943c08b070 con 0x559f9a4a18b0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 10 client.15138 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 10 client.15138 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 20 client.15138 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a52fd80 0x559f9a52ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 4 client.15138 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "status"}) -- 0x559f9a40fb10 con 0x559f9a52fd80 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.740+0000 7f9449d9b640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a52fd80 0x559f9a52ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9449d9b640 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a52fd80 0x559f9a52ea90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7b719ec4d49d80 server_cookie=1f48448b063314 in_seq=0 out_seq=0 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9431ffb640 10 client.15138 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:12.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9431ffb640 1 -- 172.21.15.1:0/1041018092 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559f9a40fb10 con 0x559f9a52fd80 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9431ffb640 10 client.15138 handle_command_reply: tid=0 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 client.15138 shutdown 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 msgr2=0x559f9a4c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f943c003ed0 tx=0x7f943c0bd0c0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 shutdown_connections 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559f9a4b0fc0 0x559f9a4c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559f9a52fd80 0x559f9a52ea90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f9a4a21d0 0x559f9a4c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9431ffb640 0 client.15138 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 --2- 172.21.15.1:0/1041018092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559f9a4a18b0 0x559f9a4c4210 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 >> 172.21.15.1:0/1041018092 conn(0x559f9a49df60 msgr2=0x559f9a498ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 shutdown_connections 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 1 -- 172.21.15.1:0/1041018092 wait complete. 2024-09-19T05:21:12.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.741+0000 7f9452d7d740 20 client.15138 trim_cache size 0 max 16384 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24472, 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 129.77046489599999, 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 21, 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 91, 2024-09-19T05:21:12.752 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T05:21:12.753 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 150.007874109 2024-09-19T05:21:12.753 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:21:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 msgr2=0x7f94340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9444005fd0 tx=0x7f94440046c0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 msgr2=0x7f944c198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f943c000f80 tx=0x7f943c030b60 comp rx=0 tx=0).stop 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 shutdown_connections 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c108300 0x7f944c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c103780 0x7f944c198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 --2- 172.21.15.1:0/2511822400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c102dd0 0x7f944c198600 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 >> 172.21.15.1:0/2511822400 conn(0x7f944c0fc7d0 msgr2=0x7f944c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 shutdown_connections 2024-09-19T05:21:12.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:12.742+0000 7f94509a4640 1 -- 172.21.15.1:0/2511822400 wait complete. 2024-09-19T05:21:13.198 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:12 smithi001 ceph-mon[30968]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T05:21:13.198 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:12 smithi001 ceph-mon[30968]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:21:13.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:12 smithi060 ceph-mon[35058]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T05:21:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:12 smithi060 ceph-mon[35058]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:21:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:12 smithi082 ceph-mon[35195]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T05:21:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:12 smithi082 ceph-mon[35195]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:21:13.561 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T05:21:13.577 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T05:21:13.578 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T05:21:13.578 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T05:21:13.579 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T05:21:13.599 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T05:21:13.599 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T05:21:13.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:13.600 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T05:21:13.618 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T05:21:13.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:13.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T05:21:13.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:13.688 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T05:21:13.782 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T05:21:13.783 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:21:13.783 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:13.783 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T05:21:14.055 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 -- 172.21.15.1:0/2913419427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318100e20 msgr2=0x7f1318101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 --2- 172.21.15.1:0/2913419427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318100e20 0x7f1318101200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1300009900 tx=0x7f130002a480 comp rx=0 tx=0).stop 2024-09-19T05:21:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 -- 172.21.15.1:0/2913419427 shutdown_connections 2024-09-19T05:21:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 --2- 172.21.15.1:0/2913419427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102ef0 0x7f131810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 --2- 172.21.15.1:0/2913419427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318102570 0x7f13181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 --2- 172.21.15.1:0/2913419427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318100e20 0x7f1318101200 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 -- 172.21.15.1:0/2913419427 >> 172.21.15.1:0/2913419427 conn(0x7f13180fc7d0 msgr2=0x7f13180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 -- 172.21.15.1:0/2913419427 shutdown_connections 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.545+0000 7f131f1d3640 1 -- 172.21.15.1:0/2913419427 wait complete. 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.546+0000 7f131f1d3640 1 Processor -- start 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.546+0000 7f131f1d3640 1 -- start start 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.546+0000 7f131f1d3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318100e20 0x7f13181984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.546+0000 7f131f1d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102570 0x7f1318198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131f1d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131f1d3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1318112060 con 0x7f1318102ef0 2024-09-19T05:21:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131f1d3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1318111ee0 con 0x7f1318100e20 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131f1d3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f13181121e0 con 0x7f1318102570 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58962/0 (socket says 172.21.15.1:58962) 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 -- 172.21.15.1:0/1059835275 learned_addr learned my addr 172.21.15.1:0/1059835275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f1317fff640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102570 0x7f1318198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131cf6f640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318100e20 0x7f13181984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 -- 172.21.15.1:0/1059835275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102570 msgr2=0x7f1318198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102570 0x7f1318198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 -- 172.21.15.1:0/1059835275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318100e20 msgr2=0x7f13181984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318100e20 0x7f13181984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 -- 172.21.15.1:0/1059835275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131819d490 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131d770640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f131000c970 tx=0x7f131000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310007bb0 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310007d50 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131819d780 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.547+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310018800 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.548+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13181a5060 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.549+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1318101200 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.550+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f131000fa50 con 0x7f1318102ef0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.551+0000 7f1315ffb640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 0x7f13040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.551+0000 7f131cf6f640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 0x7f13040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.551+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f13100cfcc0 con 0x7f1318102ef0 2024-09-19T05:21:14.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.551+0000 7f131cf6f640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 0x7f13040a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1300005ab0 tx=0x7f1300005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.555+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1310014030 con 0x7f1318102ef0 2024-09-19T05:21:14.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.768+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f13181a5230 con 0x7f1318102ef0 2024-09-19T05:21:14.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.769+0000 7f1315ffb640 1 -- 172.21.15.1:0/1059835275 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f131009c630 con 0x7f1318102ef0 2024-09-19T05:21:14.773 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T05:21:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 msgr2=0x7f13040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 0x7f13040a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1300005ab0 tx=0x7f1300005a20 comp rx=0 tx=0).stop 2024-09-19T05:21:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 msgr2=0x7f131819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f131000c970 tx=0x7f131000ce30 comp rx=0 tx=0).stop 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 shutdown_connections 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f13040a3240 0x7f13040a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1318102ef0 0x7f131819cdb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1318102570 0x7f1318198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 --2- 172.21.15.1:0/1059835275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1318100e20 0x7f13181984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 >> 172.21.15.1:0/1059835275 conn(0x7f13180fc7d0 msgr2=0x7f13181068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.771+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 shutdown_connections 2024-09-19T05:21:14.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:14.772+0000 7f131f1d3640 1 -- 172.21.15.1:0/1059835275 wait complete. 2024-09-19T05:21:15.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:14 smithi001 ceph-mon[30968]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:15.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:14 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1059835275' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:21:15.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:14 smithi060 ceph-mon[35058]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:14 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1059835275' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:21:15.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:14 smithi082 ceph-mon[35195]: pgmap v353: 129 pgs: 129 active+clean; 641 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:15.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:14 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1059835275' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:21:15.500 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:21:15.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:15.501 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:21:15.520 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42146sec preferred_lft 42146sec 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:21:15.521 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-19T05:21:15.521 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:21:15.522 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:21:15.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:15.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:15.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:15.667 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:21:15.692 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-19T05:21:15.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:15.695 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-19T05:21:15.752 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-19T05:21:15.752 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:21:15.752 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T05:21:15.752 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T05:21:15.752 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T05:21:15.753 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:21:15.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:15.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:15.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:15.881 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T05:21:15.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:15.898 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-19T05:21:15.954 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:21:15.955 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:21:15.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:21:15.955 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T05:21:15.955 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:21:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:16.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.076 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T05:21:16.076 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T05:21:16.077 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:21:16.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:16.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.195 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:21:16.195 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T05:21:16.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-19T05:21:16.195 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:21:16.195 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T05:21:16.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:21:16.277 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:16.292 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:21:16.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:21:16.293 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:16.348 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T05:21:16.348 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T05:21:16.348 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/b41561ac-f641-4384-a7f0-dc70293bfb0c 2024-09-19T05:21:16.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:16.348 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/b41561ac-f641-4384-a7f0-dc70293bfb0c /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T05:21:16.434 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T05:21:16.434 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T05:21:16.434 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T05:21:16.585 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T05:21:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T05:21:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T05:21:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:3300,172.21.15.60:3300,172.21.15.82:3300" 2024-09-19T05:21:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.1:3300,172.21.15.60:3300,172.21.15.82:3300:/volumes/qa/sv_1/b41561ac-f641-4384-a7f0-dc70293bfb0c 2024-09-19T05:21:16.586 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=7ab08e8a-7645-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T05:21:16.587 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T05:21:16.587 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-19T05:21:16.587 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T05:21:16.587 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T05:21:16.587 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T05:21:16.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T05:21:16.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:21:16.589 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:16.615 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T05:21:16.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:21:16.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.713 INFO:teuthology.orchestra.run.smithi001.stdout:client24827 2024-09-19T05:21:16.713 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:21:16.714 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:21:16.731 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T05:21:16.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:21:16.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.828 INFO:teuthology.orchestra.run.smithi001.stdout:client24827 2024-09-19T05:21:16.828 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T05:21:16.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T05:21:16.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.886 INFO:teuthology.orchestra.run.smithi001.stdout:client24827 2024-09-19T05:21:16.886 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968.client24827/status') 2024-09-19T05:21:16.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:21:16.947 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.24827 (3)172.21.15.1:0/2326022645 2024-09-19T05:21:16.947 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-19T05:21:16.947 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-19T05:21:16.947 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-19T05:21:16.947 INFO:teuthology.orchestra.run.smithi001.stderr:70 bytes copied, 2.3823e-05 s, 2.9 MB/s 2024-09-19T05:21:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:21:16.955 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T05:21:16.965 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T05:21:16.998 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T05:21:16.998 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:21:17.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:16 smithi060 ceph-mon[35058]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 383 B/s wr, 1 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:17.257 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:17.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:16 smithi082 ceph-mon[35195]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 383 B/s wr, 1 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:16 smithi001 ceph-mon[30968]: pgmap v354: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 383 B/s wr, 1 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:17.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 -- 172.21.15.1:0/3038975002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c112b90 msgr2=0x7f6b9c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/3038975002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c112b90 0x7f6b9c114f80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009ca0 tx=0x7f6b9402a950 comp rx=0 tx=0).stop 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 -- 172.21.15.1:0/3038975002 shutdown_connections 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/3038975002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c112b90 0x7f6b9c114f80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/3038975002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/3038975002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c074590 0x7f6b9c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 -- 172.21.15.1:0/3038975002 >> 172.21.15.1:0/3038975002 conn(0x7f6b9c0fd8c0 msgr2=0x7f6b9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 -- 172.21.15.1:0/3038975002 shutdown_connections 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.748+0000 7f6ba33b6640 1 -- 172.21.15.1:0/3038975002 wait complete. 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 Processor -- start 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 -- start start 2024-09-19T05:21:17.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074590 0x7f6b9c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c112b90 0x7f6b9c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c118560 con 0x7f6b9c074eb0 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1183e0 con 0x7f6b9c074590 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba33b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c1186e0 con 0x7f6b9c112b90 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba0951640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba0951640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58976/0 (socket says 172.21.15.1:58976) 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba0951640 1 -- 172.21.15.1:0/2185389102 learned_addr learned my addr 172.21.15.1:0/2185389102 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba1152640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074590 0x7f6b9c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.749+0000 7f6ba1953640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c112b90 0x7f6b9c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 -- 172.21.15.1:0/2185389102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c112b90 msgr2=0x7f6b9c19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c112b90 0x7f6b9c19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 -- 172.21.15.1:0/2185389102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074590 msgr2=0x7f6b9c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074590 0x7f6b9c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 -- 172.21.15.1:0/2185389102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c19efc0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba0951640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e9f0 tx=0x7f6b8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00cd80 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b8c010910 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c19f2b0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c018990 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.750+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1ab5a0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.751+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c074970 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.752+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f6b8c010ac0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.753+0000 7f6b927fc640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 0x7f6b880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.753+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6b8c0cfef0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.753+0000 7f6ba1152640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 0x7f6b880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:17.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.753+0000 7f6ba1152640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 0x7f6b880a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c19f9d0 tx=0x7f6b9800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:17.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.757+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b8c09c1b0 con 0x7f6b9c074eb0 2024-09-19T05:21:17.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.930+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b9c0ff730 con 0x7f6b880a32c0 2024-09-19T05:21:17.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.939+0000 7f6b927fc640 1 -- 172.21.15.1:0/2185389102 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340715 (secure 0 0 0) 0x7f6b9c0ff730 con 0x7f6b880a32c0 2024-09-19T05:21:17.944 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:17.946 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:21:17.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 msgr2=0x7f6b880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:17.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 0x7f6b880a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c19f9d0 tx=0x7f6b9800b390 comp rx=0 tx=0).stop 2024-09-19T05:21:17.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 msgr2=0x7f6b9c1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:17.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e9f0 tx=0x7f6b8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 shutdown_connections 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6b880a32c0 0x7f6b880a5780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b9c112b90 0x7f6b9c19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b9c074eb0 0x7f6b9c1a4c10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.942+0000 7f6ba33b6640 1 --2- 172.21.15.1:0/2185389102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9c074590 0x7f6b9c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.943+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 >> 172.21.15.1:0/2185389102 conn(0x7f6b9c0fd8c0 msgr2=0x7f6b9c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.943+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 shutdown_connections 2024-09-19T05:21:17.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:17.943+0000 7f6ba33b6640 1 -- 172.21.15.1:0/2185389102 wait complete. 2024-09-19T05:21:18.703 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-19T05:21:17.864376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656464,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":323,"num_read_kb":274,"num_write":275,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1245492,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":715,"ondisk_log_size":715,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390472,"kb_used_data":12020,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551352,"statfs":{"total":1151940427776,"available":1151540584448,"internally_reserved":0,"allocated":12308480,"data_stored":8133514,"data_compressed":471319,"data_compressed_allocated":638976,"data_compressed_original":2813952,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001895"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871987+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:21:11.871987+0000","last_peered":"2024-09-19T05:21:11.871987+0000","last_clean":"2024-09-19T05:21:11.871987+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:21:11.871987+0000","last_undegraded":"2024-09-19T05:21:11.871987+0000","last_fullsized":"2024-09-19T05:21:11.871987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961036+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:21:11.961036+0000","last_peered":"2024-09-19T05:21:11.961036+0000","last_clean":"2024-09-19T05:21:11.961036+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:21:11.961036+0000","last_undegraded":"2024-09-19T05:21:11.961036+0000","last_fullsized":"2024-09-19T05:21:11.961036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872204+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:21:11.872204+0000","last_peered":"2024-09-19T05:21:11.872204+0000","last_clean":"2024-09-19T05:21:11.872204+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:21:11.872204+0000","last_undegraded":"2024-09-19T05:21:11.872204+0000","last_fullsized":"2024-09-19T05:21:11.872204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961620+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:21:11.961620+0000","last_peered":"2024-09-19T05:21:11.961620+0000","last_clean":"2024-09-19T05:21:11.961620+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:21:11.961620+0000","last_undegraded":"2024-09-19T05:21:11.961620+0000","last_fullsized":"2024-09-19T05:21:11.961620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876407+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:21:11.876407+0000","last_peered":"2024-09-19T05:21:11.876407+0000","last_clean":"2024-09-19T05:21:11.876407+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:21:11.876407+0000","last_undegraded":"2024-09-19T05:21:11.876407+0000","last_fullsized":"2024-09-19T05:21:11.876407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872339+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:21:11.872339+0000","last_peered":"2024-09-19T05:21:11.872339+0000","last_clean":"2024-09-19T05:21:11.872339+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:21:11.872339+0000","last_undegraded":"2024-09-19T05:21:11.872339+0000","last_fullsized":"2024-09-19T05:21:11.872339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876719+0000","last_change":"2024-09-19T05:20:12.092062+0000","last_active":"2024-09-19T05:21:11.876719+0000","last_peered":"2024-09-19T05:21:11.876719+0000","last_clean":"2024-09-19T05:21:11.876719+0000","last_became_active":"2024-09-19T05:20:12.088807+0000","last_became_peered":"2024-09-19T05:20:12.088807+0000","last_unstale":"2024-09-19T05:21:11.876719+0000","last_undegraded":"2024-09-19T05:21:11.876719+0000","last_fullsized":"2024-09-19T05:21:11.876719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:07.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877617+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:21:11.877617+0000","last_peered":"2024-09-19T05:21:11.877617+0000","last_clean":"2024-09-19T05:21:11.877617+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:21:11.877617+0000","last_undegraded":"2024-09-19T05:21:11.877617+0000","last_fullsized":"2024-09-19T05:21:11.877617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872701+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:21:11.872701+0000","last_peered":"2024-09-19T05:21:11.872701+0000","last_clean":"2024-09-19T05:21:11.872701+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:21:11.872701+0000","last_undegraded":"2024-09-19T05:21:11.872701+0000","last_fullsized":"2024-09-19T05:21:11.872701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876638+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:21:11.876638+0000","last_peered":"2024-09-19T05:21:11.876638+0000","last_clean":"2024-09-19T05:21:11.876638+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:21:11.876638+0000","last_undegraded":"2024-09-19T05:21:11.876638+0000","last_fullsized":"2024-09-19T05:21:11.876638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881939+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:21:11.881939+0000","last_peered":"2024-09-19T05:21:11.881939+0000","last_clean":"2024-09-19T05:21:11.881939+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:21:11.881939+0000","last_undegraded":"2024-09-19T05:21:11.881939+0000","last_fullsized":"2024-09-19T05:21:11.881939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872430+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:21:11.872430+0000","last_peered":"2024-09-19T05:21:11.872430+0000","last_clean":"2024-09-19T05:21:11.872430+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:21:11.872430+0000","last_undegraded":"2024-09-19T05:21:11.872430+0000","last_fullsized":"2024-09-19T05:21:11.872430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961638+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:21:11.961638+0000","last_peered":"2024-09-19T05:21:11.961638+0000","last_clean":"2024-09-19T05:21:11.961638+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:21:11.961638+0000","last_undegraded":"2024-09-19T05:21:11.961638+0000","last_fullsized":"2024-09-19T05:21:11.961638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876379+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:21:11.876379+0000","last_peered":"2024-09-19T05:21:11.876379+0000","last_clean":"2024-09-19T05:21:11.876379+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:21:11.876379+0000","last_undegraded":"2024-09-19T05:21:11.876379+0000","last_fullsized":"2024-09-19T05:21:11.876379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872692+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:21:11.872692+0000","last_peered":"2024-09-19T05:21:11.872692+0000","last_clean":"2024-09-19T05:21:11.872692+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:21:11.872692+0000","last_undegraded":"2024-09-19T05:21:11.872692+0000","last_fullsized":"2024-09-19T05:21:11.872692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961345+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:21:11.961345+0000","last_peered":"2024-09-19T05:21:11.961345+0000","last_clean":"2024-09-19T05:21:11.961345+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:21:11.961345+0000","last_undegraded":"2024-09-19T05:21:11.961345+0000","last_fullsized":"2024-09-19T05:21:11.961345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872319+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:21:11.872319+0000","last_peered":"2024-09-19T05:21:11.872319+0000","last_clean":"2024-09-19T05:21:11.872319+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:21:11.872319+0000","last_undegraded":"2024-09-19T05:21:11.872319+0000","last_fullsized":"2024-09-19T05:21:11.872319+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872679+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:21:11.872679+0000","last_peered":"2024-09-19T05:21:11.872679+0000","last_clean":"2024-09-19T05:21:11.872679+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:21:11.872679+0000","last_undegraded":"2024-09-19T05:21:11.872679+0000","last_fullsized":"2024-09-19T05:21:11.872679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875155+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:21:11.875155+0000","last_peered":"2024-09-19T05:21:11.875155+0000","last_clean":"2024-09-19T05:21:11.875155+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:21:11.875155+0000","last_undegraded":"2024-09-19T05:21:11.875155+0000","last_fullsized":"2024-09-19T05:21:11.875155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876926+0000","last_change":"2024-09-19T05:20:11.784742+0000","last_active":"2024-09-19T05:21:11.876926+0000","last_peered":"2024-09-19T05:21:11.876926+0000","last_clean":"2024-09-19T05:21:11.876926+0000","last_became_active":"2024-09-19T05:20:11.784065+0000","last_became_peered":"2024-09-19T05:20:11.784065+0000","last_unstale":"2024-09-19T05:21:11.876926+0000","last_undegraded":"2024-09-19T05:21:11.876926+0000","last_fullsized":"2024-09-19T05:21:11.876926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:28.836945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876275+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:21:11.876275+0000","last_peered":"2024-09-19T05:21:11.876275+0000","last_clean":"2024-09-19T05:21:11.876275+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:21:11.876275+0000","last_undegraded":"2024-09-19T05:21:11.876275+0000","last_fullsized":"2024-09-19T05:21:11.876275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877239+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:21:11.877239+0000","last_peered":"2024-09-19T05:21:11.877239+0000","last_clean":"2024-09-19T05:21:11.877239+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:21:11.877239+0000","last_undegraded":"2024-09-19T05:21:11.877239+0000","last_fullsized":"2024-09-19T05:21:11.877239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872579+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:21:11.872579+0000","last_peered":"2024-09-19T05:21:11.872579+0000","last_clean":"2024-09-19T05:21:11.872579+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:21:11.872579+0000","last_undegraded":"2024-09-19T05:21:11.872579+0000","last_fullsized":"2024-09-19T05:21:11.872579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876349+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:21:11.876349+0000","last_peered":"2024-09-19T05:21:11.876349+0000","last_clean":"2024-09-19T05:21:11.876349+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:21:11.876349+0000","last_undegraded":"2024-09-19T05:21:11.876349+0000","last_fullsized":"2024-09-19T05:21:11.876349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872923+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:21:11.872923+0000","last_peered":"2024-09-19T05:21:11.872923+0000","last_clean":"2024-09-19T05:21:11.872923+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:21:11.872923+0000","last_undegraded":"2024-09-19T05:21:11.872923+0000","last_fullsized":"2024-09-19T05:21:11.872923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872539+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:21:11.872539+0000","last_peered":"2024-09-19T05:21:11.872539+0000","last_clean":"2024-09-19T05:21:11.872539+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:21:11.872539+0000","last_undegraded":"2024-09-19T05:21:11.872539+0000","last_fullsized":"2024-09-19T05:21:11.872539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961686+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:21:11.961686+0000","last_peered":"2024-09-19T05:21:11.961686+0000","last_clean":"2024-09-19T05:21:11.961686+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:21:11.961686+0000","last_undegraded":"2024-09-19T05:21:11.961686+0000","last_fullsized":"2024-09-19T05:21:11.961686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872120+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:21:11.872120+0000","last_peered":"2024-09-19T05:21:11.872120+0000","last_clean":"2024-09-19T05:21:11.872120+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:21:11.872120+0000","last_undegraded":"2024-09-19T05:21:11.872120+0000","last_fullsized":"2024-09-19T05:21:11.872120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960801+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:21:11.960801+0000","last_peered":"2024-09-19T05:21:11.960801+0000","last_clean":"2024-09-19T05:21:11.960801+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:21:11.960801+0000","last_undegraded":"2024-09-19T05:21:11.960801+0000","last_fullsized":"2024-09-19T05:21:11.960801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962226+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:21:11.962226+0000","last_peered":"2024-09-19T05:21:11.962226+0000","last_clean":"2024-09-19T05:21:11.962226+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:21:11.962226+0000","last_undegraded":"2024-09-19T05:21:11.962226+0000","last_fullsized":"2024-09-19T05:21:11.962226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876828+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:21:11.876828+0000","last_peered":"2024-09-19T05:21:11.876828+0000","last_clean":"2024-09-19T05:21:11.876828+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:21:11.876828+0000","last_undegraded":"2024-09-19T05:21:11.876828+0000","last_fullsized":"2024-09-19T05:21:11.876828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874241+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:21:11.874241+0000","last_peered":"2024-09-19T05:21:11.874241+0000","last_clean":"2024-09-19T05:21:11.874241+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:21:11.874241+0000","last_undegraded":"2024-09-19T05:21:11.874241+0000","last_fullsized":"2024-09-19T05:21:11.874241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874901+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:21:11.874901+0000","last_peered":"2024-09-19T05:21:11.874901+0000","last_clean":"2024-09-19T05:21:11.874901+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:21:11.874901+0000","last_undegraded":"2024-09-19T05:21:11.874901+0000","last_fullsized":"2024-09-19T05:21:11.874901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871976+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:21:11.871976+0000","last_peered":"2024-09-19T05:21:11.871976+0000","last_clean":"2024-09-19T05:21:11.871976+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:21:11.871976+0000","last_undegraded":"2024-09-19T05:21:11.871976+0000","last_fullsized":"2024-09-19T05:21:11.871976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876471+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:21:11.876471+0000","last_peered":"2024-09-19T05:21:11.876471+0000","last_clean":"2024-09-19T05:21:11.876471+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:21:11.876471+0000","last_undegraded":"2024-09-19T05:21:11.876471+0000","last_fullsized":"2024-09-19T05:21:11.876471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874809+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:21:11.874809+0000","last_peered":"2024-09-19T05:21:11.874809+0000","last_clean":"2024-09-19T05:21:11.874809+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:21:11.874809+0000","last_undegraded":"2024-09-19T05:21:11.874809+0000","last_fullsized":"2024-09-19T05:21:11.874809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961847+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:21:11.961847+0000","last_peered":"2024-09-19T05:21:11.961847+0000","last_clean":"2024-09-19T05:21:11.961847+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:21:11.961847+0000","last_undegraded":"2024-09-19T05:21:11.961847+0000","last_fullsized":"2024-09-19T05:21:11.961847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962007+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:21:11.962007+0000","last_peered":"2024-09-19T05:21:11.962007+0000","last_clean":"2024-09-19T05:21:11.962007+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:21:11.962007+0000","last_undegraded":"2024-09-19T05:21:11.962007+0000","last_fullsized":"2024-09-19T05:21:11.962007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881265+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:21:11.881265+0000","last_peered":"2024-09-19T05:21:11.881265+0000","last_clean":"2024-09-19T05:21:11.881265+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:21:11.881265+0000","last_undegraded":"2024-09-19T05:21:11.881265+0000","last_fullsized":"2024-09-19T05:21:11.881265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960945+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:21:11.960945+0000","last_peered":"2024-09-19T05:21:11.960945+0000","last_clean":"2024-09-19T05:21:11.960945+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:21:11.960945+0000","last_undegraded":"2024-09-19T05:21:11.960945+0000","last_fullsized":"2024-09-19T05:21:11.960945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961781+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:21:11.961781+0000","last_peered":"2024-09-19T05:21:11.961781+0000","last_clean":"2024-09-19T05:21:11.961781+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:21:11.961781+0000","last_undegraded":"2024-09-19T05:21:11.961781+0000","last_fullsized":"2024-09-19T05:21:11.961781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960799+0000","last_change":"2024-09-19T05:20:11.690531+0000","last_active":"2024-09-19T05:21:11.960799+0000","last_peered":"2024-09-19T05:21:11.960799+0000","last_clean":"2024-09-19T05:21:11.960799+0000","last_became_active":"2024-09-19T05:20:11.690170+0000","last_became_peered":"2024-09-19T05:20:11.690170+0000","last_unstale":"2024-09-19T05:21:11.960799+0000","last_undegraded":"2024-09-19T05:21:11.960799+0000","last_fullsized":"2024-09-19T05:21:11.960799+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:02.432072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961432+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:21:11.961432+0000","last_peered":"2024-09-19T05:21:11.961432+0000","last_clean":"2024-09-19T05:21:11.961432+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:21:11.961432+0000","last_undegraded":"2024-09-19T05:21:11.961432+0000","last_fullsized":"2024-09-19T05:21:11.961432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876671+0000","last_change":"2024-09-19T05:20:11.691798+0000","last_active":"2024-09-19T05:21:11.876671+0000","last_peered":"2024-09-19T05:21:11.876671+0000","last_clean":"2024-09-19T05:21:11.876671+0000","last_became_active":"2024-09-19T05:20:11.690998+0000","last_became_peered":"2024-09-19T05:20:11.690998+0000","last_unstale":"2024-09-19T05:21:11.876671+0000","last_undegraded":"2024-09-19T05:21:11.876671+0000","last_fullsized":"2024-09-19T05:21:11.876671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:51.907655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961275+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:21:11.961275+0000","last_peered":"2024-09-19T05:21:11.961275+0000","last_clean":"2024-09-19T05:21:11.961275+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:21:11.961275+0000","last_undegraded":"2024-09-19T05:21:11.961275+0000","last_fullsized":"2024-09-19T05:21:11.961275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873077+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:21:11.873077+0000","last_peered":"2024-09-19T05:21:11.873077+0000","last_clean":"2024-09-19T05:21:11.873077+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:21:11.873077+0000","last_undegraded":"2024-09-19T05:21:11.873077+0000","last_fullsized":"2024-09-19T05:21:11.873077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961568+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:21:11.961568+0000","last_peered":"2024-09-19T05:21:11.961568+0000","last_clean":"2024-09-19T05:21:11.961568+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:21:11.961568+0000","last_undegraded":"2024-09-19T05:21:11.961568+0000","last_fullsized":"2024-09-19T05:21:11.961568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961816+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:21:11.961816+0000","last_peered":"2024-09-19T05:21:11.961816+0000","last_clean":"2024-09-19T05:21:11.961816+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:21:11.961816+0000","last_undegraded":"2024-09-19T05:21:11.961816+0000","last_fullsized":"2024-09-19T05:21:11.961816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961902+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:21:11.961902+0000","last_peered":"2024-09-19T05:21:11.961902+0000","last_clean":"2024-09-19T05:21:11.961902+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:21:11.961902+0000","last_undegraded":"2024-09-19T05:21:11.961902+0000","last_fullsized":"2024-09-19T05:21:11.961902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872879+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:21:11.872879+0000","last_peered":"2024-09-19T05:21:11.872879+0000","last_clean":"2024-09-19T05:21:11.872879+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:21:11.872879+0000","last_undegraded":"2024-09-19T05:21:11.872879+0000","last_fullsized":"2024-09-19T05:21:11.872879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877276+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:21:11.877276+0000","last_peered":"2024-09-19T05:21:11.877276+0000","last_clean":"2024-09-19T05:21:11.877276+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:21:11.877276+0000","last_undegraded":"2024-09-19T05:21:11.877276+0000","last_fullsized":"2024-09-19T05:21:11.877276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961872+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:21:11.961872+0000","last_peered":"2024-09-19T05:21:11.961872+0000","last_clean":"2024-09-19T05:21:11.961872+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:21:11.961872+0000","last_undegraded":"2024-09-19T05:21:11.961872+0000","last_fullsized":"2024-09-19T05:21:11.961872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882260+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:21:11.882260+0000","last_peered":"2024-09-19T05:21:11.882260+0000","last_clean":"2024-09-19T05:21:11.882260+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:21:11.882260+0000","last_undegraded":"2024-09-19T05:21:11.882260+0000","last_fullsized":"2024-09-19T05:21:11.882260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876096+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:21:11.876096+0000","last_peered":"2024-09-19T05:21:11.876096+0000","last_clean":"2024-09-19T05:21:11.876096+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:21:11.876096+0000","last_undegraded":"2024-09-19T05:21:11.876096+0000","last_fullsized":"2024-09-19T05:21:11.876096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961980+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:21:11.961980+0000","last_peered":"2024-09-19T05:21:11.961980+0000","last_clean":"2024-09-19T05:21:11.961980+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:21:11.961980+0000","last_undegraded":"2024-09-19T05:21:11.961980+0000","last_fullsized":"2024-09-19T05:21:11.961980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962114+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:21:11.962114+0000","last_peered":"2024-09-19T05:21:11.962114+0000","last_clean":"2024-09-19T05:21:11.962114+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:21:11.962114+0000","last_undegraded":"2024-09-19T05:21:11.962114+0000","last_fullsized":"2024-09-19T05:21:11.962114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881129+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:21:11.881129+0000","last_peered":"2024-09-19T05:21:11.881129+0000","last_clean":"2024-09-19T05:21:11.881129+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:21:11.881129+0000","last_undegraded":"2024-09-19T05:21:11.881129+0000","last_fullsized":"2024-09-19T05:21:11.881129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874591+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:21:11.874591+0000","last_peered":"2024-09-19T05:21:11.874591+0000","last_clean":"2024-09-19T05:21:11.874591+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:21:11.874591+0000","last_undegraded":"2024-09-19T05:21:11.874591+0000","last_fullsized":"2024-09-19T05:21:11.874591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877091+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:21:11.877091+0000","last_peered":"2024-09-19T05:21:11.877091+0000","last_clean":"2024-09-19T05:21:11.877091+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:21:11.877091+0000","last_undegraded":"2024-09-19T05:21:11.877091+0000","last_fullsized":"2024-09-19T05:21:11.877091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881256+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:21:11.881256+0000","last_peered":"2024-09-19T05:21:11.881256+0000","last_clean":"2024-09-19T05:21:11.881256+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:21:11.881256+0000","last_undegraded":"2024-09-19T05:21:11.881256+0000","last_fullsized":"2024-09-19T05:21:11.881256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881398+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:21:11.881398+0000","last_peered":"2024-09-19T05:21:11.881398+0000","last_clean":"2024-09-19T05:21:11.881398+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:21:11.881398+0000","last_undegraded":"2024-09-19T05:21:11.881398+0000","last_fullsized":"2024-09-19T05:21:11.881398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.884270+0000","last_change":"2024-09-19T05:21:11.883795+0000","last_active":"2024-09-19T05:21:11.884270+0000","last_peered":"2024-09-19T05:21:11.884270+0000","last_clean":"2024-09-19T05:21:11.884270+0000","last_became_active":"2024-09-19T05:21:11.877327+0000","last_became_peered":"2024-09-19T05:21:11.877327+0000","last_unstale":"2024-09-19T05:21:11.884270+0000","last_undegraded":"2024-09-19T05:21:11.884270+0000","last_fullsized":"2024-09-19T05:21:11.884270+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:06.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962156+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:21:11.962156+0000","last_peered":"2024-09-19T05:21:11.962156+0000","last_clean":"2024-09-19T05:21:11.962156+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:21:11.962156+0000","last_undegraded":"2024-09-19T05:21:11.962156+0000","last_fullsized":"2024-09-19T05:21:11.962156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961337+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:21:11.961337+0000","last_peered":"2024-09-19T05:21:11.961337+0000","last_clean":"2024-09-19T05:21:11.961337+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:21:11.961337+0000","last_undegraded":"2024-09-19T05:21:11.961337+0000","last_fullsized":"2024-09-19T05:21:11.961337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872599+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:21:11.872599+0000","last_peered":"2024-09-19T05:21:11.872599+0000","last_clean":"2024-09-19T05:21:11.872599+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:21:11.872599+0000","last_undegraded":"2024-09-19T05:21:11.872599+0000","last_fullsized":"2024-09-19T05:21:11.872599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876789+0000","last_change":"2024-09-19T05:20:12.087358+0000","last_active":"2024-09-19T05:21:11.876789+0000","last_peered":"2024-09-19T05:21:11.876789+0000","last_clean":"2024-09-19T05:21:11.876789+0000","last_became_active":"2024-09-19T05:20:12.086826+0000","last_became_peered":"2024-09-19T05:20:12.086826+0000","last_unstale":"2024-09-19T05:21:11.876789+0000","last_undegraded":"2024-09-19T05:21:11.876789+0000","last_fullsized":"2024-09-19T05:21:11.876789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:54.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961593+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:21:11.961593+0000","last_peered":"2024-09-19T05:21:11.961593+0000","last_clean":"2024-09-19T05:21:11.961593+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:21:11.961593+0000","last_undegraded":"2024-09-19T05:21:11.961593+0000","last_fullsized":"2024-09-19T05:21:11.961593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881551+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:21:11.881551+0000","last_peered":"2024-09-19T05:21:11.881551+0000","last_clean":"2024-09-19T05:21:11.881551+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:21:11.881551+0000","last_undegraded":"2024-09-19T05:21:11.881551+0000","last_fullsized":"2024-09-19T05:21:11.881551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874232+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:21:11.874232+0000","last_peered":"2024-09-19T05:21:11.874232+0000","last_clean":"2024-09-19T05:21:11.874232+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:21:11.874232+0000","last_undegraded":"2024-09-19T05:21:11.874232+0000","last_fullsized":"2024-09-19T05:21:11.874232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962162+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:21:11.962162+0000","last_peered":"2024-09-19T05:21:11.962162+0000","last_clean":"2024-09-19T05:21:11.962162+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:21:11.962162+0000","last_undegraded":"2024-09-19T05:21:11.962162+0000","last_fullsized":"2024-09-19T05:21:11.962162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872592+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:21:11.872592+0000","last_peered":"2024-09-19T05:21:11.872592+0000","last_clean":"2024-09-19T05:21:11.872592+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:21:11.872592+0000","last_undegraded":"2024-09-19T05:21:11.872592+0000","last_fullsized":"2024-09-19T05:21:11.872592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881828+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:21:11.881828+0000","last_peered":"2024-09-19T05:21:11.881828+0000","last_clean":"2024-09-19T05:21:11.881828+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:21:11.881828+0000","last_undegraded":"2024-09-19T05:21:11.881828+0000","last_fullsized":"2024-09-19T05:21:11.881828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876667+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:21:11.876667+0000","last_peered":"2024-09-19T05:21:11.876667+0000","last_clean":"2024-09-19T05:21:11.876667+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:21:11.876667+0000","last_undegraded":"2024-09-19T05:21:11.876667+0000","last_fullsized":"2024-09-19T05:21:11.876667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":282,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:16.889014+0000","last_change":"2024-09-19T05:21:11.884150+0000","last_active":"2024-09-19T05:21:16.889014+0000","last_peered":"2024-09-19T05:21:16.889014+0000","last_clean":"2024-09-19T05:21:16.889014+0000","last_became_active":"2024-09-19T05:21:11.878410+0000","last_became_peered":"2024-09-19T05:21:11.878410+0000","last_unstale":"2024-09-19T05:21:16.889014+0000","last_undegraded":"2024-09-19T05:21:16.889014+0000","last_fullsized":"2024-09-19T05:21:16.889014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:55.914090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65064,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":159,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874621+0000","last_change":"2024-09-19T05:20:11.784172+0000","last_active":"2024-09-19T05:21:11.874621+0000","last_peered":"2024-09-19T05:21:11.874621+0000","last_clean":"2024-09-19T05:21:11.874621+0000","last_became_active":"2024-09-19T05:20:11.783884+0000","last_became_peered":"2024-09-19T05:20:11.783884+0000","last_unstale":"2024-09-19T05:21:11.874621+0000","last_undegraded":"2024-09-19T05:21:11.874621+0000","last_fullsized":"2024-09-19T05:21:11.874621+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:25.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877656+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:21:11.877656+0000","last_peered":"2024-09-19T05:21:11.877656+0000","last_clean":"2024-09-19T05:21:11.877656+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:21:11.877656+0000","last_undegraded":"2024-09-19T05:21:11.877656+0000","last_fullsized":"2024-09-19T05:21:11.877656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882191+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:21:11.882191+0000","last_peered":"2024-09-19T05:21:11.882191+0000","last_clean":"2024-09-19T05:21:11.882191+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:21:11.882191+0000","last_undegraded":"2024-09-19T05:21:11.882191+0000","last_fullsized":"2024-09-19T05:21:11.882191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872967+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:21:11.872967+0000","last_peered":"2024-09-19T05:21:11.872967+0000","last_clean":"2024-09-19T05:21:11.872967+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:21:11.872967+0000","last_undegraded":"2024-09-19T05:21:11.872967+0000","last_fullsized":"2024-09-19T05:21:11.872967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876431+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:21:11.876431+0000","last_peered":"2024-09-19T05:21:11.876431+0000","last_clean":"2024-09-19T05:21:11.876431+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:21:11.876431+0000","last_undegraded":"2024-09-19T05:21:11.876431+0000","last_fullsized":"2024-09-19T05:21:11.876431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961850+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:21:11.961850+0000","last_peered":"2024-09-19T05:21:11.961850+0000","last_clean":"2024-09-19T05:21:11.961850+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:21:11.961850+0000","last_undegraded":"2024-09-19T05:21:11.961850+0000","last_fullsized":"2024-09-19T05:21:11.961850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871456+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:21:11.871456+0000","last_peered":"2024-09-19T05:21:11.871456+0000","last_clean":"2024-09-19T05:21:11.871456+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:21:11.871456+0000","last_undegraded":"2024-09-19T05:21:11.871456+0000","last_fullsized":"2024-09-19T05:21:11.871456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877801+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:21:11.877801+0000","last_peered":"2024-09-19T05:21:11.877801+0000","last_clean":"2024-09-19T05:21:11.877801+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:21:11.877801+0000","last_undegraded":"2024-09-19T05:21:11.877801+0000","last_fullsized":"2024-09-19T05:21:11.877801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875000+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:21:11.875000+0000","last_peered":"2024-09-19T05:21:11.875000+0000","last_clean":"2024-09-19T05:21:11.875000+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:21:11.875000+0000","last_undegraded":"2024-09-19T05:21:11.875000+0000","last_fullsized":"2024-09-19T05:21:11.875000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961081+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:21:11.961081+0000","last_peered":"2024-09-19T05:21:11.961081+0000","last_clean":"2024-09-19T05:21:11.961081+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:21:11.961081+0000","last_undegraded":"2024-09-19T05:21:11.961081+0000","last_fullsized":"2024-09-19T05:21:11.961081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876134+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:21:11.876134+0000","last_peered":"2024-09-19T05:21:11.876134+0000","last_clean":"2024-09-19T05:21:11.876134+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:21:11.876134+0000","last_undegraded":"2024-09-19T05:21:11.876134+0000","last_fullsized":"2024-09-19T05:21:11.876134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871625+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:21:11.871625+0000","last_peered":"2024-09-19T05:21:11.871625+0000","last_clean":"2024-09-19T05:21:11.871625+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:21:11.871625+0000","last_undegraded":"2024-09-19T05:21:11.871625+0000","last_fullsized":"2024-09-19T05:21:11.871625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.963064+0000","last_change":"2024-09-19T05:21:11.962673+0000","last_active":"2024-09-19T05:21:11.963064+0000","last_peered":"2024-09-19T05:21:11.963064+0000","last_clean":"2024-09-19T05:21:11.963064+0000","last_became_active":"2024-09-19T05:21:11.962407+0000","last_became_peered":"2024-09-19T05:21:11.962407+0000","last_unstale":"2024-09-19T05:21:11.963064+0000","last_undegraded":"2024-09-19T05:21:11.963064+0000","last_fullsized":"2024-09-19T05:21:11.963064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:46.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874571+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:21:11.874571+0000","last_peered":"2024-09-19T05:21:11.874571+0000","last_clean":"2024-09-19T05:21:11.874571+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:21:11.874571+0000","last_undegraded":"2024-09-19T05:21:11.874571+0000","last_fullsized":"2024-09-19T05:21:11.874571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960943+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:21:11.960943+0000","last_peered":"2024-09-19T05:21:11.960943+0000","last_clean":"2024-09-19T05:21:11.960943+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:21:11.960943+0000","last_undegraded":"2024-09-19T05:21:11.960943+0000","last_fullsized":"2024-09-19T05:21:11.960943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961037+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:21:11.961037+0000","last_peered":"2024-09-19T05:21:11.961037+0000","last_clean":"2024-09-19T05:21:11.961037+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:21:11.961037+0000","last_undegraded":"2024-09-19T05:21:11.961037+0000","last_fullsized":"2024-09-19T05:21:11.961037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874818+0000","last_change":"2024-09-19T05:20:12.090144+0000","last_active":"2024-09-19T05:21:11.874818+0000","last_peered":"2024-09-19T05:21:11.874818+0000","last_clean":"2024-09-19T05:21:11.874818+0000","last_became_active":"2024-09-19T05:20:12.089669+0000","last_became_peered":"2024-09-19T05:20:12.089669+0000","last_unstale":"2024-09-19T05:21:11.874818+0000","last_undegraded":"2024-09-19T05:21:11.874818+0000","last_fullsized":"2024-09-19T05:21:11.874818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:39.253036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881603+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:21:11.881603+0000","last_peered":"2024-09-19T05:21:11.881603+0000","last_clean":"2024-09-19T05:21:11.881603+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:21:11.881603+0000","last_undegraded":"2024-09-19T05:21:11.881603+0000","last_fullsized":"2024-09-19T05:21:11.881603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872472+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:21:11.872472+0000","last_peered":"2024-09-19T05:21:11.872472+0000","last_clean":"2024-09-19T05:21:11.872472+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:21:11.872472+0000","last_undegraded":"2024-09-19T05:21:11.872472+0000","last_fullsized":"2024-09-19T05:21:11.872472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881650+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:21:11.881650+0000","last_peered":"2024-09-19T05:21:11.881650+0000","last_clean":"2024-09-19T05:21:11.881650+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:21:11.881650+0000","last_undegraded":"2024-09-19T05:21:11.881650+0000","last_fullsized":"2024-09-19T05:21:11.881650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876402+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:21:11.876402+0000","last_peered":"2024-09-19T05:21:11.876402+0000","last_clean":"2024-09-19T05:21:11.876402+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:21:11.876402+0000","last_undegraded":"2024-09-19T05:21:11.876402+0000","last_fullsized":"2024-09-19T05:21:11.876402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872926+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:21:11.872926+0000","last_peered":"2024-09-19T05:21:11.872926+0000","last_clean":"2024-09-19T05:21:11.872926+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:21:11.872926+0000","last_undegraded":"2024-09-19T05:21:11.872926+0000","last_fullsized":"2024-09-19T05:21:11.872926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874997+0000","last_change":"2024-09-19T05:20:11.693523+0000","last_active":"2024-09-19T05:21:11.874997+0000","last_peered":"2024-09-19T05:21:11.874997+0000","last_clean":"2024-09-19T05:21:11.874997+0000","last_became_active":"2024-09-19T05:20:11.693018+0000","last_became_peered":"2024-09-19T05:20:11.693018+0000","last_unstale":"2024-09-19T05:21:11.874997+0000","last_undegraded":"2024-09-19T05:21:11.874997+0000","last_fullsized":"2024-09-19T05:21:11.874997+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:09.595591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872596+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:21:11.872596+0000","last_peered":"2024-09-19T05:21:11.872596+0000","last_clean":"2024-09-19T05:21:11.872596+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:21:11.872596+0000","last_undegraded":"2024-09-19T05:21:11.872596+0000","last_fullsized":"2024-09-19T05:21:11.872596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872274+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:21:11.872274+0000","last_peered":"2024-09-19T05:21:11.872274+0000","last_clean":"2024-09-19T05:21:11.872274+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:21:11.872274+0000","last_undegraded":"2024-09-19T05:21:11.872274+0000","last_fullsized":"2024-09-19T05:21:11.872274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876155+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:21:11.876155+0000","last_peered":"2024-09-19T05:21:11.876155+0000","last_clean":"2024-09-19T05:21:11.876155+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:21:11.876155+0000","last_undegraded":"2024-09-19T05:21:11.876155+0000","last_fullsized":"2024-09-19T05:21:11.876155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962127+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:21:11.962127+0000","last_peered":"2024-09-19T05:21:11.962127+0000","last_clean":"2024-09-19T05:21:11.962127+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:21:11.962127+0000","last_undegraded":"2024-09-19T05:21:11.962127+0000","last_fullsized":"2024-09-19T05:21:11.962127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874532+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:21:11.874532+0000","last_peered":"2024-09-19T05:21:11.874532+0000","last_clean":"2024-09-19T05:21:11.874532+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:21:11.874532+0000","last_undegraded":"2024-09-19T05:21:11.874532+0000","last_fullsized":"2024-09-19T05:21:11.874532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872918+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:21:11.872918+0000","last_peered":"2024-09-19T05:21:11.872918+0000","last_clean":"2024-09-19T05:21:11.872918+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:21:11.872918+0000","last_undegraded":"2024-09-19T05:21:11.872918+0000","last_fullsized":"2024-09-19T05:21:11.872918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961666+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:21:11.961666+0000","last_peered":"2024-09-19T05:21:11.961666+0000","last_clean":"2024-09-19T05:21:11.961666+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:21:11.961666+0000","last_undegraded":"2024-09-19T05:21:11.961666+0000","last_fullsized":"2024-09-19T05:21:11.961666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881264+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:21:11.881264+0000","last_peered":"2024-09-19T05:21:11.881264+0000","last_clean":"2024-09-19T05:21:11.881264+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:21:11.881264+0000","last_undegraded":"2024-09-19T05:21:11.881264+0000","last_fullsized":"2024-09-19T05:21:11.881264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961256+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:21:11.961256+0000","last_peered":"2024-09-19T05:21:11.961256+0000","last_clean":"2024-09-19T05:21:11.961256+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:21:11.961256+0000","last_undegraded":"2024-09-19T05:21:11.961256+0000","last_fullsized":"2024-09-19T05:21:11.961256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877578+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:21:11.877578+0000","last_peered":"2024-09-19T05:21:11.877578+0000","last_clean":"2024-09-19T05:21:11.877578+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:21:11.877578+0000","last_undegraded":"2024-09-19T05:21:11.877578+0000","last_fullsized":"2024-09-19T05:21:11.877578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961992+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:21:11.961992+0000","last_peered":"2024-09-19T05:21:11.961992+0000","last_clean":"2024-09-19T05:21:11.961992+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:21:11.961992+0000","last_undegraded":"2024-09-19T05:21:11.961992+0000","last_fullsized":"2024-09-19T05:21:11.961992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874395+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:21:11.874395+0000","last_peered":"2024-09-19T05:21:11.874395+0000","last_clean":"2024-09-19T05:21:11.874395+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:21:11.874395+0000","last_undegraded":"2024-09-19T05:21:11.874395+0000","last_fullsized":"2024-09-19T05:21:11.874395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873044+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:21:11.873044+0000","last_peered":"2024-09-19T05:21:11.873044+0000","last_clean":"2024-09-19T05:21:11.873044+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:21:11.873044+0000","last_undegraded":"2024-09-19T05:21:11.873044+0000","last_fullsized":"2024-09-19T05:21:11.873044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872076+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:21:11.872076+0000","last_peered":"2024-09-19T05:21:11.872076+0000","last_clean":"2024-09-19T05:21:11.872076+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:21:11.872076+0000","last_undegraded":"2024-09-19T05:21:11.872076+0000","last_fullsized":"2024-09-19T05:21:11.872076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874788+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:21:11.874788+0000","last_peered":"2024-09-19T05:21:11.874788+0000","last_clean":"2024-09-19T05:21:11.874788+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:21:11.874788+0000","last_undegraded":"2024-09-19T05:21:11.874788+0000","last_fullsized":"2024-09-19T05:21:11.874788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877033+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:21:11.877033+0000","last_peered":"2024-09-19T05:21:11.877033+0000","last_clean":"2024-09-19T05:21:11.877033+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:21:11.877033+0000","last_undegraded":"2024-09-19T05:21:11.877033+0000","last_fullsized":"2024-09-19T05:21:11.877033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875904+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:21:11.875904+0000","last_peered":"2024-09-19T05:21:11.875904+0000","last_clean":"2024-09-19T05:21:11.875904+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:21:11.875904+0000","last_undegraded":"2024-09-19T05:21:11.875904+0000","last_fullsized":"2024-09-19T05:21:11.875904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875926+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:21:11.875926+0000","last_peered":"2024-09-19T05:21:11.875926+0000","last_clean":"2024-09-19T05:21:11.875926+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:21:11.875926+0000","last_undegraded":"2024-09-19T05:21:11.875926+0000","last_fullsized":"2024-09-19T05:21:11.875926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961926+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:21:11.961926+0000","last_peered":"2024-09-19T05:21:11.961926+0000","last_clean":"2024-09-19T05:21:11.961926+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:21:11.961926+0000","last_undegraded":"2024-09-19T05:21:11.961926+0000","last_fullsized":"2024-09-19T05:21:11.961926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872907+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:21:11.872907+0000","last_peered":"2024-09-19T05:21:11.872907+0000","last_clean":"2024-09-19T05:21:11.872907+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:21:11.872907+0000","last_undegraded":"2024-09-19T05:21:11.872907+0000","last_fullsized":"2024-09-19T05:21:11.872907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961843+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:21:11.961843+0000","last_peered":"2024-09-19T05:21:11.961843+0000","last_clean":"2024-09-19T05:21:11.961843+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:21:11.961843+0000","last_undegraded":"2024-09-19T05:21:11.961843+0000","last_fullsized":"2024-09-19T05:21:11.961843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875256+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:21:11.875256+0000","last_peered":"2024-09-19T05:21:11.875256+0000","last_clean":"2024-09-19T05:21:11.875256+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:21:11.875256+0000","last_undegraded":"2024-09-19T05:21:11.875256+0000","last_fullsized":"2024-09-19T05:21:11.875256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877683+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:21:11.877683+0000","last_peered":"2024-09-19T05:21:11.877683+0000","last_clean":"2024-09-19T05:21:11.877683+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:21:11.877683+0000","last_undegraded":"2024-09-19T05:21:11.877683+0000","last_fullsized":"2024-09-19T05:21:11.877683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961130+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:21:11.961130+0000","last_peered":"2024-09-19T05:21:11.961130+0000","last_clean":"2024-09-19T05:21:11.961130+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:21:11.961130+0000","last_undegraded":"2024-09-19T05:21:11.961130+0000","last_fullsized":"2024-09-19T05:21:11.961130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874759+0000","last_change":"2024-09-19T05:20:11.691043+0000","last_active":"2024-09-19T05:21:11.874759+0000","last_peered":"2024-09-19T05:21:11.874759+0000","last_clean":"2024-09-19T05:21:11.874759+0000","last_became_active":"2024-09-19T05:20:11.690672+0000","last_became_peered":"2024-09-19T05:20:11.690672+0000","last_unstale":"2024-09-19T05:21:11.874759+0000","last_undegraded":"2024-09-19T05:21:11.874759+0000","last_fullsized":"2024-09-19T05:21:11.874759+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:01.913488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876447+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:21:11.876447+0000","last_peered":"2024-09-19T05:21:11.876447+0000","last_clean":"2024-09-19T05:21:11.876447+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:21:11.876447+0000","last_undegraded":"2024-09-19T05:21:11.876447+0000","last_fullsized":"2024-09-19T05:21:11.876447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871767+0000","last_change":"2024-09-19T05:20:11.690113+0000","last_active":"2024-09-19T05:21:11.871767+0000","last_peered":"2024-09-19T05:21:11.871767+0000","last_clean":"2024-09-19T05:21:11.871767+0000","last_became_active":"2024-09-19T05:20:11.689729+0000","last_became_peered":"2024-09-19T05:20:11.689729+0000","last_unstale":"2024-09-19T05:21:11.871767+0000","last_undegraded":"2024-09-19T05:21:11.871767+0000","last_fullsized":"2024-09-19T05:21:11.871767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:14.762934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876158+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:21:11.876158+0000","last_peered":"2024-09-19T05:21:11.876158+0000","last_clean":"2024-09-19T05:21:11.876158+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:21:11.876158+0000","last_undegraded":"2024-09-19T05:21:11.876158+0000","last_fullsized":"2024-09-19T05:21:11.876158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876329+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:21:11.876329+0000","last_peered":"2024-09-19T05:21:11.876329+0000","last_clean":"2024-09-19T05:21:11.876329+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:21:11.876329+0000","last_undegraded":"2024-09-19T05:21:11.876329+0000","last_fullsized":"2024-09-19T05:21:11.876329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874720+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:21:11.874720+0000","last_peered":"2024-09-19T05:21:11.874720+0000","last_clean":"2024-09-19T05:21:11.874720+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:21:11.874720+0000","last_undegraded":"2024-09-19T05:21:11.874720+0000","last_fullsized":"2024-09-19T05:21:11.874720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65862,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":165,"num_write":92,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":196970,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547241,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":515152,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1126400,"data_stored":1166682,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906994,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":519830,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135927,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":515756,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":1110198,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528386,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":511056,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1056768,"data_stored":1105702,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":579930,"data_compressed":39698,"data_compressed_allocated":53248,"data_compressed_original":143360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":511160,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":995328,"data_stored":511090,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":575812,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":511146,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":64778,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:21:18.709 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:21:18.973 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:19.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:18 smithi001 ceph-mon[30968]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:19.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:18 smithi001 ceph-mon[30968]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:19.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:18 smithi060 ceph-mon[35058]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:19.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:18 smithi060 ceph-mon[35058]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:18 smithi082 ceph-mon[35195]: pgmap v355: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 511 B/s wr, 2 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-19T05:21:19.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:18 smithi082 ceph-mon[35195]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- 172.21.15.1:0/580876318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074620 msgr2=0x7f22a0074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/580876318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074620 0x7f22a0074a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2290009ca0 tx=0x7f229002a950 comp rx=0 tx=0).stop 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- 172.21.15.1:0/580876318 shutdown_connections 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/580876318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 0x7f22a0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/580876318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074f40 0x7f22a010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/580876318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074620 0x7f22a0074a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- 172.21.15.1:0/580876318 >> 172.21.15.1:0/580876318 conn(0x7f22a00fd8c0 msgr2=0x7f22a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- 172.21.15.1:0/580876318 shutdown_connections 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- 172.21.15.1:0/580876318 wait complete. 2024-09-19T05:21:19.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 Processor -- start 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.456+0000 7f22a7bcd640 1 -- start start 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 0x7f22a019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 0x7f22a019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0114150 con 0x7f22a0074f40 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0113fd0 con 0x7f22a010e3c0 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a7bcd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01142d0 con 0x7f22a0074620 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58992/0 (socket says 172.21.15.1:58992) 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 -- 172.21.15.1:0/3473354396 learned_addr learned my addr 172.21.15.1:0/3473354396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a616a640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 0x7f22a019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5969640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 0x7f22a019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:19.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 -- 172.21.15.1:0/3473354396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 msgr2=0x7f22a019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 0x7f22a019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 -- 172.21.15.1:0/3473354396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 msgr2=0x7f22a019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 0x7f22a019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 -- 172.21.15.1:0/3473354396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a019f590 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5969640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 0x7f22a019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f22a5168640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f229400c920 tx=0x7f229400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294007c70 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.457+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2294007e10 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.458+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a019f880 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.458+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294018890 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.458+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a01a7160 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.458+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a0074a00 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.460+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2294018a70 con 0x7f22a0074f40 2024-09-19T05:21:19.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.460+0000 7f229effd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 0x7f22880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:19.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.460+0000 7f22a5969640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 0x7f22880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:19.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.460+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f22940cfdb0 con 0x7f22a0074f40 2024-09-19T05:21:19.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.461+0000 7f22a5969640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 0x7f22880a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2290006010 tx=0x7f2290005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:19.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.465+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2294014030 con 0x7f22a0074f40 2024-09-19T05:21:19.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.639+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22a0062630 con 0x7f22880a32c0 2024-09-19T05:21:19.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.647+0000 7f229effd640 1 -- 172.21.15.1:0/3473354396 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340715 (secure 0 0 0) 0x7f22a0062630 con 0x7f22880a32c0 2024-09-19T05:21:19.652 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:19.654 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 msgr2=0x7f22880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 0x7f22880a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2290006010 tx=0x7f2290005f80 comp rx=0 tx=0).stop 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 msgr2=0x7f22a019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f229400c920 tx=0x7f229400cde0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 shutdown_connections 2024-09-19T05:21:19.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f22880a32c0 0x7f22880a5780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a010e3c0 0x7f22a019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22a0074f40 0x7f22a019ab20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 --2- 172.21.15.1:0/3473354396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a0074620 0x7f22a019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 >> 172.21.15.1:0/3473354396 conn(0x7f22a00fd8c0 msgr2=0x7f22a00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.651+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 shutdown_connections 2024-09-19T05:21:19.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:19.652+0000 7f22a7bcd640 1 -- 172.21.15.1:0/3473354396 wait complete. 2024-09-19T05:21:20.022 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:19 smithi001 ceph-mon[30968]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:20.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:19 smithi060 ceph-mon[35058]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:19 smithi082 ceph-mon[35195]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:20.405 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-19T05:21:17.864376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656464,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":323,"num_read_kb":274,"num_write":275,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1245492,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":715,"ondisk_log_size":715,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390472,"kb_used_data":12020,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551352,"statfs":{"total":1151940427776,"available":1151540584448,"internally_reserved":0,"allocated":12308480,"data_stored":8133514,"data_compressed":471319,"data_compressed_allocated":638976,"data_compressed_original":2813952,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001895"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871987+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:21:11.871987+0000","last_peered":"2024-09-19T05:21:11.871987+0000","last_clean":"2024-09-19T05:21:11.871987+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:21:11.871987+0000","last_undegraded":"2024-09-19T05:21:11.871987+0000","last_fullsized":"2024-09-19T05:21:11.871987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961036+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:21:11.961036+0000","last_peered":"2024-09-19T05:21:11.961036+0000","last_clean":"2024-09-19T05:21:11.961036+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:21:11.961036+0000","last_undegraded":"2024-09-19T05:21:11.961036+0000","last_fullsized":"2024-09-19T05:21:11.961036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872204+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:21:11.872204+0000","last_peered":"2024-09-19T05:21:11.872204+0000","last_clean":"2024-09-19T05:21:11.872204+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:21:11.872204+0000","last_undegraded":"2024-09-19T05:21:11.872204+0000","last_fullsized":"2024-09-19T05:21:11.872204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961620+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:21:11.961620+0000","last_peered":"2024-09-19T05:21:11.961620+0000","last_clean":"2024-09-19T05:21:11.961620+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:21:11.961620+0000","last_undegraded":"2024-09-19T05:21:11.961620+0000","last_fullsized":"2024-09-19T05:21:11.961620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876407+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:21:11.876407+0000","last_peered":"2024-09-19T05:21:11.876407+0000","last_clean":"2024-09-19T05:21:11.876407+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:21:11.876407+0000","last_undegraded":"2024-09-19T05:21:11.876407+0000","last_fullsized":"2024-09-19T05:21:11.876407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872339+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:21:11.872339+0000","last_peered":"2024-09-19T05:21:11.872339+0000","last_clean":"2024-09-19T05:21:11.872339+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:21:11.872339+0000","last_undegraded":"2024-09-19T05:21:11.872339+0000","last_fullsized":"2024-09-19T05:21:11.872339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876719+0000","last_change":"2024-09-19T05:20:12.092062+0000","last_active":"2024-09-19T05:21:11.876719+0000","last_peered":"2024-09-19T05:21:11.876719+0000","last_clean":"2024-09-19T05:21:11.876719+0000","last_became_active":"2024-09-19T05:20:12.088807+0000","last_became_peered":"2024-09-19T05:20:12.088807+0000","last_unstale":"2024-09-19T05:21:11.876719+0000","last_undegraded":"2024-09-19T05:21:11.876719+0000","last_fullsized":"2024-09-19T05:21:11.876719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:07.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877617+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:21:11.877617+0000","last_peered":"2024-09-19T05:21:11.877617+0000","last_clean":"2024-09-19T05:21:11.877617+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:21:11.877617+0000","last_undegraded":"2024-09-19T05:21:11.877617+0000","last_fullsized":"2024-09-19T05:21:11.877617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872701+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:21:11.872701+0000","last_peered":"2024-09-19T05:21:11.872701+0000","last_clean":"2024-09-19T05:21:11.872701+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:21:11.872701+0000","last_undegraded":"2024-09-19T05:21:11.872701+0000","last_fullsized":"2024-09-19T05:21:11.872701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876638+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:21:11.876638+0000","last_peered":"2024-09-19T05:21:11.876638+0000","last_clean":"2024-09-19T05:21:11.876638+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:21:11.876638+0000","last_undegraded":"2024-09-19T05:21:11.876638+0000","last_fullsized":"2024-09-19T05:21:11.876638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881939+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:21:11.881939+0000","last_peered":"2024-09-19T05:21:11.881939+0000","last_clean":"2024-09-19T05:21:11.881939+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:21:11.881939+0000","last_undegraded":"2024-09-19T05:21:11.881939+0000","last_fullsized":"2024-09-19T05:21:11.881939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872430+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:21:11.872430+0000","last_peered":"2024-09-19T05:21:11.872430+0000","last_clean":"2024-09-19T05:21:11.872430+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:21:11.872430+0000","last_undegraded":"2024-09-19T05:21:11.872430+0000","last_fullsized":"2024-09-19T05:21:11.872430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961638+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:21:11.961638+0000","last_peered":"2024-09-19T05:21:11.961638+0000","last_clean":"2024-09-19T05:21:11.961638+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:21:11.961638+0000","last_undegraded":"2024-09-19T05:21:11.961638+0000","last_fullsized":"2024-09-19T05:21:11.961638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876379+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:21:11.876379+0000","last_peered":"2024-09-19T05:21:11.876379+0000","last_clean":"2024-09-19T05:21:11.876379+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:21:11.876379+0000","last_undegraded":"2024-09-19T05:21:11.876379+0000","last_fullsized":"2024-09-19T05:21:11.876379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872692+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:21:11.872692+0000","last_peered":"2024-09-19T05:21:11.872692+0000","last_clean":"2024-09-19T05:21:11.872692+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:21:11.872692+0000","last_undegraded":"2024-09-19T05:21:11.872692+0000","last_fullsized":"2024-09-19T05:21:11.872692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961345+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:21:11.961345+0000","last_peered":"2024-09-19T05:21:11.961345+0000","last_clean":"2024-09-19T05:21:11.961345+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:21:11.961345+0000","last_undegraded":"2024-09-19T05:21:11.961345+0000","last_fullsized":"2024-09-19T05:21:11.961345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872319+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:21:11.872319+0000","last_peered":"2024-09-19T05:21:11.872319+0000","last_clean":"2024-09-19T05:21:11.872319+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:21:11.872319+0000","last_undegraded":"2024-09-19T05:21:11.872319+0000","last_fullsized":"2024-09-19T05:21:11.872319+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872679+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:21:11.872679+0000","last_peered":"2024-09-19T05:21:11.872679+0000","last_clean":"2024-09-19T05:21:11.872679+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:21:11.872679+0000","last_undegraded":"2024-09-19T05:21:11.872679+0000","last_fullsized":"2024-09-19T05:21:11.872679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875155+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:21:11.875155+0000","last_peered":"2024-09-19T05:21:11.875155+0000","last_clean":"2024-09-19T05:21:11.875155+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:21:11.875155+0000","last_undegraded":"2024-09-19T05:21:11.875155+0000","last_fullsized":"2024-09-19T05:21:11.875155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876926+0000","last_change":"2024-09-19T05:20:11.784742+0000","last_active":"2024-09-19T05:21:11.876926+0000","last_peered":"2024-09-19T05:21:11.876926+0000","last_clean":"2024-09-19T05:21:11.876926+0000","last_became_active":"2024-09-19T05:20:11.784065+0000","last_became_peered":"2024-09-19T05:20:11.784065+0000","last_unstale":"2024-09-19T05:21:11.876926+0000","last_undegraded":"2024-09-19T05:21:11.876926+0000","last_fullsized":"2024-09-19T05:21:11.876926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:28.836945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876275+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:21:11.876275+0000","last_peered":"2024-09-19T05:21:11.876275+0000","last_clean":"2024-09-19T05:21:11.876275+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:21:11.876275+0000","last_undegraded":"2024-09-19T05:21:11.876275+0000","last_fullsized":"2024-09-19T05:21:11.876275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877239+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:21:11.877239+0000","last_peered":"2024-09-19T05:21:11.877239+0000","last_clean":"2024-09-19T05:21:11.877239+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:21:11.877239+0000","last_undegraded":"2024-09-19T05:21:11.877239+0000","last_fullsized":"2024-09-19T05:21:11.877239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872579+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:21:11.872579+0000","last_peered":"2024-09-19T05:21:11.872579+0000","last_clean":"2024-09-19T05:21:11.872579+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:21:11.872579+0000","last_undegraded":"2024-09-19T05:21:11.872579+0000","last_fullsized":"2024-09-19T05:21:11.872579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876349+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:21:11.876349+0000","last_peered":"2024-09-19T05:21:11.876349+0000","last_clean":"2024-09-19T05:21:11.876349+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:21:11.876349+0000","last_undegraded":"2024-09-19T05:21:11.876349+0000","last_fullsized":"2024-09-19T05:21:11.876349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872923+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:21:11.872923+0000","last_peered":"2024-09-19T05:21:11.872923+0000","last_clean":"2024-09-19T05:21:11.872923+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:21:11.872923+0000","last_undegraded":"2024-09-19T05:21:11.872923+0000","last_fullsized":"2024-09-19T05:21:11.872923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872539+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:21:11.872539+0000","last_peered":"2024-09-19T05:21:11.872539+0000","last_clean":"2024-09-19T05:21:11.872539+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:21:11.872539+0000","last_undegraded":"2024-09-19T05:21:11.872539+0000","last_fullsized":"2024-09-19T05:21:11.872539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961686+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:21:11.961686+0000","last_peered":"2024-09-19T05:21:11.961686+0000","last_clean":"2024-09-19T05:21:11.961686+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:21:11.961686+0000","last_undegraded":"2024-09-19T05:21:11.961686+0000","last_fullsized":"2024-09-19T05:21:11.961686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872120+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:21:11.872120+0000","last_peered":"2024-09-19T05:21:11.872120+0000","last_clean":"2024-09-19T05:21:11.872120+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:21:11.872120+0000","last_undegraded":"2024-09-19T05:21:11.872120+0000","last_fullsized":"2024-09-19T05:21:11.872120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960801+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:21:11.960801+0000","last_peered":"2024-09-19T05:21:11.960801+0000","last_clean":"2024-09-19T05:21:11.960801+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:21:11.960801+0000","last_undegraded":"2024-09-19T05:21:11.960801+0000","last_fullsized":"2024-09-19T05:21:11.960801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962226+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:21:11.962226+0000","last_peered":"2024-09-19T05:21:11.962226+0000","last_clean":"2024-09-19T05:21:11.962226+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:21:11.962226+0000","last_undegraded":"2024-09-19T05:21:11.962226+0000","last_fullsized":"2024-09-19T05:21:11.962226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876828+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:21:11.876828+0000","last_peered":"2024-09-19T05:21:11.876828+0000","last_clean":"2024-09-19T05:21:11.876828+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:21:11.876828+0000","last_undegraded":"2024-09-19T05:21:11.876828+0000","last_fullsized":"2024-09-19T05:21:11.876828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874241+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:21:11.874241+0000","last_peered":"2024-09-19T05:21:11.874241+0000","last_clean":"2024-09-19T05:21:11.874241+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:21:11.874241+0000","last_undegraded":"2024-09-19T05:21:11.874241+0000","last_fullsized":"2024-09-19T05:21:11.874241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874901+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:21:11.874901+0000","last_peered":"2024-09-19T05:21:11.874901+0000","last_clean":"2024-09-19T05:21:11.874901+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:21:11.874901+0000","last_undegraded":"2024-09-19T05:21:11.874901+0000","last_fullsized":"2024-09-19T05:21:11.874901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871976+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:21:11.871976+0000","last_peered":"2024-09-19T05:21:11.871976+0000","last_clean":"2024-09-19T05:21:11.871976+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:21:11.871976+0000","last_undegraded":"2024-09-19T05:21:11.871976+0000","last_fullsized":"2024-09-19T05:21:11.871976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876471+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:21:11.876471+0000","last_peered":"2024-09-19T05:21:11.876471+0000","last_clean":"2024-09-19T05:21:11.876471+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:21:11.876471+0000","last_undegraded":"2024-09-19T05:21:11.876471+0000","last_fullsized":"2024-09-19T05:21:11.876471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874809+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:21:11.874809+0000","last_peered":"2024-09-19T05:21:11.874809+0000","last_clean":"2024-09-19T05:21:11.874809+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:21:11.874809+0000","last_undegraded":"2024-09-19T05:21:11.874809+0000","last_fullsized":"2024-09-19T05:21:11.874809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961847+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:21:11.961847+0000","last_peered":"2024-09-19T05:21:11.961847+0000","last_clean":"2024-09-19T05:21:11.961847+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:21:11.961847+0000","last_undegraded":"2024-09-19T05:21:11.961847+0000","last_fullsized":"2024-09-19T05:21:11.961847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962007+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:21:11.962007+0000","last_peered":"2024-09-19T05:21:11.962007+0000","last_clean":"2024-09-19T05:21:11.962007+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:21:11.962007+0000","last_undegraded":"2024-09-19T05:21:11.962007+0000","last_fullsized":"2024-09-19T05:21:11.962007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881265+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:21:11.881265+0000","last_peered":"2024-09-19T05:21:11.881265+0000","last_clean":"2024-09-19T05:21:11.881265+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:21:11.881265+0000","last_undegraded":"2024-09-19T05:21:11.881265+0000","last_fullsized":"2024-09-19T05:21:11.881265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960945+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:21:11.960945+0000","last_peered":"2024-09-19T05:21:11.960945+0000","last_clean":"2024-09-19T05:21:11.960945+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:21:11.960945+0000","last_undegraded":"2024-09-19T05:21:11.960945+0000","last_fullsized":"2024-09-19T05:21:11.960945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961781+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:21:11.961781+0000","last_peered":"2024-09-19T05:21:11.961781+0000","last_clean":"2024-09-19T05:21:11.961781+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:21:11.961781+0000","last_undegraded":"2024-09-19T05:21:11.961781+0000","last_fullsized":"2024-09-19T05:21:11.961781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960799+0000","last_change":"2024-09-19T05:20:11.690531+0000","last_active":"2024-09-19T05:21:11.960799+0000","last_peered":"2024-09-19T05:21:11.960799+0000","last_clean":"2024-09-19T05:21:11.960799+0000","last_became_active":"2024-09-19T05:20:11.690170+0000","last_became_peered":"2024-09-19T05:20:11.690170+0000","last_unstale":"2024-09-19T05:21:11.960799+0000","last_undegraded":"2024-09-19T05:21:11.960799+0000","last_fullsized":"2024-09-19T05:21:11.960799+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:02.432072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961432+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:21:11.961432+0000","last_peered":"2024-09-19T05:21:11.961432+0000","last_clean":"2024-09-19T05:21:11.961432+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:21:11.961432+0000","last_undegraded":"2024-09-19T05:21:11.961432+0000","last_fullsized":"2024-09-19T05:21:11.961432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876671+0000","last_change":"2024-09-19T05:20:11.691798+0000","last_active":"2024-09-19T05:21:11.876671+0000","last_peered":"2024-09-19T05:21:11.876671+0000","last_clean":"2024-09-19T05:21:11.876671+0000","last_became_active":"2024-09-19T05:20:11.690998+0000","last_became_peered":"2024-09-19T05:20:11.690998+0000","last_unstale":"2024-09-19T05:21:11.876671+0000","last_undegraded":"2024-09-19T05:21:11.876671+0000","last_fullsized":"2024-09-19T05:21:11.876671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:51.907655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961275+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:21:11.961275+0000","last_peered":"2024-09-19T05:21:11.961275+0000","last_clean":"2024-09-19T05:21:11.961275+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:21:11.961275+0000","last_undegraded":"2024-09-19T05:21:11.961275+0000","last_fullsized":"2024-09-19T05:21:11.961275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873077+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:21:11.873077+0000","last_peered":"2024-09-19T05:21:11.873077+0000","last_clean":"2024-09-19T05:21:11.873077+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:21:11.873077+0000","last_undegraded":"2024-09-19T05:21:11.873077+0000","last_fullsized":"2024-09-19T05:21:11.873077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961568+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:21:11.961568+0000","last_peered":"2024-09-19T05:21:11.961568+0000","last_clean":"2024-09-19T05:21:11.961568+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:21:11.961568+0000","last_undegraded":"2024-09-19T05:21:11.961568+0000","last_fullsized":"2024-09-19T05:21:11.961568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961816+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:21:11.961816+0000","last_peered":"2024-09-19T05:21:11.961816+0000","last_clean":"2024-09-19T05:21:11.961816+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:21:11.961816+0000","last_undegraded":"2024-09-19T05:21:11.961816+0000","last_fullsized":"2024-09-19T05:21:11.961816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961902+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:21:11.961902+0000","last_peered":"2024-09-19T05:21:11.961902+0000","last_clean":"2024-09-19T05:21:11.961902+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:21:11.961902+0000","last_undegraded":"2024-09-19T05:21:11.961902+0000","last_fullsized":"2024-09-19T05:21:11.961902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872879+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:21:11.872879+0000","last_peered":"2024-09-19T05:21:11.872879+0000","last_clean":"2024-09-19T05:21:11.872879+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:21:11.872879+0000","last_undegraded":"2024-09-19T05:21:11.872879+0000","last_fullsized":"2024-09-19T05:21:11.872879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877276+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:21:11.877276+0000","last_peered":"2024-09-19T05:21:11.877276+0000","last_clean":"2024-09-19T05:21:11.877276+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:21:11.877276+0000","last_undegraded":"2024-09-19T05:21:11.877276+0000","last_fullsized":"2024-09-19T05:21:11.877276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961872+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:21:11.961872+0000","last_peered":"2024-09-19T05:21:11.961872+0000","last_clean":"2024-09-19T05:21:11.961872+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:21:11.961872+0000","last_undegraded":"2024-09-19T05:21:11.961872+0000","last_fullsized":"2024-09-19T05:21:11.961872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882260+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:21:11.882260+0000","last_peered":"2024-09-19T05:21:11.882260+0000","last_clean":"2024-09-19T05:21:11.882260+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:21:11.882260+0000","last_undegraded":"2024-09-19T05:21:11.882260+0000","last_fullsized":"2024-09-19T05:21:11.882260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876096+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:21:11.876096+0000","last_peered":"2024-09-19T05:21:11.876096+0000","last_clean":"2024-09-19T05:21:11.876096+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:21:11.876096+0000","last_undegraded":"2024-09-19T05:21:11.876096+0000","last_fullsized":"2024-09-19T05:21:11.876096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961980+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:21:11.961980+0000","last_peered":"2024-09-19T05:21:11.961980+0000","last_clean":"2024-09-19T05:21:11.961980+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:21:11.961980+0000","last_undegraded":"2024-09-19T05:21:11.961980+0000","last_fullsized":"2024-09-19T05:21:11.961980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962114+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:21:11.962114+0000","last_peered":"2024-09-19T05:21:11.962114+0000","last_clean":"2024-09-19T05:21:11.962114+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:21:11.962114+0000","last_undegraded":"2024-09-19T05:21:11.962114+0000","last_fullsized":"2024-09-19T05:21:11.962114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881129+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:21:11.881129+0000","last_peered":"2024-09-19T05:21:11.881129+0000","last_clean":"2024-09-19T05:21:11.881129+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:21:11.881129+0000","last_undegraded":"2024-09-19T05:21:11.881129+0000","last_fullsized":"2024-09-19T05:21:11.881129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874591+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:21:11.874591+0000","last_peered":"2024-09-19T05:21:11.874591+0000","last_clean":"2024-09-19T05:21:11.874591+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:21:11.874591+0000","last_undegraded":"2024-09-19T05:21:11.874591+0000","last_fullsized":"2024-09-19T05:21:11.874591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877091+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:21:11.877091+0000","last_peered":"2024-09-19T05:21:11.877091+0000","last_clean":"2024-09-19T05:21:11.877091+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:21:11.877091+0000","last_undegraded":"2024-09-19T05:21:11.877091+0000","last_fullsized":"2024-09-19T05:21:11.877091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881256+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:21:11.881256+0000","last_peered":"2024-09-19T05:21:11.881256+0000","last_clean":"2024-09-19T05:21:11.881256+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:21:11.881256+0000","last_undegraded":"2024-09-19T05:21:11.881256+0000","last_fullsized":"2024-09-19T05:21:11.881256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881398+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:21:11.881398+0000","last_peered":"2024-09-19T05:21:11.881398+0000","last_clean":"2024-09-19T05:21:11.881398+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:21:11.881398+0000","last_undegraded":"2024-09-19T05:21:11.881398+0000","last_fullsized":"2024-09-19T05:21:11.881398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.884270+0000","last_change":"2024-09-19T05:21:11.883795+0000","last_active":"2024-09-19T05:21:11.884270+0000","last_peered":"2024-09-19T05:21:11.884270+0000","last_clean":"2024-09-19T05:21:11.884270+0000","last_became_active":"2024-09-19T05:21:11.877327+0000","last_became_peered":"2024-09-19T05:21:11.877327+0000","last_unstale":"2024-09-19T05:21:11.884270+0000","last_undegraded":"2024-09-19T05:21:11.884270+0000","last_fullsized":"2024-09-19T05:21:11.884270+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:06.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962156+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:21:11.962156+0000","last_peered":"2024-09-19T05:21:11.962156+0000","last_clean":"2024-09-19T05:21:11.962156+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:21:11.962156+0000","last_undegraded":"2024-09-19T05:21:11.962156+0000","last_fullsized":"2024-09-19T05:21:11.962156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961337+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:21:11.961337+0000","last_peered":"2024-09-19T05:21:11.961337+0000","last_clean":"2024-09-19T05:21:11.961337+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:21:11.961337+0000","last_undegraded":"2024-09-19T05:21:11.961337+0000","last_fullsized":"2024-09-19T05:21:11.961337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872599+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:21:11.872599+0000","last_peered":"2024-09-19T05:21:11.872599+0000","last_clean":"2024-09-19T05:21:11.872599+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:21:11.872599+0000","last_undegraded":"2024-09-19T05:21:11.872599+0000","last_fullsized":"2024-09-19T05:21:11.872599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876789+0000","last_change":"2024-09-19T05:20:12.087358+0000","last_active":"2024-09-19T05:21:11.876789+0000","last_peered":"2024-09-19T05:21:11.876789+0000","last_clean":"2024-09-19T05:21:11.876789+0000","last_became_active":"2024-09-19T05:20:12.086826+0000","last_became_peered":"2024-09-19T05:20:12.086826+0000","last_unstale":"2024-09-19T05:21:11.876789+0000","last_undegraded":"2024-09-19T05:21:11.876789+0000","last_fullsized":"2024-09-19T05:21:11.876789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:54.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961593+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:21:11.961593+0000","last_peered":"2024-09-19T05:21:11.961593+0000","last_clean":"2024-09-19T05:21:11.961593+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:21:11.961593+0000","last_undegraded":"2024-09-19T05:21:11.961593+0000","last_fullsized":"2024-09-19T05:21:11.961593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881551+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:21:11.881551+0000","last_peered":"2024-09-19T05:21:11.881551+0000","last_clean":"2024-09-19T05:21:11.881551+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:21:11.881551+0000","last_undegraded":"2024-09-19T05:21:11.881551+0000","last_fullsized":"2024-09-19T05:21:11.881551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874232+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:21:11.874232+0000","last_peered":"2024-09-19T05:21:11.874232+0000","last_clean":"2024-09-19T05:21:11.874232+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:21:11.874232+0000","last_undegraded":"2024-09-19T05:21:11.874232+0000","last_fullsized":"2024-09-19T05:21:11.874232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962162+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:21:11.962162+0000","last_peered":"2024-09-19T05:21:11.962162+0000","last_clean":"2024-09-19T05:21:11.962162+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:21:11.962162+0000","last_undegraded":"2024-09-19T05:21:11.962162+0000","last_fullsized":"2024-09-19T05:21:11.962162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872592+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:21:11.872592+0000","last_peered":"2024-09-19T05:21:11.872592+0000","last_clean":"2024-09-19T05:21:11.872592+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:21:11.872592+0000","last_undegraded":"2024-09-19T05:21:11.872592+0000","last_fullsized":"2024-09-19T05:21:11.872592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881828+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:21:11.881828+0000","last_peered":"2024-09-19T05:21:11.881828+0000","last_clean":"2024-09-19T05:21:11.881828+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:21:11.881828+0000","last_undegraded":"2024-09-19T05:21:11.881828+0000","last_fullsized":"2024-09-19T05:21:11.881828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876667+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:21:11.876667+0000","last_peered":"2024-09-19T05:21:11.876667+0000","last_clean":"2024-09-19T05:21:11.876667+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:21:11.876667+0000","last_undegraded":"2024-09-19T05:21:11.876667+0000","last_fullsized":"2024-09-19T05:21:11.876667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":282,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:16.889014+0000","last_change":"2024-09-19T05:21:11.884150+0000","last_active":"2024-09-19T05:21:16.889014+0000","last_peered":"2024-09-19T05:21:16.889014+0000","last_clean":"2024-09-19T05:21:16.889014+0000","last_became_active":"2024-09-19T05:21:11.878410+0000","last_became_peered":"2024-09-19T05:21:11.878410+0000","last_unstale":"2024-09-19T05:21:16.889014+0000","last_undegraded":"2024-09-19T05:21:16.889014+0000","last_fullsized":"2024-09-19T05:21:16.889014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:55.914090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65064,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":159,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874621+0000","last_change":"2024-09-19T05:20:11.784172+0000","last_active":"2024-09-19T05:21:11.874621+0000","last_peered":"2024-09-19T05:21:11.874621+0000","last_clean":"2024-09-19T05:21:11.874621+0000","last_became_active":"2024-09-19T05:20:11.783884+0000","last_became_peered":"2024-09-19T05:20:11.783884+0000","last_unstale":"2024-09-19T05:21:11.874621+0000","last_undegraded":"2024-09-19T05:21:11.874621+0000","last_fullsized":"2024-09-19T05:21:11.874621+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:25.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877656+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:21:11.877656+0000","last_peered":"2024-09-19T05:21:11.877656+0000","last_clean":"2024-09-19T05:21:11.877656+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:21:11.877656+0000","last_undegraded":"2024-09-19T05:21:11.877656+0000","last_fullsized":"2024-09-19T05:21:11.877656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882191+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:21:11.882191+0000","last_peered":"2024-09-19T05:21:11.882191+0000","last_clean":"2024-09-19T05:21:11.882191+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:21:11.882191+0000","last_undegraded":"2024-09-19T05:21:11.882191+0000","last_fullsized":"2024-09-19T05:21:11.882191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872967+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:21:11.872967+0000","last_peered":"2024-09-19T05:21:11.872967+0000","last_clean":"2024-09-19T05:21:11.872967+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:21:11.872967+0000","last_undegraded":"2024-09-19T05:21:11.872967+0000","last_fullsized":"2024-09-19T05:21:11.872967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876431+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:21:11.876431+0000","last_peered":"2024-09-19T05:21:11.876431+0000","last_clean":"2024-09-19T05:21:11.876431+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:21:11.876431+0000","last_undegraded":"2024-09-19T05:21:11.876431+0000","last_fullsized":"2024-09-19T05:21:11.876431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961850+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:21:11.961850+0000","last_peered":"2024-09-19T05:21:11.961850+0000","last_clean":"2024-09-19T05:21:11.961850+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:21:11.961850+0000","last_undegraded":"2024-09-19T05:21:11.961850+0000","last_fullsized":"2024-09-19T05:21:11.961850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871456+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:21:11.871456+0000","last_peered":"2024-09-19T05:21:11.871456+0000","last_clean":"2024-09-19T05:21:11.871456+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:21:11.871456+0000","last_undegraded":"2024-09-19T05:21:11.871456+0000","last_fullsized":"2024-09-19T05:21:11.871456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877801+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:21:11.877801+0000","last_peered":"2024-09-19T05:21:11.877801+0000","last_clean":"2024-09-19T05:21:11.877801+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:21:11.877801+0000","last_undegraded":"2024-09-19T05:21:11.877801+0000","last_fullsized":"2024-09-19T05:21:11.877801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875000+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:21:11.875000+0000","last_peered":"2024-09-19T05:21:11.875000+0000","last_clean":"2024-09-19T05:21:11.875000+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:21:11.875000+0000","last_undegraded":"2024-09-19T05:21:11.875000+0000","last_fullsized":"2024-09-19T05:21:11.875000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961081+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:21:11.961081+0000","last_peered":"2024-09-19T05:21:11.961081+0000","last_clean":"2024-09-19T05:21:11.961081+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:21:11.961081+0000","last_undegraded":"2024-09-19T05:21:11.961081+0000","last_fullsized":"2024-09-19T05:21:11.961081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876134+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:21:11.876134+0000","last_peered":"2024-09-19T05:21:11.876134+0000","last_clean":"2024-09-19T05:21:11.876134+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:21:11.876134+0000","last_undegraded":"2024-09-19T05:21:11.876134+0000","last_fullsized":"2024-09-19T05:21:11.876134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871625+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:21:11.871625+0000","last_peered":"2024-09-19T05:21:11.871625+0000","last_clean":"2024-09-19T05:21:11.871625+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:21:11.871625+0000","last_undegraded":"2024-09-19T05:21:11.871625+0000","last_fullsized":"2024-09-19T05:21:11.871625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.963064+0000","last_change":"2024-09-19T05:21:11.962673+0000","last_active":"2024-09-19T05:21:11.963064+0000","last_peered":"2024-09-19T05:21:11.963064+0000","last_clean":"2024-09-19T05:21:11.963064+0000","last_became_active":"2024-09-19T05:21:11.962407+0000","last_became_peered":"2024-09-19T05:21:11.962407+0000","last_unstale":"2024-09-19T05:21:11.963064+0000","last_undegraded":"2024-09-19T05:21:11.963064+0000","last_fullsized":"2024-09-19T05:21:11.963064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:46.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874571+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:21:11.874571+0000","last_peered":"2024-09-19T05:21:11.874571+0000","last_clean":"2024-09-19T05:21:11.874571+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:21:11.874571+0000","last_undegraded":"2024-09-19T05:21:11.874571+0000","last_fullsized":"2024-09-19T05:21:11.874571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960943+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:21:11.960943+0000","last_peered":"2024-09-19T05:21:11.960943+0000","last_clean":"2024-09-19T05:21:11.960943+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:21:11.960943+0000","last_undegraded":"2024-09-19T05:21:11.960943+0000","last_fullsized":"2024-09-19T05:21:11.960943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961037+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:21:11.961037+0000","last_peered":"2024-09-19T05:21:11.961037+0000","last_clean":"2024-09-19T05:21:11.961037+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:21:11.961037+0000","last_undegraded":"2024-09-19T05:21:11.961037+0000","last_fullsized":"2024-09-19T05:21:11.961037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874818+0000","last_change":"2024-09-19T05:20:12.090144+0000","last_active":"2024-09-19T05:21:11.874818+0000","last_peered":"2024-09-19T05:21:11.874818+0000","last_clean":"2024-09-19T05:21:11.874818+0000","last_became_active":"2024-09-19T05:20:12.089669+0000","last_became_peered":"2024-09-19T05:20:12.089669+0000","last_unstale":"2024-09-19T05:21:11.874818+0000","last_undegraded":"2024-09-19T05:21:11.874818+0000","last_fullsized":"2024-09-19T05:21:11.874818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:39.253036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881603+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:21:11.881603+0000","last_peered":"2024-09-19T05:21:11.881603+0000","last_clean":"2024-09-19T05:21:11.881603+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:21:11.881603+0000","last_undegraded":"2024-09-19T05:21:11.881603+0000","last_fullsized":"2024-09-19T05:21:11.881603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872472+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:21:11.872472+0000","last_peered":"2024-09-19T05:21:11.872472+0000","last_clean":"2024-09-19T05:21:11.872472+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:21:11.872472+0000","last_undegraded":"2024-09-19T05:21:11.872472+0000","last_fullsized":"2024-09-19T05:21:11.872472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881650+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:21:11.881650+0000","last_peered":"2024-09-19T05:21:11.881650+0000","last_clean":"2024-09-19T05:21:11.881650+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:21:11.881650+0000","last_undegraded":"2024-09-19T05:21:11.881650+0000","last_fullsized":"2024-09-19T05:21:11.881650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876402+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:21:11.876402+0000","last_peered":"2024-09-19T05:21:11.876402+0000","last_clean":"2024-09-19T05:21:11.876402+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:21:11.876402+0000","last_undegraded":"2024-09-19T05:21:11.876402+0000","last_fullsized":"2024-09-19T05:21:11.876402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872926+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:21:11.872926+0000","last_peered":"2024-09-19T05:21:11.872926+0000","last_clean":"2024-09-19T05:21:11.872926+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:21:11.872926+0000","last_undegraded":"2024-09-19T05:21:11.872926+0000","last_fullsized":"2024-09-19T05:21:11.872926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874997+0000","last_change":"2024-09-19T05:20:11.693523+0000","last_active":"2024-09-19T05:21:11.874997+0000","last_peered":"2024-09-19T05:21:11.874997+0000","last_clean":"2024-09-19T05:21:11.874997+0000","last_became_active":"2024-09-19T05:20:11.693018+0000","last_became_peered":"2024-09-19T05:20:11.693018+0000","last_unstale":"2024-09-19T05:21:11.874997+0000","last_undegraded":"2024-09-19T05:21:11.874997+0000","last_fullsized":"2024-09-19T05:21:11.874997+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:09.595591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872596+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:21:11.872596+0000","last_peered":"2024-09-19T05:21:11.872596+0000","last_clean":"2024-09-19T05:21:11.872596+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:21:11.872596+0000","last_undegraded":"2024-09-19T05:21:11.872596+0000","last_fullsized":"2024-09-19T05:21:11.872596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872274+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:21:11.872274+0000","last_peered":"2024-09-19T05:21:11.872274+0000","last_clean":"2024-09-19T05:21:11.872274+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:21:11.872274+0000","last_undegraded":"2024-09-19T05:21:11.872274+0000","last_fullsized":"2024-09-19T05:21:11.872274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876155+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:21:11.876155+0000","last_peered":"2024-09-19T05:21:11.876155+0000","last_clean":"2024-09-19T05:21:11.876155+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:21:11.876155+0000","last_undegraded":"2024-09-19T05:21:11.876155+0000","last_fullsized":"2024-09-19T05:21:11.876155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962127+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:21:11.962127+0000","last_peered":"2024-09-19T05:21:11.962127+0000","last_clean":"2024-09-19T05:21:11.962127+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:21:11.962127+0000","last_undegraded":"2024-09-19T05:21:11.962127+0000","last_fullsized":"2024-09-19T05:21:11.962127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874532+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:21:11.874532+0000","last_peered":"2024-09-19T05:21:11.874532+0000","last_clean":"2024-09-19T05:21:11.874532+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:21:11.874532+0000","last_undegraded":"2024-09-19T05:21:11.874532+0000","last_fullsized":"2024-09-19T05:21:11.874532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872918+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:21:11.872918+0000","last_peered":"2024-09-19T05:21:11.872918+0000","last_clean":"2024-09-19T05:21:11.872918+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:21:11.872918+0000","last_undegraded":"2024-09-19T05:21:11.872918+0000","last_fullsized":"2024-09-19T05:21:11.872918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961666+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:21:11.961666+0000","last_peered":"2024-09-19T05:21:11.961666+0000","last_clean":"2024-09-19T05:21:11.961666+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:21:11.961666+0000","last_undegraded":"2024-09-19T05:21:11.961666+0000","last_fullsized":"2024-09-19T05:21:11.961666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881264+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:21:11.881264+0000","last_peered":"2024-09-19T05:21:11.881264+0000","last_clean":"2024-09-19T05:21:11.881264+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:21:11.881264+0000","last_undegraded":"2024-09-19T05:21:11.881264+0000","last_fullsized":"2024-09-19T05:21:11.881264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961256+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:21:11.961256+0000","last_peered":"2024-09-19T05:21:11.961256+0000","last_clean":"2024-09-19T05:21:11.961256+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:21:11.961256+0000","last_undegraded":"2024-09-19T05:21:11.961256+0000","last_fullsized":"2024-09-19T05:21:11.961256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877578+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:21:11.877578+0000","last_peered":"2024-09-19T05:21:11.877578+0000","last_clean":"2024-09-19T05:21:11.877578+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:21:11.877578+0000","last_undegraded":"2024-09-19T05:21:11.877578+0000","last_fullsized":"2024-09-19T05:21:11.877578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961992+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:21:11.961992+0000","last_peered":"2024-09-19T05:21:11.961992+0000","last_clean":"2024-09-19T05:21:11.961992+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:21:11.961992+0000","last_undegraded":"2024-09-19T05:21:11.961992+0000","last_fullsized":"2024-09-19T05:21:11.961992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874395+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:21:11.874395+0000","last_peered":"2024-09-19T05:21:11.874395+0000","last_clean":"2024-09-19T05:21:11.874395+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:21:11.874395+0000","last_undegraded":"2024-09-19T05:21:11.874395+0000","last_fullsized":"2024-09-19T05:21:11.874395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873044+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:21:11.873044+0000","last_peered":"2024-09-19T05:21:11.873044+0000","last_clean":"2024-09-19T05:21:11.873044+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:21:11.873044+0000","last_undegraded":"2024-09-19T05:21:11.873044+0000","last_fullsized":"2024-09-19T05:21:11.873044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872076+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:21:11.872076+0000","last_peered":"2024-09-19T05:21:11.872076+0000","last_clean":"2024-09-19T05:21:11.872076+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:21:11.872076+0000","last_undegraded":"2024-09-19T05:21:11.872076+0000","last_fullsized":"2024-09-19T05:21:11.872076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874788+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:21:11.874788+0000","last_peered":"2024-09-19T05:21:11.874788+0000","last_clean":"2024-09-19T05:21:11.874788+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:21:11.874788+0000","last_undegraded":"2024-09-19T05:21:11.874788+0000","last_fullsized":"2024-09-19T05:21:11.874788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877033+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:21:11.877033+0000","last_peered":"2024-09-19T05:21:11.877033+0000","last_clean":"2024-09-19T05:21:11.877033+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:21:11.877033+0000","last_undegraded":"2024-09-19T05:21:11.877033+0000","last_fullsized":"2024-09-19T05:21:11.877033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875904+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:21:11.875904+0000","last_peered":"2024-09-19T05:21:11.875904+0000","last_clean":"2024-09-19T05:21:11.875904+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:21:11.875904+0000","last_undegraded":"2024-09-19T05:21:11.875904+0000","last_fullsized":"2024-09-19T05:21:11.875904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875926+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:21:11.875926+0000","last_peered":"2024-09-19T05:21:11.875926+0000","last_clean":"2024-09-19T05:21:11.875926+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:21:11.875926+0000","last_undegraded":"2024-09-19T05:21:11.875926+0000","last_fullsized":"2024-09-19T05:21:11.875926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961926+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:21:11.961926+0000","last_peered":"2024-09-19T05:21:11.961926+0000","last_clean":"2024-09-19T05:21:11.961926+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:21:11.961926+0000","last_undegraded":"2024-09-19T05:21:11.961926+0000","last_fullsized":"2024-09-19T05:21:11.961926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872907+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:21:11.872907+0000","last_peered":"2024-09-19T05:21:11.872907+0000","last_clean":"2024-09-19T05:21:11.872907+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:21:11.872907+0000","last_undegraded":"2024-09-19T05:21:11.872907+0000","last_fullsized":"2024-09-19T05:21:11.872907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961843+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:21:11.961843+0000","last_peered":"2024-09-19T05:21:11.961843+0000","last_clean":"2024-09-19T05:21:11.961843+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:21:11.961843+0000","last_undegraded":"2024-09-19T05:21:11.961843+0000","last_fullsized":"2024-09-19T05:21:11.961843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875256+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:21:11.875256+0000","last_peered":"2024-09-19T05:21:11.875256+0000","last_clean":"2024-09-19T05:21:11.875256+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:21:11.875256+0000","last_undegraded":"2024-09-19T05:21:11.875256+0000","last_fullsized":"2024-09-19T05:21:11.875256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877683+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:21:11.877683+0000","last_peered":"2024-09-19T05:21:11.877683+0000","last_clean":"2024-09-19T05:21:11.877683+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:21:11.877683+0000","last_undegraded":"2024-09-19T05:21:11.877683+0000","last_fullsized":"2024-09-19T05:21:11.877683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961130+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:21:11.961130+0000","last_peered":"2024-09-19T05:21:11.961130+0000","last_clean":"2024-09-19T05:21:11.961130+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:21:11.961130+0000","last_undegraded":"2024-09-19T05:21:11.961130+0000","last_fullsized":"2024-09-19T05:21:11.961130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874759+0000","last_change":"2024-09-19T05:20:11.691043+0000","last_active":"2024-09-19T05:21:11.874759+0000","last_peered":"2024-09-19T05:21:11.874759+0000","last_clean":"2024-09-19T05:21:11.874759+0000","last_became_active":"2024-09-19T05:20:11.690672+0000","last_became_peered":"2024-09-19T05:20:11.690672+0000","last_unstale":"2024-09-19T05:21:11.874759+0000","last_undegraded":"2024-09-19T05:21:11.874759+0000","last_fullsized":"2024-09-19T05:21:11.874759+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:01.913488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876447+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:21:11.876447+0000","last_peered":"2024-09-19T05:21:11.876447+0000","last_clean":"2024-09-19T05:21:11.876447+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:21:11.876447+0000","last_undegraded":"2024-09-19T05:21:11.876447+0000","last_fullsized":"2024-09-19T05:21:11.876447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871767+0000","last_change":"2024-09-19T05:20:11.690113+0000","last_active":"2024-09-19T05:21:11.871767+0000","last_peered":"2024-09-19T05:21:11.871767+0000","last_clean":"2024-09-19T05:21:11.871767+0000","last_became_active":"2024-09-19T05:20:11.689729+0000","last_became_peered":"2024-09-19T05:20:11.689729+0000","last_unstale":"2024-09-19T05:21:11.871767+0000","last_undegraded":"2024-09-19T05:21:11.871767+0000","last_fullsized":"2024-09-19T05:21:11.871767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:14.762934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876158+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:21:11.876158+0000","last_peered":"2024-09-19T05:21:11.876158+0000","last_clean":"2024-09-19T05:21:11.876158+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:21:11.876158+0000","last_undegraded":"2024-09-19T05:21:11.876158+0000","last_fullsized":"2024-09-19T05:21:11.876158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876329+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:21:11.876329+0000","last_peered":"2024-09-19T05:21:11.876329+0000","last_clean":"2024-09-19T05:21:11.876329+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:21:11.876329+0000","last_undegraded":"2024-09-19T05:21:11.876329+0000","last_fullsized":"2024-09-19T05:21:11.876329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874720+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:21:11.874720+0000","last_peered":"2024-09-19T05:21:11.874720+0000","last_clean":"2024-09-19T05:21:11.874720+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:21:11.874720+0000","last_undegraded":"2024-09-19T05:21:11.874720+0000","last_fullsized":"2024-09-19T05:21:11.874720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65862,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":165,"num_write":92,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":196970,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547241,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":515152,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1126400,"data_stored":1166682,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906994,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":519830,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135927,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":515756,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364860,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":1110198,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528386,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":511056,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1056768,"data_stored":1105702,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":579930,"data_compressed":39698,"data_compressed_allocated":53248,"data_compressed_original":143360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":511160,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":995328,"data_stored":511090,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":575812,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":511146,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":64778,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:21:20.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T05:21:20.411 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:21:20.672 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:21.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:20 smithi001 ceph-mon[30968]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 569 B/s wr, 2 op/s; 7.0 KiB/s, 0 objects/s recovering 2024-09-19T05:21:21.152 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:20 smithi060 ceph-mon[35058]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 569 B/s wr, 2 op/s; 7.0 KiB/s, 0 objects/s recovering 2024-09-19T05:21:21.159 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:20 smithi082 ceph-mon[35195]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1 KiB/s rd, 569 B/s wr, 2 op/s; 7.0 KiB/s, 0 objects/s recovering 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 -- 172.21.15.1:0/3229902068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 msgr2=0x7f4444100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 --2- 172.21.15.1:0/3229902068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f4444100ef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f442c009930 tx=0x7f442c02a420 comp rx=0 tx=0).stop 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 -- 172.21.15.1:0/3229902068 shutdown_connections 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 --2- 172.21.15.1:0/3229902068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 --2- 172.21.15.1:0/3229902068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f4444100ef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 --2- 172.21.15.1:0/3229902068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4444106a90 0x7f4444106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 -- 172.21.15.1:0/3229902068 >> 172.21.15.1:0/3229902068 conn(0x7f44440fc7d0 msgr2=0x7f44440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 -- 172.21.15.1:0/3229902068 shutdown_connections 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.132+0000 7f4449f83640 1 -- 172.21.15.1:0/3229902068 wait complete. 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 Processor -- start 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 -- start start 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4444106a90 0x7f444419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4444110e90 con 0x7f4444100a90 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4444110d10 con 0x7f4444101430 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f4449f83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4444111010 con 0x7f4444106a90 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f44437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:21.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f44437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59014/0 (socket says 172.21.15.1:59014) 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.133+0000 7f44437fe640 1 -- 172.21.15.1:0/415518544 learned_addr learned my addr 172.21.15.1:0/415518544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f443affd640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 -- 172.21.15.1:0/415518544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4444106a90 msgr2=0x7f444419efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4444106a90 0x7f444419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 -- 172.21.15.1:0/415518544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 msgr2=0x7f444419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 -- 172.21.15.1:0/415518544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444419f6a0 con 0x7f4444100a90 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f443affd640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44437fe640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f443400d770 tx=0x7f443400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434017070 con 0x7f4444100a90 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4434005500 con 0x7f4444100a90 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444419f990 con 0x7f4444100a90 2024-09-19T05:21:21.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434004e00 con 0x7f4444100a90 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.134+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44441a7270 con 0x7f4444100a90 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.135+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4444100ef0 con 0x7f4444100a90 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.136+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4434004fa0 con 0x7f4444100a90 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.137+0000 7f44417fa640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 0x7f44300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.137+0000 7f443affd640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 0x7f44300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.137+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f44340cfbb0 con 0x7f4444100a90 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.138+0000 7f443affd640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 0x7f44300a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:21.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.140+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f443409c540 con 0x7f4444100a90 2024-09-19T05:21:21.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.313+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 --> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f444406ae30 con 0x7f44300a32c0 2024-09-19T05:21:21.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.321+0000 7f44417fa640 1 -- 172.21.15.1:0/415518544 <== mgr.14150 v2:172.21.15.1:6800/427915191 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340679 (secure 0 0 0) 0x7f444406ae30 con 0x7f44300a32c0 2024-09-19T05:21:21.328 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:21.331 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T05:21:21.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 msgr2=0x7f44300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:21.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 0x7f44300a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c00 tx=0x7f442c032c70 comp rx=0 tx=0).stop 2024-09-19T05:21:21.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 msgr2=0x7f444419a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f443400d770 tx=0x7f443400dc30 comp rx=0 tx=0).stop 2024-09-19T05:21:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 shutdown_connections 2024-09-19T05:21:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f44300a32c0 0x7f44300a5780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4444106a90 0x7f444419efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4444101430 0x7f444419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 --2- 172.21.15.1:0/415518544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4444100a90 0x7f444419a6f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 >> 172.21.15.1:0/415518544 conn(0x7f44440fc7d0 msgr2=0x7f444406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 shutdown_connections 2024-09-19T05:21:21.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:21.324+0000 7f4449f83640 1 -- 172.21.15.1:0/415518544 wait complete. 2024-09-19T05:21:21.999 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-19T05:21:19.864877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656464,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":323,"num_read_kb":274,"num_write":277,"num_write_kb":3037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1245492,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":716,"ondisk_log_size":716,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":418,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390472,"kb_used_data":12020,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551352,"statfs":{"total":1151940427776,"available":1151540584448,"internally_reserved":0,"allocated":12308480,"data_stored":8133514,"data_compressed":471319,"data_compressed_allocated":638976,"data_compressed_original":2813952,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":557,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.995610"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871987+0000","last_change":"2024-09-19T05:18:59.691335+0000","last_active":"2024-09-19T05:21:11.871987+0000","last_peered":"2024-09-19T05:21:11.871987+0000","last_clean":"2024-09-19T05:21:11.871987+0000","last_became_active":"2024-09-19T05:18:59.690982+0000","last_became_peered":"2024-09-19T05:18:59.690982+0000","last_unstale":"2024-09-19T05:21:11.871987+0000","last_undegraded":"2024-09-19T05:21:11.871987+0000","last_fullsized":"2024-09-19T05:21:11.871987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:55.076189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961036+0000","last_change":"2024-09-19T05:19:01.944483+0000","last_active":"2024-09-19T05:21:11.961036+0000","last_peered":"2024-09-19T05:21:11.961036+0000","last_clean":"2024-09-19T05:21:11.961036+0000","last_became_active":"2024-09-19T05:19:01.944140+0000","last_became_peered":"2024-09-19T05:19:01.944140+0000","last_unstale":"2024-09-19T05:21:11.961036+0000","last_undegraded":"2024-09-19T05:21:11.961036+0000","last_fullsized":"2024-09-19T05:21:11.961036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:00.225219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872204+0000","last_change":"2024-09-19T05:19:09.020764+0000","last_active":"2024-09-19T05:21:11.872204+0000","last_peered":"2024-09-19T05:21:11.872204+0000","last_clean":"2024-09-19T05:21:11.872204+0000","last_became_active":"2024-09-19T05:19:09.020422+0000","last_became_peered":"2024-09-19T05:19:09.020422+0000","last_unstale":"2024-09-19T05:21:11.872204+0000","last_undegraded":"2024-09-19T05:21:11.872204+0000","last_fullsized":"2024-09-19T05:21:11.872204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:03.899289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961620+0000","last_change":"2024-09-19T05:18:59.742115+0000","last_active":"2024-09-19T05:21:11.961620+0000","last_peered":"2024-09-19T05:21:11.961620+0000","last_clean":"2024-09-19T05:21:11.961620+0000","last_became_active":"2024-09-19T05:18:59.741770+0000","last_became_peered":"2024-09-19T05:18:59.741770+0000","last_unstale":"2024-09-19T05:21:11.961620+0000","last_undegraded":"2024-09-19T05:21:11.961620+0000","last_fullsized":"2024-09-19T05:21:11.961620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:58.197576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876407+0000","last_change":"2024-09-19T05:19:01.945728+0000","last_active":"2024-09-19T05:21:11.876407+0000","last_peered":"2024-09-19T05:21:11.876407+0000","last_clean":"2024-09-19T05:21:11.876407+0000","last_became_active":"2024-09-19T05:19:01.945181+0000","last_became_peered":"2024-09-19T05:19:01.945181+0000","last_unstale":"2024-09-19T05:21:11.876407+0000","last_undegraded":"2024-09-19T05:21:11.876407+0000","last_fullsized":"2024-09-19T05:21:11.876407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:34:17.200909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872339+0000","last_change":"2024-09-19T05:19:09.015844+0000","last_active":"2024-09-19T05:21:11.872339+0000","last_peered":"2024-09-19T05:21:11.872339+0000","last_clean":"2024-09-19T05:21:11.872339+0000","last_became_active":"2024-09-19T05:19:09.015226+0000","last_became_peered":"2024-09-19T05:19:09.015226+0000","last_unstale":"2024-09-19T05:21:11.872339+0000","last_undegraded":"2024-09-19T05:21:11.872339+0000","last_fullsized":"2024-09-19T05:21:11.872339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:00.699335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876719+0000","last_change":"2024-09-19T05:20:12.092062+0000","last_active":"2024-09-19T05:21:11.876719+0000","last_peered":"2024-09-19T05:21:11.876719+0000","last_clean":"2024-09-19T05:21:11.876719+0000","last_became_active":"2024-09-19T05:20:12.088807+0000","last_became_peered":"2024-09-19T05:20:12.088807+0000","last_unstale":"2024-09-19T05:21:11.876719+0000","last_undegraded":"2024-09-19T05:21:11.876719+0000","last_fullsized":"2024-09-19T05:21:11.876719+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:07.201486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877617+0000","last_change":"2024-09-19T05:19:01.951888+0000","last_active":"2024-09-19T05:21:11.877617+0000","last_peered":"2024-09-19T05:21:11.877617+0000","last_clean":"2024-09-19T05:21:11.877617+0000","last_became_active":"2024-09-19T05:19:01.951547+0000","last_became_peered":"2024-09-19T05:19:01.951547+0000","last_unstale":"2024-09-19T05:21:11.877617+0000","last_undegraded":"2024-09-19T05:21:11.877617+0000","last_fullsized":"2024-09-19T05:21:11.877617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:57.174938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872701+0000","last_change":"2024-09-19T05:19:09.016977+0000","last_active":"2024-09-19T05:21:11.872701+0000","last_peered":"2024-09-19T05:21:11.872701+0000","last_clean":"2024-09-19T05:21:11.872701+0000","last_became_active":"2024-09-19T05:19:09.016130+0000","last_became_peered":"2024-09-19T05:19:09.016130+0000","last_unstale":"2024-09-19T05:21:11.872701+0000","last_undegraded":"2024-09-19T05:21:11.872701+0000","last_fullsized":"2024-09-19T05:21:11.872701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:23.192511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876638+0000","last_change":"2024-09-19T05:18:59.694195+0000","last_active":"2024-09-19T05:21:11.876638+0000","last_peered":"2024-09-19T05:21:11.876638+0000","last_clean":"2024-09-19T05:21:11.876638+0000","last_became_active":"2024-09-19T05:18:59.693786+0000","last_became_peered":"2024-09-19T05:18:59.693786+0000","last_unstale":"2024-09-19T05:21:11.876638+0000","last_undegraded":"2024-09-19T05:21:11.876638+0000","last_fullsized":"2024-09-19T05:21:11.876638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:50.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881939+0000","last_change":"2024-09-19T05:19:01.945792+0000","last_active":"2024-09-19T05:21:11.881939+0000","last_peered":"2024-09-19T05:21:11.881939+0000","last_clean":"2024-09-19T05:21:11.881939+0000","last_became_active":"2024-09-19T05:19:01.945371+0000","last_became_peered":"2024-09-19T05:19:01.945371+0000","last_unstale":"2024-09-19T05:21:11.881939+0000","last_undegraded":"2024-09-19T05:21:11.881939+0000","last_fullsized":"2024-09-19T05:21:11.881939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:54.795314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872430+0000","last_change":"2024-09-19T05:19:09.015676+0000","last_active":"2024-09-19T05:21:11.872430+0000","last_peered":"2024-09-19T05:21:11.872430+0000","last_clean":"2024-09-19T05:21:11.872430+0000","last_became_active":"2024-09-19T05:19:09.015265+0000","last_became_peered":"2024-09-19T05:19:09.015265+0000","last_unstale":"2024-09-19T05:21:11.872430+0000","last_undegraded":"2024-09-19T05:21:11.872430+0000","last_fullsized":"2024-09-19T05:21:11.872430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:35.784668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961638+0000","last_change":"2024-09-19T05:19:01.948416+0000","last_active":"2024-09-19T05:21:11.961638+0000","last_peered":"2024-09-19T05:21:11.961638+0000","last_clean":"2024-09-19T05:21:11.961638+0000","last_became_active":"2024-09-19T05:19:01.947968+0000","last_became_peered":"2024-09-19T05:19:01.947968+0000","last_unstale":"2024-09-19T05:21:11.961638+0000","last_undegraded":"2024-09-19T05:21:11.961638+0000","last_fullsized":"2024-09-19T05:21:11.961638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:50.384860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876379+0000","last_change":"2024-09-19T05:18:59.695601+0000","last_active":"2024-09-19T05:21:11.876379+0000","last_peered":"2024-09-19T05:21:11.876379+0000","last_clean":"2024-09-19T05:21:11.876379+0000","last_became_active":"2024-09-19T05:18:59.695255+0000","last_became_peered":"2024-09-19T05:18:59.695255+0000","last_unstale":"2024-09-19T05:21:11.876379+0000","last_undegraded":"2024-09-19T05:21:11.876379+0000","last_fullsized":"2024-09-19T05:21:11.876379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:09.621322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872692+0000","last_change":"2024-09-19T05:19:09.031227+0000","last_active":"2024-09-19T05:21:11.872692+0000","last_peered":"2024-09-19T05:21:11.872692+0000","last_clean":"2024-09-19T05:21:11.872692+0000","last_became_active":"2024-09-19T05:19:09.030681+0000","last_became_peered":"2024-09-19T05:19:09.030681+0000","last_unstale":"2024-09-19T05:21:11.872692+0000","last_undegraded":"2024-09-19T05:21:11.872692+0000","last_fullsized":"2024-09-19T05:21:11.872692+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:12.154525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961345+0000","last_change":"2024-09-19T05:19:01.934440+0000","last_active":"2024-09-19T05:21:11.961345+0000","last_peered":"2024-09-19T05:21:11.961345+0000","last_clean":"2024-09-19T05:21:11.961345+0000","last_became_active":"2024-09-19T05:19:01.934094+0000","last_became_peered":"2024-09-19T05:19:01.934094+0000","last_unstale":"2024-09-19T05:21:11.961345+0000","last_undegraded":"2024-09-19T05:21:11.961345+0000","last_fullsized":"2024-09-19T05:21:11.961345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:37.188120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872319+0000","last_change":"2024-09-19T05:18:59.691713+0000","last_active":"2024-09-19T05:21:11.872319+0000","last_peered":"2024-09-19T05:21:11.872319+0000","last_clean":"2024-09-19T05:21:11.872319+0000","last_became_active":"2024-09-19T05:18:59.691362+0000","last_became_peered":"2024-09-19T05:18:59.691362+0000","last_unstale":"2024-09-19T05:21:11.872319+0000","last_undegraded":"2024-09-19T05:21:11.872319+0000","last_fullsized":"2024-09-19T05:21:11.872319+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:48.090461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872679+0000","last_change":"2024-09-19T05:19:09.013231+0000","last_active":"2024-09-19T05:21:11.872679+0000","last_peered":"2024-09-19T05:21:11.872679+0000","last_clean":"2024-09-19T05:21:11.872679+0000","last_became_active":"2024-09-19T05:19:09.012706+0000","last_became_peered":"2024-09-19T05:19:09.012706+0000","last_unstale":"2024-09-19T05:21:11.872679+0000","last_undegraded":"2024-09-19T05:21:11.872679+0000","last_fullsized":"2024-09-19T05:21:11.872679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:43.261050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875155+0000","last_change":"2024-09-19T05:19:01.942349+0000","last_active":"2024-09-19T05:21:11.875155+0000","last_peered":"2024-09-19T05:21:11.875155+0000","last_clean":"2024-09-19T05:21:11.875155+0000","last_became_active":"2024-09-19T05:19:01.941904+0000","last_became_peered":"2024-09-19T05:19:01.941904+0000","last_unstale":"2024-09-19T05:21:11.875155+0000","last_undegraded":"2024-09-19T05:21:11.875155+0000","last_fullsized":"2024-09-19T05:21:11.875155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:00.348302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:18:59.693460+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:18:59.693147+0000","last_became_peered":"2024-09-19T05:18:59.693147+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:22.237290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876926+0000","last_change":"2024-09-19T05:20:11.784742+0000","last_active":"2024-09-19T05:21:11.876926+0000","last_peered":"2024-09-19T05:21:11.876926+0000","last_clean":"2024-09-19T05:21:11.876926+0000","last_became_active":"2024-09-19T05:20:11.784065+0000","last_became_peered":"2024-09-19T05:20:11.784065+0000","last_unstale":"2024-09-19T05:21:11.876926+0000","last_undegraded":"2024-09-19T05:21:11.876926+0000","last_fullsized":"2024-09-19T05:21:11.876926+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:28.836945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876275+0000","last_change":"2024-09-19T05:19:01.942721+0000","last_active":"2024-09-19T05:21:11.876275+0000","last_peered":"2024-09-19T05:21:11.876275+0000","last_clean":"2024-09-19T05:21:11.876275+0000","last_became_active":"2024-09-19T05:19:01.942322+0000","last_became_peered":"2024-09-19T05:19:01.942322+0000","last_unstale":"2024-09-19T05:21:11.876275+0000","last_undegraded":"2024-09-19T05:21:11.876275+0000","last_fullsized":"2024-09-19T05:21:11.876275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:34.157624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877239+0000","last_change":"2024-09-19T05:18:59.742492+0000","last_active":"2024-09-19T05:21:11.877239+0000","last_peered":"2024-09-19T05:21:11.877239+0000","last_clean":"2024-09-19T05:21:11.877239+0000","last_became_active":"2024-09-19T05:18:59.742184+0000","last_became_peered":"2024-09-19T05:18:59.742184+0000","last_unstale":"2024-09-19T05:21:11.877239+0000","last_undegraded":"2024-09-19T05:21:11.877239+0000","last_fullsized":"2024-09-19T05:21:11.877239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:46.122087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872579+0000","last_change":"2024-09-19T05:19:09.031422+0000","last_active":"2024-09-19T05:21:11.872579+0000","last_peered":"2024-09-19T05:21:11.872579+0000","last_clean":"2024-09-19T05:21:11.872579+0000","last_became_active":"2024-09-19T05:19:09.031028+0000","last_became_peered":"2024-09-19T05:19:09.031028+0000","last_unstale":"2024-09-19T05:21:11.872579+0000","last_undegraded":"2024-09-19T05:21:11.872579+0000","last_fullsized":"2024-09-19T05:21:11.872579+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:20.846849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876349+0000","last_change":"2024-09-19T05:19:01.944599+0000","last_active":"2024-09-19T05:21:11.876349+0000","last_peered":"2024-09-19T05:21:11.876349+0000","last_clean":"2024-09-19T05:21:11.876349+0000","last_became_active":"2024-09-19T05:19:01.944294+0000","last_became_peered":"2024-09-19T05:19:01.944294+0000","last_unstale":"2024-09-19T05:21:11.876349+0000","last_undegraded":"2024-09-19T05:21:11.876349+0000","last_fullsized":"2024-09-19T05:21:11.876349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:13.281517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872923+0000","last_change":"2024-09-19T05:19:00.058662+0000","last_active":"2024-09-19T05:21:11.872923+0000","last_peered":"2024-09-19T05:21:11.872923+0000","last_clean":"2024-09-19T05:21:11.872923+0000","last_became_active":"2024-09-19T05:19:00.058342+0000","last_became_peered":"2024-09-19T05:19:00.058342+0000","last_unstale":"2024-09-19T05:21:11.872923+0000","last_undegraded":"2024-09-19T05:21:11.872923+0000","last_fullsized":"2024-09-19T05:21:11.872923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.737878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872539+0000","last_change":"2024-09-19T05:19:09.009688+0000","last_active":"2024-09-19T05:21:11.872539+0000","last_peered":"2024-09-19T05:21:11.872539+0000","last_clean":"2024-09-19T05:21:11.872539+0000","last_became_active":"2024-09-19T05:19:09.009230+0000","last_became_peered":"2024-09-19T05:19:09.009230+0000","last_unstale":"2024-09-19T05:21:11.872539+0000","last_undegraded":"2024-09-19T05:21:11.872539+0000","last_fullsized":"2024-09-19T05:21:11.872539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.255994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961686+0000","last_change":"2024-09-19T05:19:01.936921+0000","last_active":"2024-09-19T05:21:11.961686+0000","last_peered":"2024-09-19T05:21:11.961686+0000","last_clean":"2024-09-19T05:21:11.961686+0000","last_became_active":"2024-09-19T05:19:01.936533+0000","last_became_peered":"2024-09-19T05:19:01.936533+0000","last_unstale":"2024-09-19T05:21:11.961686+0000","last_undegraded":"2024-09-19T05:21:11.961686+0000","last_fullsized":"2024-09-19T05:21:11.961686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:07.406383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:12.952813+0000","last_change":"2024-09-19T05:18:59.689658+0000","last_active":"2024-09-19T05:21:12.952813+0000","last_peered":"2024-09-19T05:21:12.952813+0000","last_clean":"2024-09-19T05:21:12.952813+0000","last_became_active":"2024-09-19T05:18:59.689346+0000","last_became_peered":"2024-09-19T05:18:59.689346+0000","last_unstale":"2024-09-19T05:21:12.952813+0000","last_undegraded":"2024-09-19T05:21:12.952813+0000","last_fullsized":"2024-09-19T05:21:12.952813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:44.344312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960801+0000","last_change":"2024-09-19T05:19:09.030490+0000","last_active":"2024-09-19T05:21:11.960801+0000","last_peered":"2024-09-19T05:21:11.960801+0000","last_clean":"2024-09-19T05:21:11.960801+0000","last_became_active":"2024-09-19T05:19:09.030088+0000","last_became_peered":"2024-09-19T05:19:09.030088+0000","last_unstale":"2024-09-19T05:21:11.960801+0000","last_undegraded":"2024-09-19T05:21:11.960801+0000","last_fullsized":"2024-09-19T05:21:11.960801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.655055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962226+0000","last_change":"2024-09-19T05:19:01.938603+0000","last_active":"2024-09-19T05:21:11.962226+0000","last_peered":"2024-09-19T05:21:11.962226+0000","last_clean":"2024-09-19T05:21:11.962226+0000","last_became_active":"2024-09-19T05:19:01.938287+0000","last_became_peered":"2024-09-19T05:19:01.938287+0000","last_unstale":"2024-09-19T05:21:11.962226+0000","last_undegraded":"2024-09-19T05:21:11.962226+0000","last_fullsized":"2024-09-19T05:21:11.962226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:19.758072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876828+0000","last_change":"2024-09-19T05:18:59.742963+0000","last_active":"2024-09-19T05:21:11.876828+0000","last_peered":"2024-09-19T05:21:11.876828+0000","last_clean":"2024-09-19T05:21:11.876828+0000","last_became_active":"2024-09-19T05:18:59.742534+0000","last_became_peered":"2024-09-19T05:18:59.742534+0000","last_unstale":"2024-09-19T05:21:11.876828+0000","last_undegraded":"2024-09-19T05:21:11.876828+0000","last_fullsized":"2024-09-19T05:21:11.876828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:23.284858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874241+0000","last_change":"2024-09-19T05:19:09.015458+0000","last_active":"2024-09-19T05:21:11.874241+0000","last_peered":"2024-09-19T05:21:11.874241+0000","last_clean":"2024-09-19T05:21:11.874241+0000","last_became_active":"2024-09-19T05:19:09.015044+0000","last_became_peered":"2024-09-19T05:19:09.015044+0000","last_unstale":"2024-09-19T05:21:11.874241+0000","last_undegraded":"2024-09-19T05:21:11.874241+0000","last_fullsized":"2024-09-19T05:21:11.874241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.703171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874901+0000","last_change":"2024-09-19T05:19:01.931232+0000","last_active":"2024-09-19T05:21:11.874901+0000","last_peered":"2024-09-19T05:21:11.874901+0000","last_clean":"2024-09-19T05:21:11.874901+0000","last_became_active":"2024-09-19T05:19:01.930887+0000","last_became_peered":"2024-09-19T05:19:01.930887+0000","last_unstale":"2024-09-19T05:21:11.874901+0000","last_undegraded":"2024-09-19T05:21:11.874901+0000","last_fullsized":"2024-09-19T05:21:11.874901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:06.883962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871976+0000","last_change":"2024-09-19T05:18:59.742488+0000","last_active":"2024-09-19T05:21:11.871976+0000","last_peered":"2024-09-19T05:21:11.871976+0000","last_clean":"2024-09-19T05:21:11.871976+0000","last_became_active":"2024-09-19T05:18:59.742156+0000","last_became_peered":"2024-09-19T05:18:59.742156+0000","last_unstale":"2024-09-19T05:21:11.871976+0000","last_undegraded":"2024-09-19T05:21:11.871976+0000","last_fullsized":"2024-09-19T05:21:11.871976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:56.447401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876471+0000","last_change":"2024-09-19T05:19:09.031551+0000","last_active":"2024-09-19T05:21:11.876471+0000","last_peered":"2024-09-19T05:21:11.876471+0000","last_clean":"2024-09-19T05:21:11.876471+0000","last_became_active":"2024-09-19T05:19:09.031061+0000","last_became_peered":"2024-09-19T05:19:09.031061+0000","last_unstale":"2024-09-19T05:21:11.876471+0000","last_undegraded":"2024-09-19T05:21:11.876471+0000","last_fullsized":"2024-09-19T05:21:11.876471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:59.958430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874809+0000","last_change":"2024-09-19T05:19:01.943896+0000","last_active":"2024-09-19T05:21:11.874809+0000","last_peered":"2024-09-19T05:21:11.874809+0000","last_clean":"2024-09-19T05:21:11.874809+0000","last_became_active":"2024-09-19T05:19:01.943232+0000","last_became_peered":"2024-09-19T05:19:01.943232+0000","last_unstale":"2024-09-19T05:21:11.874809+0000","last_undegraded":"2024-09-19T05:21:11.874809+0000","last_fullsized":"2024-09-19T05:21:11.874809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:22:13.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961847+0000","last_change":"2024-09-19T05:18:59.694761+0000","last_active":"2024-09-19T05:21:11.961847+0000","last_peered":"2024-09-19T05:21:11.961847+0000","last_clean":"2024-09-19T05:21:11.961847+0000","last_became_active":"2024-09-19T05:18:59.694152+0000","last_became_peered":"2024-09-19T05:18:59.694152+0000","last_unstale":"2024-09-19T05:21:11.961847+0000","last_undegraded":"2024-09-19T05:21:11.961847+0000","last_fullsized":"2024-09-19T05:21:11.961847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.908195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962007+0000","last_change":"2024-09-19T05:19:09.021485+0000","last_active":"2024-09-19T05:21:11.962007+0000","last_peered":"2024-09-19T05:21:11.962007+0000","last_clean":"2024-09-19T05:21:11.962007+0000","last_became_active":"2024-09-19T05:19:09.021122+0000","last_became_peered":"2024-09-19T05:19:09.021122+0000","last_unstale":"2024-09-19T05:21:11.962007+0000","last_undegraded":"2024-09-19T05:21:11.962007+0000","last_fullsized":"2024-09-19T05:21:11.962007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.853025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881265+0000","last_change":"2024-09-19T05:19:01.948119+0000","last_active":"2024-09-19T05:21:11.881265+0000","last_peered":"2024-09-19T05:21:11.881265+0000","last_clean":"2024-09-19T05:21:11.881265+0000","last_became_active":"2024-09-19T05:19:01.947808+0000","last_became_peered":"2024-09-19T05:19:01.947808+0000","last_unstale":"2024-09-19T05:21:11.881265+0000","last_undegraded":"2024-09-19T05:21:11.881265+0000","last_fullsized":"2024-09-19T05:21:11.881265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:29.803548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960945+0000","last_change":"2024-09-19T05:18:59.742015+0000","last_active":"2024-09-19T05:21:11.960945+0000","last_peered":"2024-09-19T05:21:11.960945+0000","last_clean":"2024-09-19T05:21:11.960945+0000","last_became_active":"2024-09-19T05:18:59.741659+0000","last_became_peered":"2024-09-19T05:18:59.741659+0000","last_unstale":"2024-09-19T05:21:11.960945+0000","last_undegraded":"2024-09-19T05:21:11.960945+0000","last_fullsized":"2024-09-19T05:21:11.960945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:01.947004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961781+0000","last_change":"2024-09-19T05:19:09.031116+0000","last_active":"2024-09-19T05:21:11.961781+0000","last_peered":"2024-09-19T05:21:11.961781+0000","last_clean":"2024-09-19T05:21:11.961781+0000","last_became_active":"2024-09-19T05:19:09.030704+0000","last_became_peered":"2024-09-19T05:19:09.030704+0000","last_unstale":"2024-09-19T05:21:11.961781+0000","last_undegraded":"2024-09-19T05:21:11.961781+0000","last_fullsized":"2024-09-19T05:21:11.961781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:44.963822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960799+0000","last_change":"2024-09-19T05:20:11.690531+0000","last_active":"2024-09-19T05:21:11.960799+0000","last_peered":"2024-09-19T05:21:11.960799+0000","last_clean":"2024-09-19T05:21:11.960799+0000","last_became_active":"2024-09-19T05:20:11.690170+0000","last_became_peered":"2024-09-19T05:20:11.690170+0000","last_unstale":"2024-09-19T05:21:11.960799+0000","last_undegraded":"2024-09-19T05:21:11.960799+0000","last_fullsized":"2024-09-19T05:21:11.960799+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:02.432072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961432+0000","last_change":"2024-09-19T05:18:59.694467+0000","last_active":"2024-09-19T05:21:11.961432+0000","last_peered":"2024-09-19T05:21:11.961432+0000","last_clean":"2024-09-19T05:21:11.961432+0000","last_became_active":"2024-09-19T05:18:59.694029+0000","last_became_peered":"2024-09-19T05:18:59.694029+0000","last_unstale":"2024-09-19T05:21:11.961432+0000","last_undegraded":"2024-09-19T05:21:11.961432+0000","last_fullsized":"2024-09-19T05:21:11.961432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:43.532209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876671+0000","last_change":"2024-09-19T05:20:11.691798+0000","last_active":"2024-09-19T05:21:11.876671+0000","last_peered":"2024-09-19T05:21:11.876671+0000","last_clean":"2024-09-19T05:21:11.876671+0000","last_became_active":"2024-09-19T05:20:11.690998+0000","last_became_peered":"2024-09-19T05:20:11.690998+0000","last_unstale":"2024-09-19T05:21:11.876671+0000","last_undegraded":"2024-09-19T05:21:11.876671+0000","last_fullsized":"2024-09-19T05:21:11.876671+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:51.907655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961275+0000","last_change":"2024-09-19T05:19:01.940212+0000","last_active":"2024-09-19T05:21:11.961275+0000","last_peered":"2024-09-19T05:21:11.961275+0000","last_clean":"2024-09-19T05:21:11.961275+0000","last_became_active":"2024-09-19T05:19:01.938683+0000","last_became_peered":"2024-09-19T05:19:01.938683+0000","last_unstale":"2024-09-19T05:21:11.961275+0000","last_undegraded":"2024-09-19T05:21:11.961275+0000","last_fullsized":"2024-09-19T05:21:11.961275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:36.424279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873077+0000","last_change":"2024-09-19T05:18:59.697358+0000","last_active":"2024-09-19T05:21:11.873077+0000","last_peered":"2024-09-19T05:21:11.873077+0000","last_clean":"2024-09-19T05:21:11.873077+0000","last_became_active":"2024-09-19T05:18:59.697006+0000","last_became_peered":"2024-09-19T05:18:59.697006+0000","last_unstale":"2024-09-19T05:21:11.873077+0000","last_undegraded":"2024-09-19T05:21:11.873077+0000","last_fullsized":"2024-09-19T05:21:11.873077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:04.470940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961568+0000","last_change":"2024-09-19T05:17:49.792370+0000","last_active":"2024-09-19T05:21:11.961568+0000","last_peered":"2024-09-19T05:21:11.961568+0000","last_clean":"2024-09-19T05:21:11.961568+0000","last_became_active":"2024-09-19T05:17:49.791911+0000","last_became_peered":"2024-09-19T05:17:49.791911+0000","last_unstale":"2024-09-19T05:21:11.961568+0000","last_undegraded":"2024-09-19T05:21:11.961568+0000","last_fullsized":"2024-09-19T05:21:11.961568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:14:26.575753+0000","last_clean_scrub_stamp":"2024-09-19T05:14:26.575753+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:33.060411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961816+0000","last_change":"2024-09-19T05:19:09.015288+0000","last_active":"2024-09-19T05:21:11.961816+0000","last_peered":"2024-09-19T05:21:11.961816+0000","last_clean":"2024-09-19T05:21:11.961816+0000","last_became_active":"2024-09-19T05:19:09.014905+0000","last_became_peered":"2024-09-19T05:19:09.014905+0000","last_unstale":"2024-09-19T05:21:11.961816+0000","last_undegraded":"2024-09-19T05:21:11.961816+0000","last_fullsized":"2024-09-19T05:21:11.961816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:20.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961976+0000","last_change":"2024-09-19T05:19:01.947610+0000","last_active":"2024-09-19T05:21:11.961976+0000","last_peered":"2024-09-19T05:21:11.961976+0000","last_clean":"2024-09-19T05:21:11.961976+0000","last_became_active":"2024-09-19T05:19:01.947162+0000","last_became_peered":"2024-09-19T05:19:01.947162+0000","last_unstale":"2024-09-19T05:21:11.961976+0000","last_undegraded":"2024-09-19T05:21:11.961976+0000","last_fullsized":"2024-09-19T05:21:11.961976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:11.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872879+0000","last_change":"2024-09-19T05:19:00.058485+0000","last_active":"2024-09-19T05:21:11.872879+0000","last_peered":"2024-09-19T05:21:11.872879+0000","last_clean":"2024-09-19T05:21:11.872879+0000","last_became_active":"2024-09-19T05:19:00.058112+0000","last_became_peered":"2024-09-19T05:19:00.058112+0000","last_unstale":"2024-09-19T05:21:11.872879+0000","last_undegraded":"2024-09-19T05:21:11.872879+0000","last_fullsized":"2024-09-19T05:21:11.872879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:40.407018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877276+0000","last_change":"2024-09-19T05:19:09.011010+0000","last_active":"2024-09-19T05:21:11.877276+0000","last_peered":"2024-09-19T05:21:11.877276+0000","last_clean":"2024-09-19T05:21:11.877276+0000","last_became_active":"2024-09-19T05:19:09.010596+0000","last_became_peered":"2024-09-19T05:19:09.010596+0000","last_unstale":"2024-09-19T05:21:11.877276+0000","last_undegraded":"2024-09-19T05:21:11.877276+0000","last_fullsized":"2024-09-19T05:21:11.877276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:29.872009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961934+0000","last_change":"2024-09-19T05:19:01.938746+0000","last_active":"2024-09-19T05:21:11.961934+0000","last_peered":"2024-09-19T05:21:11.961934+0000","last_clean":"2024-09-19T05:21:11.961934+0000","last_became_active":"2024-09-19T05:19:01.938400+0000","last_became_peered":"2024-09-19T05:19:01.938400+0000","last_unstale":"2024-09-19T05:21:11.961934+0000","last_undegraded":"2024-09-19T05:21:11.961934+0000","last_fullsized":"2024-09-19T05:21:11.961934+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:38.111401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882260+0000","last_change":"2024-09-19T05:18:59.689147+0000","last_active":"2024-09-19T05:21:11.882260+0000","last_peered":"2024-09-19T05:21:11.882260+0000","last_clean":"2024-09-19T05:21:11.882260+0000","last_became_active":"2024-09-19T05:18:59.688265+0000","last_became_peered":"2024-09-19T05:18:59.688265+0000","last_unstale":"2024-09-19T05:21:11.882260+0000","last_undegraded":"2024-09-19T05:21:11.882260+0000","last_fullsized":"2024-09-19T05:21:11.882260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:27.906410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876096+0000","last_change":"2024-09-19T05:19:09.024599+0000","last_active":"2024-09-19T05:21:11.876096+0000","last_peered":"2024-09-19T05:21:11.876096+0000","last_clean":"2024-09-19T05:21:11.876096+0000","last_became_active":"2024-09-19T05:19:09.023389+0000","last_became_peered":"2024-09-19T05:19:09.023389+0000","last_unstale":"2024-09-19T05:21:11.876096+0000","last_undegraded":"2024-09-19T05:21:11.876096+0000","last_fullsized":"2024-09-19T05:21:11.876096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:56.133853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962037+0000","last_change":"2024-09-19T05:19:01.941060+0000","last_active":"2024-09-19T05:21:11.962037+0000","last_peered":"2024-09-19T05:21:11.962037+0000","last_clean":"2024-09-19T05:21:11.962037+0000","last_became_active":"2024-09-19T05:19:01.940688+0000","last_became_peered":"2024-09-19T05:19:01.940688+0000","last_unstale":"2024-09-19T05:21:11.962037+0000","last_undegraded":"2024-09-19T05:21:11.962037+0000","last_fullsized":"2024-09-19T05:21:11.962037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:58:56.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962114+0000","last_change":"2024-09-19T05:18:59.692109+0000","last_active":"2024-09-19T05:21:11.962114+0000","last_peered":"2024-09-19T05:21:11.962114+0000","last_clean":"2024-09-19T05:21:11.962114+0000","last_became_active":"2024-09-19T05:18:59.691795+0000","last_became_peered":"2024-09-19T05:18:59.691795+0000","last_unstale":"2024-09-19T05:21:11.962114+0000","last_undegraded":"2024-09-19T05:21:11.962114+0000","last_fullsized":"2024-09-19T05:21:11.962114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:54.004333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881129+0000","last_change":"2024-09-19T05:19:09.014148+0000","last_active":"2024-09-19T05:21:11.881129+0000","last_peered":"2024-09-19T05:21:11.881129+0000","last_clean":"2024-09-19T05:21:11.881129+0000","last_became_active":"2024-09-19T05:19:09.013486+0000","last_became_peered":"2024-09-19T05:19:09.013486+0000","last_unstale":"2024-09-19T05:21:11.881129+0000","last_undegraded":"2024-09-19T05:21:11.881129+0000","last_fullsized":"2024-09-19T05:21:11.881129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:25.312213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874591+0000","last_change":"2024-09-19T05:19:01.943707+0000","last_active":"2024-09-19T05:21:11.874591+0000","last_peered":"2024-09-19T05:21:11.874591+0000","last_clean":"2024-09-19T05:21:11.874591+0000","last_became_active":"2024-09-19T05:19:01.943443+0000","last_became_peered":"2024-09-19T05:19:01.943443+0000","last_unstale":"2024-09-19T05:21:11.874591+0000","last_undegraded":"2024-09-19T05:21:11.874591+0000","last_fullsized":"2024-09-19T05:21:11.874591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:21:55.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877091+0000","last_change":"2024-09-19T05:18:59.695016+0000","last_active":"2024-09-19T05:21:11.877091+0000","last_peered":"2024-09-19T05:21:11.877091+0000","last_clean":"2024-09-19T05:21:11.877091+0000","last_became_active":"2024-09-19T05:18:59.694663+0000","last_became_peered":"2024-09-19T05:18:59.694663+0000","last_unstale":"2024-09-19T05:21:11.877091+0000","last_undegraded":"2024-09-19T05:21:11.877091+0000","last_fullsized":"2024-09-19T05:21:11.877091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:10.230038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881256+0000","last_change":"2024-09-19T05:19:09.023280+0000","last_active":"2024-09-19T05:21:11.881256+0000","last_peered":"2024-09-19T05:21:11.881256+0000","last_clean":"2024-09-19T05:21:11.881256+0000","last_became_active":"2024-09-19T05:19:09.022981+0000","last_became_peered":"2024-09-19T05:19:09.022981+0000","last_unstale":"2024-09-19T05:21:11.881256+0000","last_undegraded":"2024-09-19T05:21:11.881256+0000","last_fullsized":"2024-09-19T05:21:11.881256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:48.190722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881398+0000","last_change":"2024-09-19T05:19:01.947240+0000","last_active":"2024-09-19T05:21:11.881398+0000","last_peered":"2024-09-19T05:21:11.881398+0000","last_clean":"2024-09-19T05:21:11.881398+0000","last_became_active":"2024-09-19T05:19:01.946893+0000","last_became_peered":"2024-09-19T05:19:01.946893+0000","last_unstale":"2024-09-19T05:21:11.881398+0000","last_undegraded":"2024-09-19T05:21:11.881398+0000","last_fullsized":"2024-09-19T05:21:11.881398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:40.010892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.884270+0000","last_change":"2024-09-19T05:21:11.883795+0000","last_active":"2024-09-19T05:21:11.884270+0000","last_peered":"2024-09-19T05:21:11.884270+0000","last_clean":"2024-09-19T05:21:11.884270+0000","last_became_active":"2024-09-19T05:21:11.877327+0000","last_became_peered":"2024-09-19T05:21:11.877327+0000","last_unstale":"2024-09-19T05:21:11.884270+0000","last_undegraded":"2024-09-19T05:21:11.884270+0000","last_fullsized":"2024-09-19T05:21:11.884270+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:06.283128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962156+0000","last_change":"2024-09-19T05:19:09.010419+0000","last_active":"2024-09-19T05:21:11.962156+0000","last_peered":"2024-09-19T05:21:11.962156+0000","last_clean":"2024-09-19T05:21:11.962156+0000","last_became_active":"2024-09-19T05:19:09.010047+0000","last_became_peered":"2024-09-19T05:19:09.010047+0000","last_unstale":"2024-09-19T05:21:11.962156+0000","last_undegraded":"2024-09-19T05:21:11.962156+0000","last_fullsized":"2024-09-19T05:21:11.962156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:15:29.711721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961337+0000","last_change":"2024-09-19T05:19:01.942653+0000","last_active":"2024-09-19T05:21:11.961337+0000","last_peered":"2024-09-19T05:21:11.961337+0000","last_clean":"2024-09-19T05:21:11.961337+0000","last_became_active":"2024-09-19T05:19:01.941527+0000","last_became_peered":"2024-09-19T05:19:01.941527+0000","last_unstale":"2024-09-19T05:21:11.961337+0000","last_undegraded":"2024-09-19T05:21:11.961337+0000","last_fullsized":"2024-09-19T05:21:11.961337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:32.466712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872599+0000","last_change":"2024-09-19T05:18:59.696804+0000","last_active":"2024-09-19T05:21:11.872599+0000","last_peered":"2024-09-19T05:21:11.872599+0000","last_clean":"2024-09-19T05:21:11.872599+0000","last_became_active":"2024-09-19T05:18:59.696422+0000","last_became_peered":"2024-09-19T05:18:59.696422+0000","last_unstale":"2024-09-19T05:21:11.872599+0000","last_undegraded":"2024-09-19T05:21:11.872599+0000","last_fullsized":"2024-09-19T05:21:11.872599+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:45.655085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876789+0000","last_change":"2024-09-19T05:20:12.087358+0000","last_active":"2024-09-19T05:21:11.876789+0000","last_peered":"2024-09-19T05:21:11.876789+0000","last_clean":"2024-09-19T05:21:11.876789+0000","last_became_active":"2024-09-19T05:20:12.086826+0000","last_became_peered":"2024-09-19T05:20:12.086826+0000","last_unstale":"2024-09-19T05:21:11.876789+0000","last_undegraded":"2024-09-19T05:21:11.876789+0000","last_fullsized":"2024-09-19T05:21:11.876789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:54.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961593+0000","last_change":"2024-09-19T05:19:01.949771+0000","last_active":"2024-09-19T05:21:11.961593+0000","last_peered":"2024-09-19T05:21:11.961593+0000","last_clean":"2024-09-19T05:21:11.961593+0000","last_became_active":"2024-09-19T05:19:01.949415+0000","last_became_peered":"2024-09-19T05:19:01.949415+0000","last_unstale":"2024-09-19T05:21:11.961593+0000","last_undegraded":"2024-09-19T05:21:11.961593+0000","last_fullsized":"2024-09-19T05:21:11.961593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:12.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881551+0000","last_change":"2024-09-19T05:18:59.693696+0000","last_active":"2024-09-19T05:21:11.881551+0000","last_peered":"2024-09-19T05:21:11.881551+0000","last_clean":"2024-09-19T05:21:11.881551+0000","last_became_active":"2024-09-19T05:18:59.693073+0000","last_became_peered":"2024-09-19T05:18:59.693073+0000","last_unstale":"2024-09-19T05:21:11.881551+0000","last_undegraded":"2024-09-19T05:21:11.881551+0000","last_fullsized":"2024-09-19T05:21:11.881551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:42.630053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874232+0000","last_change":"2024-09-19T05:19:09.017817+0000","last_active":"2024-09-19T05:21:11.874232+0000","last_peered":"2024-09-19T05:21:11.874232+0000","last_clean":"2024-09-19T05:21:11.874232+0000","last_became_active":"2024-09-19T05:19:09.017476+0000","last_became_peered":"2024-09-19T05:19:09.017476+0000","last_unstale":"2024-09-19T05:21:11.874232+0000","last_undegraded":"2024-09-19T05:21:11.874232+0000","last_fullsized":"2024-09-19T05:21:11.874232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.916811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962162+0000","last_change":"2024-09-19T05:19:01.941983+0000","last_active":"2024-09-19T05:21:11.962162+0000","last_peered":"2024-09-19T05:21:11.962162+0000","last_clean":"2024-09-19T05:21:11.962162+0000","last_became_active":"2024-09-19T05:19:01.941610+0000","last_became_peered":"2024-09-19T05:19:01.941610+0000","last_unstale":"2024-09-19T05:21:11.962162+0000","last_undegraded":"2024-09-19T05:21:11.962162+0000","last_fullsized":"2024-09-19T05:21:11.962162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:37.647689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872592+0000","last_change":"2024-09-19T05:18:59.693885+0000","last_active":"2024-09-19T05:21:11.872592+0000","last_peered":"2024-09-19T05:21:11.872592+0000","last_clean":"2024-09-19T05:21:11.872592+0000","last_became_active":"2024-09-19T05:18:59.693521+0000","last_became_peered":"2024-09-19T05:18:59.693521+0000","last_unstale":"2024-09-19T05:21:11.872592+0000","last_undegraded":"2024-09-19T05:21:11.872592+0000","last_fullsized":"2024-09-19T05:21:11.872592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.429420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881828+0000","last_change":"2024-09-19T05:19:09.015360+0000","last_active":"2024-09-19T05:21:11.881828+0000","last_peered":"2024-09-19T05:21:11.881828+0000","last_clean":"2024-09-19T05:21:11.881828+0000","last_became_active":"2024-09-19T05:19:09.014953+0000","last_became_peered":"2024-09-19T05:19:09.014953+0000","last_unstale":"2024-09-19T05:21:11.881828+0000","last_undegraded":"2024-09-19T05:21:11.881828+0000","last_fullsized":"2024-09-19T05:21:11.881828+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:05.757301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876667+0000","last_change":"2024-09-19T05:19:01.943017+0000","last_active":"2024-09-19T05:21:11.876667+0000","last_peered":"2024-09-19T05:21:11.876667+0000","last_clean":"2024-09-19T05:21:11.876667+0000","last_became_active":"2024-09-19T05:19:01.942628+0000","last_became_peered":"2024-09-19T05:19:01.942628+0000","last_unstale":"2024-09-19T05:21:11.876667+0000","last_undegraded":"2024-09-19T05:21:11.876667+0000","last_fullsized":"2024-09-19T05:21:11.876667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:55.707176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":282,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:16.889014+0000","last_change":"2024-09-19T05:21:11.884150+0000","last_active":"2024-09-19T05:21:16.889014+0000","last_peered":"2024-09-19T05:21:16.889014+0000","last_clean":"2024-09-19T05:21:16.889014+0000","last_became_active":"2024-09-19T05:21:11.878410+0000","last_became_peered":"2024-09-19T05:21:11.878410+0000","last_unstale":"2024-09-19T05:21:16.889014+0000","last_undegraded":"2024-09-19T05:21:16.889014+0000","last_fullsized":"2024-09-19T05:21:16.889014+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:55.914090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65064,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":159,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874621+0000","last_change":"2024-09-19T05:20:11.784172+0000","last_active":"2024-09-19T05:21:11.874621+0000","last_peered":"2024-09-19T05:21:11.874621+0000","last_clean":"2024-09-19T05:21:11.874621+0000","last_became_active":"2024-09-19T05:20:11.783884+0000","last_became_peered":"2024-09-19T05:20:11.783884+0000","last_unstale":"2024-09-19T05:21:11.874621+0000","last_undegraded":"2024-09-19T05:21:11.874621+0000","last_fullsized":"2024-09-19T05:21:11.874621+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:25.748191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877656+0000","last_change":"2024-09-19T05:19:01.945650+0000","last_active":"2024-09-19T05:21:11.877656+0000","last_peered":"2024-09-19T05:21:11.877656+0000","last_clean":"2024-09-19T05:21:11.877656+0000","last_became_active":"2024-09-19T05:19:01.945245+0000","last_became_peered":"2024-09-19T05:19:01.945245+0000","last_unstale":"2024-09-19T05:21:11.877656+0000","last_undegraded":"2024-09-19T05:21:11.877656+0000","last_fullsized":"2024-09-19T05:21:11.877656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:06.499781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.882191+0000","last_change":"2024-09-19T05:18:59.742724+0000","last_active":"2024-09-19T05:21:11.882191+0000","last_peered":"2024-09-19T05:21:11.882191+0000","last_clean":"2024-09-19T05:21:11.882191+0000","last_became_active":"2024-09-19T05:18:59.742361+0000","last_became_peered":"2024-09-19T05:18:59.742361+0000","last_unstale":"2024-09-19T05:21:11.882191+0000","last_undegraded":"2024-09-19T05:21:11.882191+0000","last_fullsized":"2024-09-19T05:21:11.882191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:56.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872967+0000","last_change":"2024-09-19T05:19:09.013345+0000","last_active":"2024-09-19T05:21:11.872967+0000","last_peered":"2024-09-19T05:21:11.872967+0000","last_clean":"2024-09-19T05:21:11.872967+0000","last_became_active":"2024-09-19T05:19:09.012869+0000","last_became_peered":"2024-09-19T05:19:09.012869+0000","last_unstale":"2024-09-19T05:21:11.872967+0000","last_undegraded":"2024-09-19T05:21:11.872967+0000","last_fullsized":"2024-09-19T05:21:11.872967+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:52:38.385664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876431+0000","last_change":"2024-09-19T05:19:01.943091+0000","last_active":"2024-09-19T05:21:11.876431+0000","last_peered":"2024-09-19T05:21:11.876431+0000","last_clean":"2024-09-19T05:21:11.876431+0000","last_became_active":"2024-09-19T05:19:01.942775+0000","last_became_peered":"2024-09-19T05:19:01.942775+0000","last_unstale":"2024-09-19T05:21:11.876431+0000","last_undegraded":"2024-09-19T05:21:11.876431+0000","last_fullsized":"2024-09-19T05:21:11.876431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:49.445564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961850+0000","last_change":"2024-09-19T05:18:59.698183+0000","last_active":"2024-09-19T05:21:11.961850+0000","last_peered":"2024-09-19T05:21:11.961850+0000","last_clean":"2024-09-19T05:21:11.961850+0000","last_became_active":"2024-09-19T05:18:59.697834+0000","last_became_peered":"2024-09-19T05:18:59.697834+0000","last_unstale":"2024-09-19T05:21:11.961850+0000","last_undegraded":"2024-09-19T05:21:11.961850+0000","last_fullsized":"2024-09-19T05:21:11.961850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:24.504466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871456+0000","last_change":"2024-09-19T05:19:09.024792+0000","last_active":"2024-09-19T05:21:11.871456+0000","last_peered":"2024-09-19T05:21:11.871456+0000","last_clean":"2024-09-19T05:21:11.871456+0000","last_became_active":"2024-09-19T05:19:09.024209+0000","last_became_peered":"2024-09-19T05:19:09.024209+0000","last_unstale":"2024-09-19T05:21:11.871456+0000","last_undegraded":"2024-09-19T05:21:11.871456+0000","last_fullsized":"2024-09-19T05:21:11.871456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:35.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877801+0000","last_change":"2024-09-19T05:19:01.952144+0000","last_active":"2024-09-19T05:21:11.877801+0000","last_peered":"2024-09-19T05:21:11.877801+0000","last_clean":"2024-09-19T05:21:11.877801+0000","last_became_active":"2024-09-19T05:19:01.951356+0000","last_became_peered":"2024-09-19T05:19:01.951356+0000","last_unstale":"2024-09-19T05:21:11.877801+0000","last_undegraded":"2024-09-19T05:21:11.877801+0000","last_fullsized":"2024-09-19T05:21:11.877801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:02.644686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875000+0000","last_change":"2024-09-19T05:18:59.694535+0000","last_active":"2024-09-19T05:21:11.875000+0000","last_peered":"2024-09-19T05:21:11.875000+0000","last_clean":"2024-09-19T05:21:11.875000+0000","last_became_active":"2024-09-19T05:18:59.694192+0000","last_became_peered":"2024-09-19T05:18:59.694192+0000","last_unstale":"2024-09-19T05:21:11.875000+0000","last_undegraded":"2024-09-19T05:21:11.875000+0000","last_fullsized":"2024-09-19T05:21:11.875000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:34:12.148981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961081+0000","last_change":"2024-09-19T05:19:09.018753+0000","last_active":"2024-09-19T05:21:11.961081+0000","last_peered":"2024-09-19T05:21:11.961081+0000","last_clean":"2024-09-19T05:21:11.961081+0000","last_became_active":"2024-09-19T05:19:09.018400+0000","last_became_peered":"2024-09-19T05:19:09.018400+0000","last_unstale":"2024-09-19T05:21:11.961081+0000","last_undegraded":"2024-09-19T05:21:11.961081+0000","last_fullsized":"2024-09-19T05:21:11.961081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:46.956714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876134+0000","last_change":"2024-09-19T05:19:09.021119+0000","last_active":"2024-09-19T05:21:11.876134+0000","last_peered":"2024-09-19T05:21:11.876134+0000","last_clean":"2024-09-19T05:21:11.876134+0000","last_became_active":"2024-09-19T05:19:09.020374+0000","last_became_peered":"2024-09-19T05:19:09.020374+0000","last_unstale":"2024-09-19T05:21:11.876134+0000","last_undegraded":"2024-09-19T05:21:11.876134+0000","last_fullsized":"2024-09-19T05:21:11.876134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:45.358549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871625+0000","last_change":"2024-09-19T05:19:01.937370+0000","last_active":"2024-09-19T05:21:11.871625+0000","last_peered":"2024-09-19T05:21:11.871625+0000","last_clean":"2024-09-19T05:21:11.871625+0000","last_became_active":"2024-09-19T05:19:01.937057+0000","last_became_peered":"2024-09-19T05:19:01.937057+0000","last_unstale":"2024-09-19T05:21:11.871625+0000","last_undegraded":"2024-09-19T05:21:11.871625+0000","last_fullsized":"2024-09-19T05:21:11.871625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:42.423171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.963064+0000","last_change":"2024-09-19T05:21:11.962673+0000","last_active":"2024-09-19T05:21:11.963064+0000","last_peered":"2024-09-19T05:21:11.963064+0000","last_clean":"2024-09-19T05:21:11.963064+0000","last_became_active":"2024-09-19T05:21:11.962407+0000","last_became_peered":"2024-09-19T05:21:11.962407+0000","last_unstale":"2024-09-19T05:21:11.963064+0000","last_undegraded":"2024-09-19T05:21:11.963064+0000","last_fullsized":"2024-09-19T05:21:11.963064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:46.528381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874571+0000","last_change":"2024-09-19T05:19:09.024136+0000","last_active":"2024-09-19T05:21:11.874571+0000","last_peered":"2024-09-19T05:21:11.874571+0000","last_clean":"2024-09-19T05:21:11.874571+0000","last_became_active":"2024-09-19T05:19:09.023822+0000","last_became_peered":"2024-09-19T05:19:09.023822+0000","last_unstale":"2024-09-19T05:21:11.874571+0000","last_undegraded":"2024-09-19T05:21:11.874571+0000","last_fullsized":"2024-09-19T05:21:11.874571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:24.168766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.960943+0000","last_change":"2024-09-19T05:19:01.936164+0000","last_active":"2024-09-19T05:21:11.960943+0000","last_peered":"2024-09-19T05:21:11.960943+0000","last_clean":"2024-09-19T05:21:11.960943+0000","last_became_active":"2024-09-19T05:19:01.935847+0000","last_became_peered":"2024-09-19T05:19:01.935847+0000","last_unstale":"2024-09-19T05:21:11.960943+0000","last_undegraded":"2024-09-19T05:21:11.960943+0000","last_fullsized":"2024-09-19T05:21:11.960943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:27:30.784232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961037+0000","last_change":"2024-09-19T05:18:59.689823+0000","last_active":"2024-09-19T05:21:11.961037+0000","last_peered":"2024-09-19T05:21:11.961037+0000","last_clean":"2024-09-19T05:21:11.961037+0000","last_became_active":"2024-09-19T05:18:59.689242+0000","last_became_peered":"2024-09-19T05:18:59.689242+0000","last_unstale":"2024-09-19T05:21:11.961037+0000","last_undegraded":"2024-09-19T05:21:11.961037+0000","last_fullsized":"2024-09-19T05:21:11.961037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:22.469300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874818+0000","last_change":"2024-09-19T05:20:12.090144+0000","last_active":"2024-09-19T05:21:11.874818+0000","last_peered":"2024-09-19T05:21:11.874818+0000","last_clean":"2024-09-19T05:21:11.874818+0000","last_became_active":"2024-09-19T05:20:12.089669+0000","last_became_peered":"2024-09-19T05:20:12.089669+0000","last_unstale":"2024-09-19T05:21:11.874818+0000","last_undegraded":"2024-09-19T05:21:11.874818+0000","last_fullsized":"2024-09-19T05:21:11.874818+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:39.253036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881603+0000","last_change":"2024-09-19T05:19:01.946394+0000","last_active":"2024-09-19T05:21:11.881603+0000","last_peered":"2024-09-19T05:21:11.881603+0000","last_clean":"2024-09-19T05:21:11.881603+0000","last_became_active":"2024-09-19T05:19:01.946086+0000","last_became_peered":"2024-09-19T05:19:01.946086+0000","last_unstale":"2024-09-19T05:21:11.881603+0000","last_undegraded":"2024-09-19T05:21:11.881603+0000","last_fullsized":"2024-09-19T05:21:11.881603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:50.372666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872472+0000","last_change":"2024-09-19T05:19:09.014564+0000","last_active":"2024-09-19T05:21:11.872472+0000","last_peered":"2024-09-19T05:21:11.872472+0000","last_clean":"2024-09-19T05:21:11.872472+0000","last_became_active":"2024-09-19T05:19:09.014077+0000","last_became_peered":"2024-09-19T05:19:09.014077+0000","last_unstale":"2024-09-19T05:21:11.872472+0000","last_undegraded":"2024-09-19T05:21:11.872472+0000","last_fullsized":"2024-09-19T05:21:11.872472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:58.171414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881650+0000","last_change":"2024-09-19T05:18:59.693929+0000","last_active":"2024-09-19T05:21:11.881650+0000","last_peered":"2024-09-19T05:21:11.881650+0000","last_clean":"2024-09-19T05:21:11.881650+0000","last_became_active":"2024-09-19T05:18:59.693120+0000","last_became_peered":"2024-09-19T05:18:59.693120+0000","last_unstale":"2024-09-19T05:21:11.881650+0000","last_undegraded":"2024-09-19T05:21:11.881650+0000","last_fullsized":"2024-09-19T05:21:11.881650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:18:58.677383+0000","last_clean_scrub_stamp":"2024-09-19T05:18:58.677383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.642445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876402+0000","last_change":"2024-09-19T05:19:01.939573+0000","last_active":"2024-09-19T05:21:11.876402+0000","last_peered":"2024-09-19T05:21:11.876402+0000","last_clean":"2024-09-19T05:21:11.876402+0000","last_became_active":"2024-09-19T05:19:01.939251+0000","last_became_peered":"2024-09-19T05:19:01.939251+0000","last_unstale":"2024-09-19T05:21:11.876402+0000","last_undegraded":"2024-09-19T05:21:11.876402+0000","last_fullsized":"2024-09-19T05:21:11.876402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:21.422687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872926+0000","last_change":"2024-09-19T05:19:09.014680+0000","last_active":"2024-09-19T05:21:11.872926+0000","last_peered":"2024-09-19T05:21:11.872926+0000","last_clean":"2024-09-19T05:21:11.872926+0000","last_became_active":"2024-09-19T05:19:09.013892+0000","last_became_peered":"2024-09-19T05:19:09.013892+0000","last_unstale":"2024-09-19T05:21:11.872926+0000","last_undegraded":"2024-09-19T05:21:11.872926+0000","last_fullsized":"2024-09-19T05:21:11.872926+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:07.991007+0000","last_clean_scrub_stamp":"2024-09-19T05:19:07.991007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:36.472655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874997+0000","last_change":"2024-09-19T05:20:11.693523+0000","last_active":"2024-09-19T05:21:11.874997+0000","last_peered":"2024-09-19T05:21:11.874997+0000","last_clean":"2024-09-19T05:21:11.874997+0000","last_became_active":"2024-09-19T05:20:11.693018+0000","last_became_peered":"2024-09-19T05:20:11.693018+0000","last_unstale":"2024-09-19T05:21:11.874997+0000","last_undegraded":"2024-09-19T05:21:11.874997+0000","last_fullsized":"2024-09-19T05:21:11.874997+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:09.595591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872596+0000","last_change":"2024-09-19T05:19:01.944465+0000","last_active":"2024-09-19T05:21:11.872596+0000","last_peered":"2024-09-19T05:21:11.872596+0000","last_clean":"2024-09-19T05:21:11.872596+0000","last_became_active":"2024-09-19T05:19:01.944145+0000","last_became_peered":"2024-09-19T05:19:01.944145+0000","last_unstale":"2024-09-19T05:21:11.872596+0000","last_undegraded":"2024-09-19T05:21:11.872596+0000","last_fullsized":"2024-09-19T05:21:11.872596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:36.171054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872274+0000","last_change":"2024-09-19T05:19:01.938974+0000","last_active":"2024-09-19T05:21:11.872274+0000","last_peered":"2024-09-19T05:21:11.872274+0000","last_clean":"2024-09-19T05:21:11.872274+0000","last_became_active":"2024-09-19T05:19:01.937897+0000","last_became_peered":"2024-09-19T05:19:01.937897+0000","last_unstale":"2024-09-19T05:21:11.872274+0000","last_undegraded":"2024-09-19T05:21:11.872274+0000","last_fullsized":"2024-09-19T05:21:11.872274+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:57.446804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876155+0000","last_change":"2024-09-19T05:19:01.943991+0000","last_active":"2024-09-19T05:21:11.876155+0000","last_peered":"2024-09-19T05:21:11.876155+0000","last_clean":"2024-09-19T05:21:11.876155+0000","last_became_active":"2024-09-19T05:19:01.943682+0000","last_became_peered":"2024-09-19T05:19:01.943682+0000","last_unstale":"2024-09-19T05:21:11.876155+0000","last_undegraded":"2024-09-19T05:21:11.876155+0000","last_fullsized":"2024-09-19T05:21:11.876155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:34.492279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.962127+0000","last_change":"2024-09-19T05:19:01.943162+0000","last_active":"2024-09-19T05:21:11.962127+0000","last_peered":"2024-09-19T05:21:11.962127+0000","last_clean":"2024-09-19T05:21:11.962127+0000","last_became_active":"2024-09-19T05:19:01.942863+0000","last_became_peered":"2024-09-19T05:19:01.942863+0000","last_unstale":"2024-09-19T05:21:11.962127+0000","last_undegraded":"2024-09-19T05:21:11.962127+0000","last_fullsized":"2024-09-19T05:21:11.962127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:03.524099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874532+0000","last_change":"2024-09-19T05:19:01.940070+0000","last_active":"2024-09-19T05:21:11.874532+0000","last_peered":"2024-09-19T05:21:11.874532+0000","last_clean":"2024-09-19T05:21:11.874532+0000","last_became_active":"2024-09-19T05:19:01.939756+0000","last_became_peered":"2024-09-19T05:19:01.939756+0000","last_unstale":"2024-09-19T05:21:11.874532+0000","last_undegraded":"2024-09-19T05:21:11.874532+0000","last_fullsized":"2024-09-19T05:21:11.874532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:26.409843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872918+0000","last_change":"2024-09-19T05:19:01.942026+0000","last_active":"2024-09-19T05:21:11.872918+0000","last_peered":"2024-09-19T05:21:11.872918+0000","last_clean":"2024-09-19T05:21:11.872918+0000","last_became_active":"2024-09-19T05:19:01.941474+0000","last_became_peered":"2024-09-19T05:19:01.941474+0000","last_unstale":"2024-09-19T05:21:11.872918+0000","last_undegraded":"2024-09-19T05:21:11.872918+0000","last_fullsized":"2024-09-19T05:21:11.872918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:01.238866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961666+0000","last_change":"2024-09-19T05:19:01.944694+0000","last_active":"2024-09-19T05:21:11.961666+0000","last_peered":"2024-09-19T05:21:11.961666+0000","last_clean":"2024-09-19T05:21:11.961666+0000","last_became_active":"2024-09-19T05:19:01.944340+0000","last_became_peered":"2024-09-19T05:19:01.944340+0000","last_unstale":"2024-09-19T05:21:11.961666+0000","last_undegraded":"2024-09-19T05:21:11.961666+0000","last_fullsized":"2024-09-19T05:21:11.961666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:30.411573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.881264+0000","last_change":"2024-09-19T05:19:01.934013+0000","last_active":"2024-09-19T05:21:11.881264+0000","last_peered":"2024-09-19T05:21:11.881264+0000","last_clean":"2024-09-19T05:21:11.881264+0000","last_became_active":"2024-09-19T05:19:01.933669+0000","last_became_peered":"2024-09-19T05:19:01.933669+0000","last_unstale":"2024-09-19T05:21:11.881264+0000","last_undegraded":"2024-09-19T05:21:11.881264+0000","last_fullsized":"2024-09-19T05:21:11.881264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:09:59.664913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961256+0000","last_change":"2024-09-19T05:19:01.941920+0000","last_active":"2024-09-19T05:21:11.961256+0000","last_peered":"2024-09-19T05:21:11.961256+0000","last_clean":"2024-09-19T05:21:11.961256+0000","last_became_active":"2024-09-19T05:19:01.941571+0000","last_became_peered":"2024-09-19T05:19:01.941571+0000","last_unstale":"2024-09-19T05:21:11.961256+0000","last_undegraded":"2024-09-19T05:21:11.961256+0000","last_fullsized":"2024-09-19T05:21:11.961256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.636145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877578+0000","last_change":"2024-09-19T05:19:01.951584+0000","last_active":"2024-09-19T05:21:11.877578+0000","last_peered":"2024-09-19T05:21:11.877578+0000","last_clean":"2024-09-19T05:21:11.877578+0000","last_became_active":"2024-09-19T05:19:01.950990+0000","last_became_peered":"2024-09-19T05:19:01.950990+0000","last_unstale":"2024-09-19T05:21:11.877578+0000","last_undegraded":"2024-09-19T05:21:11.877578+0000","last_fullsized":"2024-09-19T05:21:11.877578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:31.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961992+0000","last_change":"2024-09-19T05:19:01.941677+0000","last_active":"2024-09-19T05:21:11.961992+0000","last_peered":"2024-09-19T05:21:11.961992+0000","last_clean":"2024-09-19T05:21:11.961992+0000","last_became_active":"2024-09-19T05:19:01.941321+0000","last_became_peered":"2024-09-19T05:19:01.941321+0000","last_unstale":"2024-09-19T05:21:11.961992+0000","last_undegraded":"2024-09-19T05:21:11.961992+0000","last_fullsized":"2024-09-19T05:21:11.961992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.822509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874395+0000","last_change":"2024-09-19T05:19:01.945948+0000","last_active":"2024-09-19T05:21:11.874395+0000","last_peered":"2024-09-19T05:21:11.874395+0000","last_clean":"2024-09-19T05:21:11.874395+0000","last_became_active":"2024-09-19T05:19:01.945113+0000","last_became_peered":"2024-09-19T05:19:01.945113+0000","last_unstale":"2024-09-19T05:21:11.874395+0000","last_undegraded":"2024-09-19T05:21:11.874395+0000","last_fullsized":"2024-09-19T05:21:11.874395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:24.157819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.873044+0000","last_change":"2024-09-19T05:19:01.939293+0000","last_active":"2024-09-19T05:21:11.873044+0000","last_peered":"2024-09-19T05:21:11.873044+0000","last_clean":"2024-09-19T05:21:11.873044+0000","last_became_active":"2024-09-19T05:19:01.938940+0000","last_became_peered":"2024-09-19T05:19:01.938940+0000","last_unstale":"2024-09-19T05:21:11.873044+0000","last_undegraded":"2024-09-19T05:21:11.873044+0000","last_fullsized":"2024-09-19T05:21:11.873044+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:29:16.045166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872076+0000","last_change":"2024-09-19T05:19:01.939113+0000","last_active":"2024-09-19T05:21:11.872076+0000","last_peered":"2024-09-19T05:21:11.872076+0000","last_clean":"2024-09-19T05:21:11.872076+0000","last_became_active":"2024-09-19T05:19:01.938801+0000","last_became_peered":"2024-09-19T05:19:01.938801+0000","last_unstale":"2024-09-19T05:21:11.872076+0000","last_undegraded":"2024-09-19T05:21:11.872076+0000","last_fullsized":"2024-09-19T05:21:11.872076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:51.138754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874788+0000","last_change":"2024-09-19T05:19:01.947452+0000","last_active":"2024-09-19T05:21:11.874788+0000","last_peered":"2024-09-19T05:21:11.874788+0000","last_clean":"2024-09-19T05:21:11.874788+0000","last_became_active":"2024-09-19T05:19:01.946509+0000","last_became_peered":"2024-09-19T05:19:01.946509+0000","last_unstale":"2024-09-19T05:21:11.874788+0000","last_undegraded":"2024-09-19T05:21:11.874788+0000","last_fullsized":"2024-09-19T05:21:11.874788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:14.871726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877033+0000","last_change":"2024-09-19T05:19:01.951255+0000","last_active":"2024-09-19T05:21:11.877033+0000","last_peered":"2024-09-19T05:21:11.877033+0000","last_clean":"2024-09-19T05:21:11.877033+0000","last_became_active":"2024-09-19T05:19:01.950427+0000","last_became_peered":"2024-09-19T05:19:01.950427+0000","last_unstale":"2024-09-19T05:21:11.877033+0000","last_undegraded":"2024-09-19T05:21:11.877033+0000","last_fullsized":"2024-09-19T05:21:11.877033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:19:26.882503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875904+0000","last_change":"2024-09-19T05:19:01.944468+0000","last_active":"2024-09-19T05:21:11.875904+0000","last_peered":"2024-09-19T05:21:11.875904+0000","last_clean":"2024-09-19T05:21:11.875904+0000","last_became_active":"2024-09-19T05:19:01.943798+0000","last_became_peered":"2024-09-19T05:19:01.943798+0000","last_unstale":"2024-09-19T05:21:11.875904+0000","last_undegraded":"2024-09-19T05:21:11.875904+0000","last_fullsized":"2024-09-19T05:21:11.875904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:04.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875926+0000","last_change":"2024-09-19T05:19:01.942244+0000","last_active":"2024-09-19T05:21:11.875926+0000","last_peered":"2024-09-19T05:21:11.875926+0000","last_clean":"2024-09-19T05:21:11.875926+0000","last_became_active":"2024-09-19T05:19:01.941935+0000","last_became_peered":"2024-09-19T05:19:01.941935+0000","last_unstale":"2024-09-19T05:21:11.875926+0000","last_undegraded":"2024-09-19T05:21:11.875926+0000","last_fullsized":"2024-09-19T05:21:11.875926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:02.310123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961926+0000","last_change":"2024-09-19T05:19:01.938340+0000","last_active":"2024-09-19T05:21:11.961926+0000","last_peered":"2024-09-19T05:21:11.961926+0000","last_clean":"2024-09-19T05:21:11.961926+0000","last_became_active":"2024-09-19T05:19:01.938027+0000","last_became_peered":"2024-09-19T05:19:01.938027+0000","last_unstale":"2024-09-19T05:21:11.961926+0000","last_undegraded":"2024-09-19T05:21:11.961926+0000","last_fullsized":"2024-09-19T05:21:11.961926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.579828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.872907+0000","last_change":"2024-09-19T05:19:01.943363+0000","last_active":"2024-09-19T05:21:11.872907+0000","last_peered":"2024-09-19T05:21:11.872907+0000","last_clean":"2024-09-19T05:21:11.872907+0000","last_became_active":"2024-09-19T05:19:01.943043+0000","last_became_peered":"2024-09-19T05:19:01.943043+0000","last_unstale":"2024-09-19T05:21:11.872907+0000","last_undegraded":"2024-09-19T05:21:11.872907+0000","last_fullsized":"2024-09-19T05:21:11.872907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:52:19.718252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961843+0000","last_change":"2024-09-19T05:19:01.948105+0000","last_active":"2024-09-19T05:21:11.961843+0000","last_peered":"2024-09-19T05:21:11.961843+0000","last_clean":"2024-09-19T05:21:11.961843+0000","last_became_active":"2024-09-19T05:19:01.947595+0000","last_became_peered":"2024-09-19T05:19:01.947595+0000","last_unstale":"2024-09-19T05:21:11.961843+0000","last_undegraded":"2024-09-19T05:21:11.961843+0000","last_fullsized":"2024-09-19T05:21:11.961843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:35.940436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.875256+0000","last_change":"2024-09-19T05:19:01.943685+0000","last_active":"2024-09-19T05:21:11.875256+0000","last_peered":"2024-09-19T05:21:11.875256+0000","last_clean":"2024-09-19T05:21:11.875256+0000","last_became_active":"2024-09-19T05:19:01.943251+0000","last_became_peered":"2024-09-19T05:19:01.943251+0000","last_unstale":"2024-09-19T05:21:11.875256+0000","last_undegraded":"2024-09-19T05:21:11.875256+0000","last_fullsized":"2024-09-19T05:21:11.875256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:10.040760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.877683+0000","last_change":"2024-09-19T05:19:01.952117+0000","last_active":"2024-09-19T05:21:11.877683+0000","last_peered":"2024-09-19T05:21:11.877683+0000","last_clean":"2024-09-19T05:21:11.877683+0000","last_became_active":"2024-09-19T05:19:01.951638+0000","last_became_peered":"2024-09-19T05:19:01.951638+0000","last_unstale":"2024-09-19T05:21:11.877683+0000","last_undegraded":"2024-09-19T05:21:11.877683+0000","last_fullsized":"2024-09-19T05:21:11.877683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:48.063140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961130+0000","last_change":"2024-09-19T05:19:01.931966+0000","last_active":"2024-09-19T05:21:11.961130+0000","last_peered":"2024-09-19T05:21:11.961130+0000","last_clean":"2024-09-19T05:21:11.961130+0000","last_became_active":"2024-09-19T05:19:01.931328+0000","last_became_peered":"2024-09-19T05:19:01.931328+0000","last_unstale":"2024-09-19T05:21:11.961130+0000","last_undegraded":"2024-09-19T05:21:11.961130+0000","last_fullsized":"2024-09-19T05:21:11.961130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:09:32.683176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.961325+0000","last_change":"2024-09-19T05:19:01.939392+0000","last_active":"2024-09-19T05:21:11.961325+0000","last_peered":"2024-09-19T05:21:11.961325+0000","last_clean":"2024-09-19T05:21:11.961325+0000","last_became_active":"2024-09-19T05:19:01.939045+0000","last_became_peered":"2024-09-19T05:19:01.939045+0000","last_unstale":"2024-09-19T05:21:11.961325+0000","last_undegraded":"2024-09-19T05:21:11.961325+0000","last_fullsized":"2024-09-19T05:21:11.961325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:36.445980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874759+0000","last_change":"2024-09-19T05:20:11.691043+0000","last_active":"2024-09-19T05:21:11.874759+0000","last_peered":"2024-09-19T05:21:11.874759+0000","last_clean":"2024-09-19T05:21:11.874759+0000","last_became_active":"2024-09-19T05:20:11.690672+0000","last_became_peered":"2024-09-19T05:20:11.690672+0000","last_unstale":"2024-09-19T05:21:11.874759+0000","last_undegraded":"2024-09-19T05:21:11.874759+0000","last_fullsized":"2024-09-19T05:21:11.874759+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:01.913488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876447+0000","last_change":"2024-09-19T05:19:01.944130+0000","last_active":"2024-09-19T05:21:11.876447+0000","last_peered":"2024-09-19T05:21:11.876447+0000","last_clean":"2024-09-19T05:21:11.876447+0000","last_became_active":"2024-09-19T05:19:01.943809+0000","last_became_peered":"2024-09-19T05:19:01.943809+0000","last_unstale":"2024-09-19T05:21:11.876447+0000","last_undegraded":"2024-09-19T05:21:11.876447+0000","last_fullsized":"2024-09-19T05:21:11.876447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:33.438856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.871767+0000","last_change":"2024-09-19T05:20:11.690113+0000","last_active":"2024-09-19T05:21:11.871767+0000","last_peered":"2024-09-19T05:21:11.871767+0000","last_clean":"2024-09-19T05:21:11.871767+0000","last_became_active":"2024-09-19T05:20:11.689729+0000","last_became_peered":"2024-09-19T05:20:11.689729+0000","last_unstale":"2024-09-19T05:21:11.871767+0000","last_undegraded":"2024-09-19T05:21:11.871767+0000","last_fullsized":"2024-09-19T05:21:11.871767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:14.762934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876158+0000","last_change":"2024-09-19T05:19:01.945392+0000","last_active":"2024-09-19T05:21:11.876158+0000","last_peered":"2024-09-19T05:21:11.876158+0000","last_clean":"2024-09-19T05:21:11.876158+0000","last_became_active":"2024-09-19T05:19:01.945097+0000","last_became_peered":"2024-09-19T05:19:01.945097+0000","last_unstale":"2024-09-19T05:21:11.876158+0000","last_undegraded":"2024-09-19T05:21:11.876158+0000","last_fullsized":"2024-09-19T05:21:11.876158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:00:00.590696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.876329+0000","last_change":"2024-09-19T05:19:01.938352+0000","last_active":"2024-09-19T05:21:11.876329+0000","last_peered":"2024-09-19T05:21:11.876329+0000","last_clean":"2024-09-19T05:21:11.876329+0000","last_became_active":"2024-09-19T05:19:01.938044+0000","last_became_peered":"2024-09-19T05:19:01.938044+0000","last_unstale":"2024-09-19T05:21:11.876329+0000","last_undegraded":"2024-09-19T05:21:11.876329+0000","last_fullsized":"2024-09-19T05:21:11.876329+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:04.751378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-19T05:21:11.874720+0000","last_change":"2024-09-19T05:19:01.947886+0000","last_active":"2024-09-19T05:21:11.874720+0000","last_peered":"2024-09-19T05:21:11.874720+0000","last_clean":"2024-09-19T05:21:11.874720+0000","last_became_active":"2024-09-19T05:19:01.946361+0000","last_became_peered":"2024-09-19T05:19:01.946361+0000","last_unstale":"2024-09-19T05:21:11.874720+0000","last_undegraded":"2024-09-19T05:21:11.874720+0000","last_fullsized":"2024-09-19T05:21:11.874720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:19:00.915032+0000","last_clean_scrub_stamp":"2024-09-19T05:19:00.915032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:10.021894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65862,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":197,"num_read_kb":165,"num_write":94,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":64756,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":196970,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":247410,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547241,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":515152,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1126400,"data_stored":1166682,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906995,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":519830,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135927,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":515756,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1052672,"data_stored":1110198,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528386,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":511056,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1056768,"data_stored":1105702,"data_compressed":65455,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":579930,"data_compressed":39698,"data_compressed_allocated":53248,"data_compressed_original":143360,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":999424,"data_stored":511160,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":995328,"data_stored":511090,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":575812,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":511146,"data_compressed":29407,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34406,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36048,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":64778,"data_compressed":10291,"data_compressed_allocated":12288,"data_compressed_original":61440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:21:22.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:21 smithi060 ceph-mon[35058]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:21 smithi082 ceph-mon[35195]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:22.266 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:21 smithi001 ceph-mon[30968]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:21:22.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 -- 172.21.15.1:0/217420673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc101420 msgr2=0x7f75bc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:22.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 --2- 172.21.15.1:0/217420673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc101420 0x7f75bc10d950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009cd0 tx=0x7f75b402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 -- 172.21.15.1:0/217420673 shutdown_connections 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 --2- 172.21.15.1:0/217420673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc101420 0x7f75bc10d950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 --2- 172.21.15.1:0/217420673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 --2- 172.21.15.1:0/217420673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc106a80 0x7f75bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 -- 172.21.15.1:0/217420673 >> 172.21.15.1:0/217420673 conn(0x7f75bc0fc7a0 msgr2=0x7f75bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 -- 172.21.15.1:0/217420673 shutdown_connections 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.734+0000 7f75c12e4640 1 -- 172.21.15.1:0/217420673 wait complete. 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 Processor -- start 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 -- start start 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc101420 0x7f75bc1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc110ea0 con 0x7f75bc106a80 2024-09-19T05:21:22.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc110d20 con 0x7f75bc100a80 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75c12e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc111020 con 0x7f75bc101420 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59034/0 (socket says 172.21.15.1:59034) 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75bb7fe640 1 -- 172.21.15.1:0/1924143955 learned_addr learned my addr 172.21.15.1:0/1924143955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75ba7fc640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc101420 0x7f75bc1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.735+0000 7f75baffd640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 -- 172.21.15.1:0/1924143955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc101420 msgr2=0x7f75bc1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc101420 0x7f75bc1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 -- 172.21.15.1:0/1924143955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 msgr2=0x7f75bc197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 -- 172.21.15.1:0/1924143955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc19c310 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75baffd640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75bb7fe640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f75b4005cc0 tx=0x7f75b4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4004040 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75b40046c0 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc19c5a0 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4046480 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.736+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1a3ee0 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.737+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc100ee0 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.738+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f75b40305a0 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.739+0000 7f75a3fff640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 0x7f75a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.739+0000 7f75baffd640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 0x7f75a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.739+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f75b402e030 con 0x7f75bc106a80 2024-09-19T05:21:22.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.739+0000 7f75baffd640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 0x7f75a40a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:22.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.743+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75b404b060 con 0x7f75bc106a80 2024-09-19T05:21:22.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.956+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75bc1a4110 con 0x7f75bc106a80 2024-09-19T05:21:22.958 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:22 smithi001 ceph-mon[30968]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 511 B/s wr, 2 op/s; 6.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:22.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.957+0000 7f75a3fff640 1 -- 172.21.15.1:0/1924143955 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f75b40bdf40 con 0x7f75bc106a80 2024-09-19T05:21:22.959 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:22.959 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:22.959 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 msgr2=0x7f75a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 0x7f75a40a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 msgr2=0x7f75bc19bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f75b4005cc0 tx=0x7f75b4003970 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 shutdown_connections 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f75a40a3240 0x7f75a40a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f75bc106a80 0x7f75bc19bc30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc101420 0x7f75bc1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 --2- 172.21.15.1:0/1924143955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75bc100a80 0x7f75bc197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 >> 172.21.15.1:0/1924143955 conn(0x7f75bc0fc7a0 msgr2=0x7f75bc0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 shutdown_connections 2024-09-19T05:21:22.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:22.959+0000 7f75c12e4640 1 -- 172.21.15.1:0/1924143955 wait complete. 2024-09-19T05:21:23.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:22 smithi060 ceph-mon[35058]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 511 B/s wr, 2 op/s; 6.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:23.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:22 smithi082 ceph-mon[35195]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 921 B/s rd, 511 B/s wr, 2 op/s; 6.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:23.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:24.042 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:23 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1924143955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:23 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1924143955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:23 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1924143955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 -- 172.21.15.1:0/240755786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 msgr2=0x7f31c010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/240755786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c010da40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009ca0 tx=0x7f31b802a950 comp rx=0 tx=0).stop 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 -- 172.21.15.1:0/240755786 shutdown_connections 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/240755786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c010da40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/240755786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 0x7f31c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/240755786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 -- 172.21.15.1:0/240755786 >> 172.21.15.1:0/240755786 conn(0x7f31c00fc7d0 msgr2=0x7f31c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 -- 172.21.15.1:0/240755786 shutdown_connections 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.419+0000 7f31c4eb4640 1 -- 172.21.15.1:0/240755786 wait complete. 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 Processor -- start 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 -- start start 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 0x7f31c01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f31c01120a0 con 0x7f31c0102ef0 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31c0111f20 con 0x7f31c0102570 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31c4eb4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31c0112220 con 0x7f31c0100e20 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37464/0 (socket says 172.21.15.1:37464) 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31bed9d640 1 -- 172.21.15.1:0/919078509 learned_addr learned my addr 172.21.15.1:0/919078509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31be59c640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.420+0000 7f31bdd9b640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 0x7f31c01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 -- 172.21.15.1:0/919078509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 msgr2=0x7f31c0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 -- 172.21.15.1:0/919078509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 msgr2=0x7f31c01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 0x7f31c01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 -- 172.21.15.1:0/919078509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c019d430 con 0x7f31c0102ef0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31be59c640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31bed9d640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f31b802ae70 tx=0x7f31b802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8034040 con 0x7f31c0102ef0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c019d6c0 con 0x7f31c0102ef0 2024-09-19T05:21:24.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b8030920 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8045480 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.421+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c01a5000 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.422+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c0101200 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.423+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f31b8037020 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.424+0000 7f31af7fe640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 0x7f31a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.424+0000 7f31be59c640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 0x7f31a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.424+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f31b80f0e60 con 0x7f31c0102ef0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.424+0000 7f31be59c640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 0x7f31a80a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31b0005fd0 tx=0x7f31b0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:24.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.428+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31b8081210 con 0x7f31c0102ef0 2024-09-19T05:21:24.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.639+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31c01997e0 con 0x7f31c0102ef0 2024-09-19T05:21:24.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.639+0000 7f31af7fe640 1 -- 172.21.15.1:0/919078509 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f31c01997e0 con 0x7f31c0102ef0 2024-09-19T05:21:24.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:24.641 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:24.641 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.641+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 msgr2=0x7f31a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.641+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 0x7f31a80a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31b0005fd0 tx=0x7f31b0005ea0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.641+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 msgr2=0x7f31c019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.641+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f31b802ae70 tx=0x7f31b802f5d0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 shutdown_connections 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f31a80a3240 0x7f31a80a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f31c0102ef0 0x7f31c019cd50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c0102570 0x7f31c01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 --2- 172.21.15.1:0/919078509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c0100e20 0x7f31c0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 >> 172.21.15.1:0/919078509 conn(0x7f31c00fc7d0 msgr2=0x7f31c0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 shutdown_connections 2024-09-19T05:21:24.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:24.642+0000 7f31c4eb4640 1 -- 172.21.15.1:0/919078509 wait complete. 2024-09-19T05:21:25.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:24 smithi060 ceph-mon[35058]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 939 B/s wr, 3 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:25.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:24 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/919078509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:24 smithi082 ceph-mon[35195]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 939 B/s wr, 3 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:25.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:24 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/919078509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:25.334 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:24 smithi001 ceph-mon[30968]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 939 B/s wr, 3 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-19T05:21:25.334 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:24 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/919078509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:25.363 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:21:25.621 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 -- 172.21.15.1:0/237297489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 msgr2=0x7f438410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 --2- 172.21.15.1:0/237297489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438410e790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f437c009900 tx=0x7f437c02a410 comp rx=0 tx=0).stop 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 -- 172.21.15.1:0/237297489 shutdown_connections 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 --2- 172.21.15.1:0/237297489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438410e790 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 --2- 172.21.15.1:0/237297489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43841037a0 0x7f438410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 --2- 172.21.15.1:0/237297489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4384102df0 0x7f43841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 -- 172.21.15.1:0/237297489 >> 172.21.15.1:0/237297489 conn(0x7f43840fc7d0 msgr2=0x7f43840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 -- 172.21.15.1:0/237297489 shutdown_connections 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 -- 172.21.15.1:0/237297489 wait complete. 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.069+0000 7f438c787640 1 Processor -- start 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 -- start start 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 0x7f4384198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 0x7f4384198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43841120f0 con 0x7f438410c2f0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4384111f70 con 0x7f4384102df0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438c787640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4384112270 con 0x7f43841037a0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438a523640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 0x7f4384198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438a523640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 0x7f4384198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:53858/0 (socket says 172.21.15.1:53858) 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438a523640 1 -- 172.21.15.1:0/114767636 learned_addr learned my addr 172.21.15.1:0/114767636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f4389d22640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 0x7f4384198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 -- 172.21.15.1:0/114767636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 msgr2=0x7f4384198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 0x7f4384198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 -- 172.21.15.1:0/114767636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 msgr2=0x7f4384198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 0x7f4384198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 -- 172.21.15.1:0/114767636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438419d4c0 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f4389d22640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 0x7f4384198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.070+0000 7f438ad24640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438419cde0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f437c009230 tx=0x7f437c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.071+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c03f030 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.071+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438419d750 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.071+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f437c003ad0 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.071+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c035070 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.071+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43841a5090 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.072+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43841031d0 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.073+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f437c042030 con 0x7f438410c2f0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.074+0000 7f43837fe640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 0x7f436c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.074+0000 7f438a523640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 0x7f436c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.074+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f437c0f03c0 con 0x7f438410c2f0 2024-09-19T05:21:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.074+0000 7f438a523640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 0x7f436c0a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43740104e0 tx=0x7f4374009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.078+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f437c0bccd0 con 0x7f438410c2f0 2024-09-19T05:21:26.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.253+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43841a5260 con 0x7f438410c2f0 2024-09-19T05:21:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.255+0000 7f43837fe640 1 -- 172.21.15.1:0/114767636 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24749 (secure 0 0 0) 0x7f437c0bc5d0 con 0x7f438410c2f0 2024-09-19T05:21:26.257 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:26.258 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":91,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:21:11.868828+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:21:26.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 msgr2=0x7f436c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 0x7f436c0a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f43740104e0 tx=0x7f4374009800 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 msgr2=0x7f438419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438419cde0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f437c009230 tx=0x7f437c004270 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 shutdown_connections 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f436c0a3240 0x7f436c0a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f438410c2f0 0x7f438419cde0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43841037a0 0x7f4384198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 --2- 172.21.15.1:0/114767636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4384102df0 0x7f4384198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 >> 172.21.15.1:0/114767636 conn(0x7f43840fc7d0 msgr2=0x7f43840fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 shutdown_connections 2024-09-19T05:21:26.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:26.258+0000 7f438c787640 1 -- 172.21.15.1:0/114767636 wait complete. 2024-09-19T05:21:26.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T05:21:27.003 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:26 smithi001 ceph-mon[30968]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:27.004 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:26 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/114767636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:27.241 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:27.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:26 smithi060 ceph-mon[35058]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:27.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:26 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/114767636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:27.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:26 smithi082 ceph-mon[35195]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:27.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:26 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/114767636' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:21:28.421 INFO:teuthology.orchestra.run.smithi001.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T05:21:28.421 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T05:21:28.421 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T05:21:28.422 DEBUG:tasks.quiescer:Yielding 2024-09-19T05:21:28.422 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T05:21:28.438 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:21:28.438 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T05:21:28.438 INFO:tasks.workunit:timeout=3h 2024-09-19T05:21:28.438 INFO:tasks.workunit:cleanup=True 2024-09-19T05:21:28.438 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:28.439 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 05:19:54.114759057 +0000 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 05:19:54.114759057 +0000 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 05:21:16.611650776 +0000 2024-09-19T05:21:28.481 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 05:19:54.114759057 +0000 2024-09-19T05:21:28.481 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T05:21:28.482 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T05:21:28.554 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:21:28.611 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T05:21:28.729 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:29.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:28 smithi001 ceph-mon[30968]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:29.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:28 smithi060 ceph-mon[35058]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:29.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:28 smithi082 ceph-mon[35195]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:29.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 -- 172.21.15.1:0/2871324999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 msgr2=0x7faaec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 --2- 172.21.15.1:0/2871324999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec1029b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faae0009900 tx=0x7faae002a480 comp rx=0 tx=0).stop 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 -- 172.21.15.1:0/2871324999 shutdown_connections 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 --2- 172.21.15.1:0/2871324999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 0x7faaec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 --2- 172.21.15.1:0/2871324999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec1029b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 --2- 172.21.15.1:0/2871324999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 0x7faaec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.231+0000 7faaf3848640 1 -- 172.21.15.1:0/2871324999 >> 172.21.15.1:0/2871324999 conn(0x7faaec0fc7d0 msgr2=0x7faaec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.232+0000 7faaf3848640 1 -- 172.21.15.1:0/2871324999 shutdown_connections 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.232+0000 7faaf3848640 1 -- 172.21.15.1:0/2871324999 wait complete. 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.232+0000 7faaf3848640 1 Processor -- start 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.232+0000 7faaf3848640 1 -- start start 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.232+0000 7faaf3848640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 0x7faaec0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf3848640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf3848640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 0x7faaec0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf3848640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faaec110f80 con 0x7faaec102570 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf3848640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faaec110e00 con 0x7faaec100e20 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf3848640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faaec111100 con 0x7faaec102ef0 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37486/0 (socket says 172.21.15.1:37486) 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 -- 172.21.15.1:0/3713498506 learned_addr learned my addr 172.21.15.1:0/3713498506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf15e4640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 0x7faaec0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf1de5640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 0x7faaec0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 -- 172.21.15.1:0/3713498506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 msgr2=0x7faaec0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 0x7faaec0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 -- 172.21.15.1:0/3713498506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 msgr2=0x7faaec0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 0x7faaec0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 -- 172.21.15.1:0/3713498506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec1a6970 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.233+0000 7faaf0de3640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faae0006010 tx=0x7faae0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.234+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae003f070 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.234+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec1a6c00 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.234+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faae0031c30 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.234+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0035030 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.234+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec1a70e0 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.235+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec101200 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.236+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7faae0042070 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.237+0000 7faade7fc640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 0x7faad80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.237+0000 7faaf15e4640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 0x7faad80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.237+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7faae00f07d0 con 0x7faaec102570 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.238+0000 7faaf15e4640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 0x7faad80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faae800bbe0 tx=0x7faae800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.240+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faae00bcaf0 con 0x7faaec102570 2024-09-19T05:21:29.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.458+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaec0fe1b0 con 0x7faaec102570 2024-09-19T05:21:29.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.459+0000 7faade7fc640 1 -- 172.21.15.1:0/3713498506 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7faaec0fe1b0 con 0x7faaec102570 2024-09-19T05:21:29.462 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:29.462 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:29.462 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:29.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 msgr2=0x7faad80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 0x7faad80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faae800bbe0 tx=0x7faae800b390 comp rx=0 tx=0).stop 2024-09-19T05:21:29.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 msgr2=0x7faaec0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faae0006010 tx=0x7faae0003c10 comp rx=0 tx=0).stop 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 shutdown_connections 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faad80a3240 0x7faad80a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaec102ef0 0x7faaec0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faaec102570 0x7faaec0fd1c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 --2- 172.21.15.1:0/3713498506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaec100e20 0x7faaec0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 >> 172.21.15.1:0/3713498506 conn(0x7faaec0fc7d0 msgr2=0x7faaec06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 shutdown_connections 2024-09-19T05:21:29.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:29.462+0000 7faaf3848640 1 -- 172.21.15.1:0/3713498506 wait complete. 2024-09-19T05:21:30.079 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:29 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3713498506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:30.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:29 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3713498506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:30.268 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:29 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3713498506' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:30.269 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:19:02.579382+0000', 'modified': '2024-09-19T05:19:46.933700+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/1625002585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1625002585}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1625002585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.82:6839/1656123730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1656123730}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1656123730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472]} 2024-09-19T05:21:30.269 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T05:21:30.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:21:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:30.965 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:30 smithi001 ceph-mon[30968]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:31.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 -- 172.21.15.1:0/3924979414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc10103660 msgr2=0x7fbc1010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/3924979414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc10103660 0x7fbc1010bb50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009900 tx=0x7fbc0002a480 comp rx=0 tx=0).stop 2024-09-19T05:21:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 -- 172.21.15.1:0/3924979414 shutdown_connections 2024-09-19T05:21:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/3924979414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc1010c170 0x7fbc1010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/3924979414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc10103660 0x7fbc1010bb50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/3924979414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.048+0000 7fbc17f4f640 1 -- 172.21.15.1:0/3924979414 >> 172.21.15.1:0/3924979414 conn(0x7fbc100fc7a0 msgr2=0x7fbc100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.049+0000 7fbc17f4f640 1 -- 172.21.15.1:0/3924979414 shutdown_connections 2024-09-19T05:21:31.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.049+0000 7fbc17f4f640 1 -- 172.21.15.1:0/3924979414 wait complete. 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.049+0000 7fbc17f4f640 1 Processor -- start 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.049+0000 7fbc17f4f640 1 -- start start 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc10103660 0x7fbc101989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10111fc0 con 0x7fbc1010c170 2024-09-19T05:21:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10111e40 con 0x7fbc10103660 2024-09-19T05:21:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc17f4f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10112140 con 0x7fbc10102d40 2024-09-19T05:21:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc15ceb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc15ceb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:47024/0 (socket says 172.21.15.1:47024) 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc15ceb640 1 -- 172.21.15.1:0/1459215428 learned_addr learned my addr 172.21.15.1:0/1459215428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37490/0 (socket says 172.21.15.1:37490) 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc154ea640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc10103660 0x7fbc101989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 -- 172.21.15.1:0/1459215428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 msgr2=0x7fbc10198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 -- 172.21.15.1:0/1459215428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc10103660 msgr2=0x7fbc101989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc10103660 0x7fbc101989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 -- 172.21.15.1:0/1459215428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1019d410 con 0x7fbc1010c170 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.050+0000 7fbc164ec640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800cab0 tx=0x7fbc0800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.051+0000 7fbc06ffd640 1 -- 172.21.15.1:0/1459215428 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800ae20 con 0x7fbc1010c170 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.051+0000 7fbc06ffd640 1 -- 172.21.15.1:0/1459215428 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0800f930 con 0x7fbc1010c170 2024-09-19T05:21:31.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.051+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1019d700 con 0x7fbc1010c170 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.051+0000 7fbc06ffd640 1 -- 172.21.15.1:0/1459215428 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08018b30 con 0x7fbc1010c170 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.051+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc101a4fe0 con 0x7fbc1010c170 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.053+0000 7fbc06ffd640 1 -- 172.21.15.1:0/1459215428 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbc0800fae0 con 0x7fbc1010c170 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.053+0000 7fbc1a328740 1 Processor -- start 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.053+0000 7fbc1a328740 1 -- start start 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1312c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad13243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ad1279090 con 0x561ad13131b0 2024-09-19T05:21:31.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561ad1220a70 con 0x561ad1312890 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc1a328740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561ad1275050 con 0x561ad1321fc0 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37502/0 (socket says 172.21.15.1:37502) 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1312c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 -- 172.21.15.1:0/355369384 learned_addr learned my addr 172.21.15.1:0/355369384 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc154ea640 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad13243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc06ffd640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 0x7fbbfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 -- 172.21.15.1:0/355369384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 msgr2=0x561ad13243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad13243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 -- 172.21.15.1:0/355369384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 msgr2=0x561ad1312c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1312c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 -- 172.21.15.1:0/355369384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad122d130 con 0x561ad13131b0 2024-09-19T05:21:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc154ea640 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad13243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc164ec640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 0x7fbbfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.054+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00bdd0 tx=0x7fbc0c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d018670aa3d0f12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbc06ffd640 1 -- 172.21.15.1:0/1459215428 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc080d0310 con 0x7fbc1010c170 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbbfbfff640 1 -- 172.21.15.1:0/355369384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c005220 con 0x561ad13131b0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbbfbfff640 1 -- 172.21.15.1:0/355369384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0c004c80 con 0x561ad13131b0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbbfbfff640 1 -- 172.21.15.1:0/355369384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c011860 con 0x561ad13131b0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbc1a328740 1 -- 172.21.15.1:0/355369384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 msgr2=0x561ad1321a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbc164ec640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 0x7fbbfc0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc080a4cc0 tx=0x7fbc08098100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.055+0000 7fbc1a328740 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00bdd0 tx=0x7fbc0c0107a0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 -- 172.21.15.1:0/355369384 shutdown_connections 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad13243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad13131b0 0x561ad1321a80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 --2- 172.21.15.1:0/355369384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1312c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 -- 172.21.15.1:0/355369384 >> 172.21.15.1:0/355369384 conn(0x561ad130ef60 msgr2=0x561ad130f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 -- 172.21.15.1:0/355369384 shutdown_connections 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 -- 172.21.15.1:0/355369384 wait complete. 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 -- start start 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 Processor -- start 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1321850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.056+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 0x561ad131ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ad1324b90 con 0x561ad1321fc0 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561ad1233f20 con 0x561ad1312890 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561ad1324d10 con 0x561ad13131b0 2024-09-19T05:21:31.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 10 client.0 _ll_register_callbacks cb 0x561ad11fd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37514/0 (socket says 172.21.15.1:37514) 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 -- 172.21.15.1:0/156124853 learned_addr learned my addr 172.21.15.1:0/156124853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 0x561ad131ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1321850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 -- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 msgr2=0x561ad131ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 0x561ad131ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 -- 172.21.15.1:0/156124853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 msgr2=0x561ad1321850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1321850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 -- 172.21.15.1:0/156124853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad0fea2b0 con 0x561ad1321fc0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 0x561ad131ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc154ea640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009230 tx=0x7fbc00041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19918b84de7907a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbbf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00035070 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc00032c30 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc0c004c80 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc00053050 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 10 client.15198 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.057+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561ad1330520 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0c004c80 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc00004b80 con 0x561ad1321fc0 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 10 client.15198 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 10 client.15198 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 20 client.15198 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad1332b10 0x561ad1333f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 4 client.15198 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ad1286600 con 0x561ad1332b10 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.058+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad1332b10 0x561ad1333f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad1332b10 0x561ad1333f80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dac7c5f57833f62 server_cookie=3e6cf511cce7d089 in_seq=0 out_seq=0 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbbf97fa640 10 client.15198 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbbf97fa640 1 -- 172.21.15.1:0/156124853 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ad1286600 con 0x561ad1332b10 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbbf97fa640 10 client.15198 handle_command_reply: tid=0 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbc1a328740 1 client.15198 shutdown 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 msgr2=0x561ad131f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.059+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009230 tx=0x7fbc00041040 comp rx=0 tx=0).stop 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 shutdown_connections 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad131f130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad1332b10 0x561ad1333f80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad13131b0 0x561ad131ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 --2- 172.21.15.1:0/156124853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad1312890 0x561ad1321850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbbf97fa640 0 client.15198 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 >> 172.21.15.1:0/156124853 conn(0x561ad130ef60 msgr2=0x561ad1314cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 shutdown_connections 2024-09-19T05:21:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 1 -- 172.21.15.1:0/156124853 wait complete. 2024-09-19T05:21:31.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.060+0000 7fbc1a328740 20 client.15198 trim_cache size 0 max 16384 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 Processor -- start 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 -- start start 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1312890 0x561ad1332440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13331e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ad13322c0 con 0x561ad1321fc0 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561ad1332990 con 0x561ad13131b0 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc1a328740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561ad1333060 con 0x561ad1312890 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37516/0 (socket says 172.21.15.1:37516) 2024-09-19T05:21:31.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 -- 172.21.15.1:0/918237375 learned_addr learned my addr 172.21.15.1:0/918237375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1312890 0x561ad1332440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 -- 172.21.15.1:0/918237375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1312890 msgr2=0x561ad1332440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1312890 0x561ad1332440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 -- 172.21.15.1:0/918237375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 msgr2=0x561ad13331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13331e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.078+0000 7fbc154ea640 1 -- 172.21.15.1:0/918237375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad1313e60 con 0x561ad1321fc0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbc154ea640 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005ec0 tx=0x7fbc0002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8e71f1e57f9b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbbfb7fe640 1 -- 172.21.15.1:0/918237375 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00035040 con 0x561ad1321fc0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbbfb7fe640 1 -- 172.21.15.1:0/918237375 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc00032e70 con 0x561ad1321fc0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbbfb7fe640 1 -- 172.21.15.1:0/918237375 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc000046c0 con 0x561ad1321fc0 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbc1a328740 1 -- 172.21.15.1:0/918237375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 msgr2=0x561ad1309ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.079+0000 7fbc1a328740 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005ec0 tx=0x7fbc0002a480 comp rx=0 tx=0).stop 2024-09-19T05:21:31.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- 172.21.15.1:0/918237375 shutdown_connections 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1321fc0 0x561ad1309ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13331e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- 172.21.15.1:0/918237375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1312890 0x561ad1332440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- 172.21.15.1:0/918237375 >> 172.21.15.1:0/918237375 conn(0x561ad130ef60 msgr2=0x561ad130f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- 172.21.15.1:0/918237375 shutdown_connections 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- 172.21.15.1:0/918237375 wait complete. 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- start start 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 Processor -- start 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad1335c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561ad1333e00 con 0x561ad1312890 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561ad1333730 con 0x561ad13131b0 2024-09-19T05:21:31.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561ad13344d0 con 0x561ad1321fc0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.080+0000 7fbc1a328740 10 client.0 _ll_register_callbacks cb 0x7fbc00004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37520/0 (socket says 172.21.15.1:37520) 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 -- 172.21.15.1:0/796176633 learned_addr learned my addr 172.21.15.1:0/796176633 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 -- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 msgr2=0x561ad1335c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad1335c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 -- 172.21.15.1:0/796176633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 msgr2=0x561ad13356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 -- 172.21.15.1:0/796176633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad139b410 con 0x561ad1312890 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc154ea640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbc00004180 tx=0x7fbc000038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16f7b9e967f3ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbbf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:21:31.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0004f070 con 0x561ad1312890 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc000035f0 con 0x561ad1312890 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561ad1280b10 con 0x561ad1312890 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc00064050 con 0x561ad1312890 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc1a328740 10 client.15204 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.081+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561ad139c6f0 con 0x561ad1312890 2024-09-19T05:21:31.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561ad1280b10 con 0x561ad1312890 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc000046c0 con 0x561ad1312890 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 10 client.15204 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 10 client.15204 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 20 client.15204 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad13a0f10 0x561ad139fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 4 client.15204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "status"}) -- 0x561ad11fd0e0 con 0x561ad13a0f10 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.082+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad13a0f10 0x561ad139fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc15ceb640 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad13a0f10 0x561ad139fc20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7185a820b5acf795 server_cookie=1ec4ccfb19c8546a in_seq=0 out_seq=0 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbbf97fa640 10 client.15204 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbbf97fa640 1 -- 172.21.15.1:0/796176633 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561ad11fd0e0 con 0x561ad13a0f10 2024-09-19T05:21:31.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbbf97fa640 10 client.15204 handle_command_reply: tid=0 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 client.15204 shutdown 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 msgr2=0x561ad1335180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbc00004180 tx=0x7fbc000038b0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 shutdown_connections 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561ad13a0f10 0x561ad139fc20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561ad1321fc0 0x561ad1335c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561ad13131b0 0x561ad13356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbbf97fa640 0 client.15204 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 --2- 172.21.15.1:0/796176633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561ad1312890 0x561ad1335180 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 >> 172.21.15.1:0/796176633 conn(0x561ad130ef60 msgr2=0x561ad1309ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 shutdown_connections 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 1 -- 172.21.15.1:0/796176633 wait complete. 2024-09-19T05:21:31.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.083+0000 7fbc1a328740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "7ab08e8a-7645-11ef-bceb-c7b262605968", 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24472, 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 148.11244121600001, 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 21, 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 91, 2024-09-19T05:21:31.092 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 87, 2024-09-19T05:21:31.093 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 168.349850664 2024-09-19T05:21:31.093 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:21:31.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 msgr2=0x7fbbfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 0x7fbbfc0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbc080a4cc0 tx=0x7fbc08098100 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 msgr2=0x7fbc1019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800cab0 tx=0x7fbc0800cf70 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 shutdown_connections 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbbfc0a3240 0x7fbbfc0a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc1010c170 0x7fbc1019cd30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc10103660 0x7fbc101989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 --2- 172.21.15.1:0/1459215428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc10102d40 0x7fbc10198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 >> 172.21.15.1:0/1459215428 conn(0x7fbc100fc7a0 msgr2=0x7fbc100fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 shutdown_connections 2024-09-19T05:21:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:31.084+0000 7fbc17f4f640 1 -- 172.21.15.1:0/1459215428 wait complete. 2024-09-19T05:21:31.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:30 smithi060 ceph-mon[35058]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:30 smithi082 ceph-mon[35195]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:31.834 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T05:21:33.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:32 smithi060 ceph-mon[35058]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-19T05:21:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:32 smithi082 ceph-mon[35195]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-19T05:21:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:32 smithi001 ceph-mon[30968]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-19T05:21:35.265 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:34 smithi082 ceph-mon[35195]: pgmap v363: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T05:21:35.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:34 smithi001 ceph-mon[30968]: pgmap v363: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T05:21:35.667 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:34 smithi060 ceph-mon[35058]: pgmap v363: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T05:21:37.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:36 smithi060 ceph-mon[35058]: pgmap v364: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:37.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:36 smithi082 ceph-mon[35195]: pgmap v364: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:36 smithi001 ceph-mon[30968]: pgmap v364: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:39.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:38 smithi060 ceph-mon[35058]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:39.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:38 smithi082 ceph-mon[35195]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:38 smithi001 ceph-mon[30968]: pgmap v365: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:41.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:40 smithi060 ceph-mon[35058]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:41.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:40 smithi082 ceph-mon[35195]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:40 smithi001 ceph-mon[30968]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:43.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:42 smithi060 ceph-mon[35058]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:43.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:42 smithi082 ceph-mon[35195]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:43.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:42 smithi001 ceph-mon[30968]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:45.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:44 smithi060 ceph-mon[35058]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:45.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:44 smithi082 ceph-mon[35195]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:45.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:44 smithi001 ceph-mon[30968]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:21:46.836 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T05:21:46.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:47.109 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:47.232 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:46 smithi001 ceph-mon[30968]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:47.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:46 smithi060 ceph-mon[35058]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:47.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:46 smithi082 ceph-mon[35195]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:47.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 -- 172.21.15.1:0/2930785956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 msgr2=0x7fef4810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 --2- 172.21.15.1:0/2930785956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef4810ec40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef40009cd0 tx=0x7fef4002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 -- 172.21.15.1:0/2930785956 shutdown_connections 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 --2- 172.21.15.1:0/2930785956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef4810ec40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 --2- 172.21.15.1:0/2930785956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef481036e0 0x7fef48107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 --2- 172.21.15.1:0/2930785956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef48102d30 0x7fef48103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 -- 172.21.15.1:0/2930785956 >> 172.21.15.1:0/2930785956 conn(0x7fef480fc7d0 msgr2=0x7fef480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 -- 172.21.15.1:0/2930785956 shutdown_connections 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.708+0000 7fef4e429640 1 -- 172.21.15.1:0/2930785956 wait complete. 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 Processor -- start 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 -- start start 2024-09-19T05:21:47.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef48102d30 0x7fef48100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 0x7fef48100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fef481120a0 con 0x7fef481082a0 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fef48111f20 con 0x7fef481036e0 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4e429640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef48112220 con 0x7fef48102d30 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4c9c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.709+0000 7fef4c9c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33050/0 (socket says 172.21.15.1:33050) 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 -- 172.21.15.1:0/2746247668 learned_addr learned my addr 172.21.15.1:0/2746247668 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef3ffff640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 0x7fef48100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef47fff640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef48102d30 0x7fef48100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 -- 172.21.15.1:0/2746247668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef48102d30 msgr2=0x7fef48100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef48102d30 0x7fef48100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 -- 172.21.15.1:0/2746247668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 msgr2=0x7fef48100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 0x7fef48100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 -- 172.21.15.1:0/2746247668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef481a6a00 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef3ffff640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 0x7fef48100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4c9c6640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef40005cc0 tx=0x7fef40032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40004040 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef400046c0 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef481a6c90 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.710+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40030e00 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.711+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef481a71d0 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.712+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef48103110 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.714+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fef400305a0 con 0x7fef481082a0 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.715+0000 7fef45ffb640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 0x7fef340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:47.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.715+0000 7fef47fff640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 0x7fef340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.715+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fef4002e030 con 0x7fef481082a0 2024-09-19T05:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.715+0000 7fef47fff640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 0x7fef340a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef38009bd0 tx=0x7fef38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:47.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.718+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef4004b060 con 0x7fef481082a0 2024-09-19T05:21:47.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.954+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef481a7400 con 0x7fef481082a0 2024-09-19T05:21:47.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.955+0000 7fef45ffb640 1 -- 172.21.15.1:0/2746247668 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fef400bdeb0 con 0x7fef481082a0 2024-09-19T05:21:47.957 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:47.957 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:47.957 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 msgr2=0x7fef340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 0x7fef340a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef38009bd0 tx=0x7fef38005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 msgr2=0x7fef48101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef40005cc0 tx=0x7fef40032f40 comp rx=0 tx=0).stop 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 shutdown_connections 2024-09-19T05:21:47.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fef340a3240 0x7fef340a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fef481082a0 0x7fef48101410 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef481036e0 0x7fef48100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 --2- 172.21.15.1:0/2746247668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef48102d30 0x7fef48100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 >> 172.21.15.1:0/2746247668 conn(0x7fef480fc7d0 msgr2=0x7fef48105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 shutdown_connections 2024-09-19T05:21:47.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:47.958+0000 7fef4e429640 1 -- 172.21.15.1:0/2746247668 wait complete. 2024-09-19T05:21:48.603 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T05:21:48.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T05:21:48.887 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:49.154 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:48 smithi001 ceph-mon[30968]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:49.154 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2746247668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:49.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:48 smithi060 ceph-mon[35058]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:49.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2746247668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:48 smithi082 ceph-mon[35195]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:21:49.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2746247668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 -- 172.21.15.1:0/1252530820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c100a80 msgr2=0x7fe81c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 --2- 172.21.15.1:0/1252530820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c100a80 0x7fe81c100ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe810009930 tx=0x7fe81002a420 comp rx=0 tx=0).stop 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 -- 172.21.15.1:0/1252530820 shutdown_connections 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 --2- 172.21.15.1:0/1252530820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c101420 0x7fe81c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 --2- 172.21.15.1:0/1252530820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c100a80 0x7fe81c100ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 --2- 172.21.15.1:0/1252530820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 -- 172.21.15.1:0/1252530820 >> 172.21.15.1:0/1252530820 conn(0x7fe81c0fc7a0 msgr2=0x7fe81c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 -- 172.21.15.1:0/1252530820 shutdown_connections 2024-09-19T05:21:49.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 -- 172.21.15.1:0/1252530820 wait complete. 2024-09-19T05:21:49.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.546+0000 7fe821762640 1 Processor -- start 2024-09-19T05:21:49.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 -- start start 2024-09-19T05:21:49.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c100a80 0x7fe81c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c110e80 con 0x7fe81c101420 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c110d00 con 0x7fe81c106a80 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe821762640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c111000 con 0x7fe81c100a80 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33072/0 (socket says 172.21.15.1:33072) 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 -- 172.21.15.1:0/2779055420 learned_addr learned my addr 172.21.15.1:0/2779055420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81affd640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c100a80 0x7fe81c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 -- 172.21.15.1:0/2779055420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c100a80 msgr2=0x7fe81c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c100a80 0x7fe81c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 -- 172.21.15.1:0/2779055420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 msgr2=0x7fe81c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.547+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe81a7fc640 1 -- 172.21.15.1:0/2779055420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c19d360 con 0x7fe81c101420 2024-09-19T05:21:49.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe810009a50 tx=0x7fe810004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe803fff640 1 -- 172.21.15.1:0/2779055420 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81003f030 con 0x7fe81c101420 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81c19d5f0 con 0x7fe81c101420 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81c1a4f30 con 0x7fe81c101420 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe803fff640 1 -- 172.21.15.1:0/2779055420 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe810003ad0 con 0x7fe81c101420 2024-09-19T05:21:49.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.548+0000 7fe803fff640 1 -- 172.21.15.1:0/2779055420 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810035070 con 0x7fe81c101420 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 Processor -- start 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe803fff640 1 -- 172.21.15.1:0/2779055420 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe810042030 con 0x7fe81c101420 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 -- start start 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f02fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f03a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561c0ef952a0 con 0x561c0f03a940 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c0ef3cb10 con 0x561c0f02f760 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe823b3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c0ef91260 con 0x561c0f030080 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33074/0 (socket says 172.21.15.1:33074) 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe81a7fc640 1 -- 172.21.15.1:0/931421740 learned_addr learned my addr 172.21.15.1:0/931421740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.551+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f02fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81affd640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f03a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 -- 172.21.15.1:0/931421740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 msgr2=0x561c0f03a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f03a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 -- 172.21.15.1:0/931421740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 msgr2=0x561c0f02fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f02fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 -- 172.21.15.1:0/931421740 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c0ed06b90 con 0x561c0f03a940 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe803fff640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 0x7fe8040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f02fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 0x7fe8040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8100f84c0 tx=0x7fe8100f85b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668d88fd1204c192 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe803fff640 1 -- 172.21.15.1:0/2779055420 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe8100f00c0 con 0x7fe81c101420 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe8017fa640 1 -- 172.21.15.1:0/931421740 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810049020 con 0x561c0f03a940 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.552+0000 7fe8017fa640 1 -- 172.21.15.1:0/931421740 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8100bca30 con 0x561c0f03a940 2024-09-19T05:21:49.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe8017fa640 1 -- 172.21.15.1:0/931421740 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100bbc90 con 0x561c0f03a940 2024-09-19T05:21:49.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 -- 172.21.15.1:0/931421740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 msgr2=0x561c0f03cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 0x7fe8040a5780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe814007f90 tx=0x7fe814007990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8100f84c0 tx=0x7fe8100f85b0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 -- 172.21.15.1:0/931421740 shutdown_connections 2024-09-19T05:21:49.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f03cd30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f03a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 --2- 172.21.15.1:0/931421740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f02fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.553+0000 7fe823b3b740 1 -- 172.21.15.1:0/931421740 >> 172.21.15.1:0/931421740 conn(0x561c0f02bcf0 msgr2=0x561c0f02c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- 172.21.15.1:0/931421740 shutdown_connections 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- 172.21.15.1:0/931421740 wait complete. 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- start start 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 Processor -- start 2024-09-19T05:21:49.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f037770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f037cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561c0f0416e0 con 0x561c0f03a940 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c0ef1d6e0 con 0x561c0f02f760 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c0f041860 con 0x561c0f030080 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.554+0000 7fe823b3b740 10 client.0 _ll_register_callbacks cb 0x561c0ef41a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f037cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33082/0 (socket says 172.21.15.1:33082) 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 -- 172.21.15.1:0/373945328 learned_addr learned my addr 172.21.15.1:0/373945328 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81affd640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f037770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 -- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 msgr2=0x561c0f037cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f037cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 -- 172.21.15.1:0/373945328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 msgr2=0x561c0f037770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f037770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 -- 172.21.15.1:0/373945328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c0f04ab50 con 0x561c0f03a940 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe814011e40 tx=0x7fe814004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4a1c5417eded46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe7feff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814003b70 con 0x561c0f03a940 2024-09-19T05:21:49.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe814003d10 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.555+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8100bca30 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe81402e050 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 10 client.15222 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c0f04d510 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8100bca30 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe81401e6b0 con 0x561c0f03a940 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 10 client.15222 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 10 client.15222 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 20 client.15222 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f04e9d0 0x561c0f050e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 4 client.15222 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.556+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c0efa29d0 con 0x561c0f04e9d0 2024-09-19T05:21:49.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.557+0000 7fe81affd640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f04e9d0 0x561c0f050e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.557+0000 7fe81affd640 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f04e9d0 0x561c0f050e50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44dfab945db956 server_cookie=edeed23b7ca0fde5 in_seq=0 out_seq=0 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.557+0000 7fe7feff5640 10 client.15222 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe7feff5640 1 -- 172.21.15.1:0/373945328 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c0efa29d0 con 0x561c0f04e9d0 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe7feff5640 10 client.15222 handle_command_reply: tid=0 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 client.15222 shutdown 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 msgr2=0x561c0f0381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe814011e40 tx=0x7fe814004a40 comp rx=0 tx=0).stop 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 shutdown_connections 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f0381f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f04e9d0 0x561c0f050e50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f030080 0x561c0f037cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 --2- 172.21.15.1:0/373945328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f02f760 0x561c0f037770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 >> 172.21.15.1:0/373945328 conn(0x561c0f02bcf0 msgr2=0x561c0f0319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe7feff5640 0 client.15222 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 shutdown_connections 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 1 -- 172.21.15.1:0/373945328 wait complete. 2024-09-19T05:21:49.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.558+0000 7fe823b3b740 20 client.15222 trim_cache size 0 max 16384 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 Processor -- start 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 -- start start 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f0318c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 0x561c0f056720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800dc00 con 0x561c0f03a940 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe808010480 con 0x561c0f030080 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.576+0000 7fe823b3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800e270 con 0x561c0f02f760 2024-09-19T05:21:49.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33094/0 (socket says 172.21.15.1:33094) 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 -- 172.21.15.1:0/892866592 learned_addr learned my addr 172.21.15.1:0/892866592 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81affd640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f0318c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 0x561c0f056720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 -- 172.21.15.1:0/892866592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 msgr2=0x561c0f0318c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f0318c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 -- 172.21.15.1:0/892866592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 msgr2=0x561c0f056720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 0x561c0f056720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 -- 172.21.15.1:0/892866592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c0f02bb20 con 0x561c0f03a940 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 0x561c0f056720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe81401ead0 tx=0x7fe814026400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7aae015684e81a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe800ff9640 1 -- 172.21.15.1:0/892866592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814004cb0 con 0x561c0f03a940 2024-09-19T05:21:49.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe800ff9640 1 -- 172.21.15.1:0/892866592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe814036070 con 0x561c0f03a940 2024-09-19T05:21:49.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.577+0000 7fe800ff9640 1 -- 172.21.15.1:0/892866592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814004290 con 0x561c0f03a940 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 -- 172.21.15.1:0/892866592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 msgr2=0x561c0f056c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe81401ead0 tx=0x7fe814026400 comp rx=0 tx=0).stop 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 -- 172.21.15.1:0/892866592 shutdown_connections 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f03a940 0x561c0f056c60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f030080 0x561c0f056720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 --2- 172.21.15.1:0/892866592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f0318c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 -- 172.21.15.1:0/892866592 >> 172.21.15.1:0/892866592 conn(0x561c0f02bcf0 msgr2=0x561c0f0311b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 -- 172.21.15.1:0/892866592 shutdown_connections 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.578+0000 7fe823b3b740 1 -- 172.21.15.1:0/892866592 wait complete. 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 -- start start 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 Processor -- start 2024-09-19T05:21:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f03a940 0x561c0f043530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800e940 con 0x561c0f030080 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800fdb0 con 0x561c0f03a940 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe80800f010 con 0x561c0f02f760 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe823b3b740 10 client.0 _ll_register_callbacks cb 0x7fe8140117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe81affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe81affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:59598/0 (socket says 172.21.15.1:59598) 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe81a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33104/0 (socket says 172.21.15.1:33104) 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.579+0000 7fe81affd640 1 -- 172.21.15.1:0/841189423 learned_addr learned my addr 172.21.15.1:0/841189423 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81b7fe640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f03a940 0x561c0f043530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 -- 172.21.15.1:0/841189423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f03a940 msgr2=0x561c0f043530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f03a940 0x561c0f043530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 -- 172.21.15.1:0/841189423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 msgr2=0x561c0f042ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 -- 172.21.15.1:0/841189423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c0f027260 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe81affd640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561c0f051690 tx=0x7fe80c010af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c10fd2d8e793f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe7feff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c02b060 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe80c00fa90 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.580+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe814036070 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe80c032050 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 10 client.24907 fetch_fsmap learned FSMap version 21 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c0f0b9a90 con 0x561c0f02f760 2024-09-19T05:21:49.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe80c00fc90 con 0x561c0f02f760 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe80c01d3f0 con 0x561c0f02f760 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 10 client.24907 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 10 client.24907 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 20 client.24907 populate_metadata read hostname 'smithi001' 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f0ba220 0x561c0f0bc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 4 client.24907 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x7fe814036070 con 0x561c0f0ba220 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.581+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f0ba220 0x561c0f0bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.582+0000 7fe81a7fc640 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f0ba220 0x561c0f0bc640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86231f50bf59a24 server_cookie=4f36f878070da66 in_seq=0 out_seq=0 2024-09-19T05:21:49.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.582+0000 7fe7feff5640 10 client.24907 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:49.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe7feff5640 1 -- 172.21.15.1:0/841189423 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fe814036070 con 0x561c0f0ba220 2024-09-19T05:21:49.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe7feff5640 10 client.24907 handle_command_reply: tid=0 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 client.24907 shutdown 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 msgr2=0x561c0f042ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561c0f051690 tx=0x7fe80c010af0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 shutdown_connections 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c0f03a940 0x561c0f043530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c0f030080 0x561c0f042ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c0f0ba220 0x561c0f0bc640 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 --2- 172.21.15.1:0/841189423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c0f02f760 0x561c0f042ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe7feff5640 0 client.24907 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 >> 172.21.15.1:0/841189423 conn(0x561c0f02bcf0 msgr2=0x561c0f0319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 shutdown_connections 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 1 -- 172.21.15.1:0/841189423 wait complete. 2024-09-19T05:21:49.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.590+0000 7fe823b3b740 20 client.24907 trim_cache size 0 max 16384 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 2, 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "57d41255": { 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 2, 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:21:49.593 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:21:49.594 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:21:49.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 msgr2=0x7fe8040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 0x7fe8040a5780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe814007f90 tx=0x7fe814007990 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 msgr2=0x7fe81c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe810009a50 tx=0x7fe810004270 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 shutdown_connections 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe8040a32c0 0x7fe8040a5780 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c106a80 0x7fe81c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe81c101420 0x7fe81c1988f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 --2- 172.21.15.1:0/2779055420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe81c100a80 0x7fe81c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 >> 172.21.15.1:0/2779055420 conn(0x7fe81c0fc7a0 msgr2=0x7fe81c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 shutdown_connections 2024-09-19T05:21:49.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:49.591+0000 7fe821762640 1 -- 172.21.15.1:0/2779055420 wait complete. 2024-09-19T05:21:50.304 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '57d41255', quiesce took 3.5 seconds. Will release after: 7.699999999999999 2024-09-19T05:21:51.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:50 smithi060 ceph-mon[35058]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:51.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:50 smithi082 ceph-mon[35195]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:50 smithi001 ceph-mon[30968]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:53.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:52 smithi060 ceph-mon[35058]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:53.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:52 smithi082 ceph-mon[35195]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:53.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:52 smithi001 ceph-mon[30968]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:21:55.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:54 smithi060 ceph-mon[35058]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:55.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:54 smithi082 ceph-mon[35195]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:55.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:54 smithi001 ceph-mon[30968]: pgmap v373: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:57.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:56 smithi060 ceph-mon[35058]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:56 smithi082 ceph-mon[35195]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:56 smithi001 ceph-mon[30968]: pgmap v374: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:21:58.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:58.280 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 -- 172.21.15.1:0/2153219601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102570 msgr2=0x7f5db81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/2153219601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102570 0x7f5db81029b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009900 tx=0x7f5da802a480 comp rx=0 tx=0).stop 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 -- 172.21.15.1:0/2153219601 shutdown_connections 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/2153219601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8102ef0 0x7f5db810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/2153219601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102570 0x7f5db81029b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:58.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/2153219601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8100e20 0x7f5db8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 -- 172.21.15.1:0/2153219601 >> 172.21.15.1:0/2153219601 conn(0x7f5db80fc7d0 msgr2=0x7f5db80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 -- 172.21.15.1:0/2153219601 shutdown_connections 2024-09-19T05:21:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.834+0000 7f5dbfe76640 1 -- 172.21.15.1:0/2153219601 wait complete. 2024-09-19T05:21:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbfe76640 1 Processor -- start 2024-09-19T05:21:58.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbfe76640 1 -- start start 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbfe76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbfe76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbfe76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbd411640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbdc12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbe413640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:58.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.835+0000 7f5dbdc12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:49606/0 (socket says 172.21.15.1:49606) 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbd411640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:33396/0 (socket says 172.21.15.1:33396) 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbe413640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49590/0 (socket says 172.21.15.1:49590) 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbfe76640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8110f80 con 0x7f5db8102ef0 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbfe76640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8110e00 con 0x7f5db8102570 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbfe76640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8111100 con 0x7f5db8100e20 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 -- 172.21.15.1:0/1796657746 learned_addr learned my addr 172.21.15.1:0/1796657746 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 -- 172.21.15.1:0/1796657746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 msgr2=0x7f5db8199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 -- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 msgr2=0x7f5db81a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 -- 172.21.15.1:0/1796657746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db81a4810 con 0x7f5db8100e20 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbd411640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:58.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbe413640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.836+0000 7f5dbdc12640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5db400bd30 tx=0x7f5db4009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.837+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011250 con 0x7f5db8100e20 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.837+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5db40113f0 con 0x7f5db8100e20 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.837+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db8197040 con 0x7f5db8100e20 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.837+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db401a900 con 0x7f5db8100e20 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.837+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db8197530 con 0x7f5db8100e20 2024-09-19T05:21:58.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.838+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db8101200 con 0x7f5db8100e20 2024-09-19T05:21:58.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.840+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5db40106e0 con 0x7f5db8100e20 2024-09-19T05:21:58.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.841+0000 7f5daeffd640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 0x7f5da40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.841+0000 7f5dbd411640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 0x7f5da40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.841+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5db40d4110 con 0x7f5db8100e20 2024-09-19T05:21:58.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.842+0000 7f5dbd411640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 0x7f5da40a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5db806ab00 tx=0x7f5da8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:58.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:58.844+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5db4016070 con 0x7f5db8100e20 2024-09-19T05:21:58.965 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:58 smithi001 ceph-mon[30968]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:59.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.136+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5db81977f0 con 0x7f5db8100e20 2024-09-19T05:21:59.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.138+0000 7f5daeffd640 1 -- 172.21.15.1:0/1796657746 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f5db40a0a80 con 0x7f5db8100e20 2024-09-19T05:21:59.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:21:59.140 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:21:59.140 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:21:59.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 msgr2=0x7f5da40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:59.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 0x7f5da40a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5db806ab00 tx=0x7f5da8005a20 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 msgr2=0x7f5db8199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5db400bd30 tx=0x7f5db4009610 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 shutdown_connections 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5da40a3240 0x7f5da40a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5db8102ef0 0x7f5db81a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db8102570 0x7f5db8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 --2- 172.21.15.1:0/1796657746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db8100e20 0x7f5db8199250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 >> 172.21.15.1:0/1796657746 conn(0x7f5db80fc7d0 msgr2=0x7f5db80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 shutdown_connections 2024-09-19T05:21:59.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:21:59.141+0000 7f5dbfe76640 1 -- 172.21.15.1:0/1796657746 wait complete. 2024-09-19T05:21:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:58 smithi060 ceph-mon[35058]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:58 smithi082 ceph-mon[35195]: pgmap v375: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-19T05:21:59.963 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 57d41255 --release --await' 2024-09-19T05:21:59.964 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 57d41255 --release --await 2024-09-19T05:22:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:21:59 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1796657746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:21:59 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1796657746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:00.315 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:21:59 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1796657746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3601023102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102ef0 msgr2=0x7fc50410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3601023102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102ef0 0x7fc50410da40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009ca0 tx=0x7fc4fc02a950 comp rx=0 tx=0).stop 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3601023102 shutdown_connections 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3601023102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102ef0 0x7fc50410da40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3601023102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102570 0x7fc5041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3601023102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504100e20 0x7fc504101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3601023102 >> 172.21.15.1:0/3601023102 conn(0x7fc5040fc7d0 msgr2=0x7fc5040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3601023102 shutdown_connections 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.818+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3601023102 wait complete. 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 Processor -- start 2024-09-19T05:22:00.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 -- start start 2024-09-19T05:22:00.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504102570 0x7fc50406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102ef0 0x7fc50406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc504110f80 con 0x7fc504100e20 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc504110e00 con 0x7fc504102570 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.819+0000 7fc50bf1f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc504111100 con 0x7fc504102ef0 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49604/0 (socket says 172.21.15.1:49604) 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 -- 172.21.15.1:0/3590494912 learned_addr learned my addr 172.21.15.1:0/3590494912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc5094ba640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504102570 0x7fc50406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102ef0 0x7fc50406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 -- 172.21.15.1:0/3590494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102ef0 msgr2=0x7fc50406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102ef0 0x7fc50406dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 -- 172.21.15.1:0/3590494912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504102570 msgr2=0x7fc50406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504102570 0x7fc50406daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 -- 172.21.15.1:0/3590494912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50406e5d0 con 0x7fc504100e20 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.820+0000 7fc509cbb640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc50000e9f0 tx=0x7fc50000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.821+0000 7fc4faffd640 1 -- 172.21.15.1:0/3590494912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50000cd00 con 0x7fc504100e20 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.821+0000 7fc4faffd640 1 -- 172.21.15.1:0/3590494912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc500010910 con 0x7fc504100e20 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.821+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50406e8c0 con 0x7fc504100e20 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.821+0000 7fc4faffd640 1 -- 172.21.15.1:0/3590494912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000189c0 con 0x7fc504100e20 2024-09-19T05:22:00.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.821+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc504107d80 con 0x7fc504100e20 2024-09-19T05:22:00.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.824+0000 7fc50e2f8740 1 Processor -- start 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.824+0000 7fc50e2f8740 1 -- start start 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51bf6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c09510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f51b5b620 con 0x558f51bf68a0 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558f51b02e50 con 0x558f51bf5f80 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558f51b575e0 con 0x558f51c09a50 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:49638/0 (socket says 172.21.15.1:49638) 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 -- 172.21.15.1:0/1408282842 learned_addr learned my addr 172.21.15.1:0/1408282842 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:00.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51bf6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 -- 172.21.15.1:0/1408282842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 msgr2=0x558f51bf6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51bf6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 -- 172.21.15.1:0/1408282842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 msgr2=0x558f51c09510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c09510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc4faffd640 1 -- 172.21.15.1:0/3590494912 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc500010ac0 con 0x7fc504100e20 2024-09-19T05:22:00.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.825+0000 7fc5094ba640 1 -- 172.21.15.1:0/1408282842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f51af3d40 con 0x558f51c09a50 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.826+0000 7fc5094ba640 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4004600 tx=0x7fc4f400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d8911118d76203 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.826+0000 7fc4effff640 1 -- 172.21.15.1:0/1408282842 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4003bd0 con 0x558f51c09a50 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.826+0000 7fc4effff640 1 -- 172.21.15.1:0/1408282842 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4015070 con 0x558f51c09a50 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.826+0000 7fc4effff640 1 -- 172.21.15.1:0/1408282842 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004d90 con 0x558f51c09a50 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc4faffd640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 0x7fc4f00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 0x7fc4f00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc4faffd640 1 -- 172.21.15.1:0/3590494912 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc5000d0140 con 0x7fc504100e20 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 -- 172.21.15.1:0/1408282842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 msgr2=0x558f51c0be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4004600 tx=0x7fc4f400bb20 comp rx=0 tx=0).stop 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 -- 172.21.15.1:0/1408282842 shutdown_connections 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51c09a50 0x558f51c0be40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c09510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/1408282842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51bf6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.827+0000 7fc50e2f8740 1 -- 172.21.15.1:0/1408282842 >> 172.21.15.1:0/1408282842 conn(0x558f51bf25f0 msgr2=0x558f51bf29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.828+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 0x7fc4f00a57c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc005e30 tx=0x7fc4fc009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.828+0000 7fc50e2f8740 1 -- 172.21.15.1:0/1408282842 shutdown_connections 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.828+0000 7fc50e2f8740 1 -- 172.21.15.1:0/1408282842 wait complete. 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.828+0000 7fc50e2f8740 1 -- start start 2024-09-19T05:22:00.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.828+0000 7fc50e2f8740 1 Processor -- start 2024-09-19T05:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c03540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51c09a50 0x558f51c092c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558f51bf8ee0 con 0x558f51bf68a0 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558f51ae3f10 con 0x558f51c09a50 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558f51bf9060 con 0x558f51bf5f80 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50e2f8740 10 client.0 _ll_register_callbacks cb 0x558f51b07db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc5094ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc5094ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49608/0 (socket says 172.21.15.1:49608) 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc5094ba640 1 -- 172.21.15.1:0/2131748106 learned_addr learned my addr 172.21.15.1:0/2131748106 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c03540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.829+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51c09a50 0x558f51c092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 -- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 msgr2=0x558f51c03540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c03540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 -- 172.21.15.1:0/2131748106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51c09a50 msgr2=0x558f51c092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51c09a50 0x558f51c092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 -- 172.21.15.1:0/2131748106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f5186a580 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c03540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc5094ba640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40039c0 tx=0x7fc4f4003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c693d3b30d96e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc4ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004cd0 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f4015070 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc4f4005020 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.830+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc4f4005220 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 10 client.15243 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558f51934960 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4015070 con 0x558f51bf68a0 2024-09-19T05:22:00.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc4f4011440 con 0x558f51bf68a0 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 10 client.15243 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 10 client.15243 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 20 client.15243 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.831+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c21d40 0x558f51c24130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.832+0000 7fc50e2f8740 4 client.15243 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.832+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f51b68b90 con 0x558f51c21d40 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.832+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c21d40 0x558f51c24130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.832+0000 7fc4ed7fa640 10 client.15243 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.833+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c21d40 0x558f51c24130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eace24e9dc7e2ca1 server_cookie=3f3e98a550359483 in_seq=0 out_seq=0 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.833+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2131748106 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f51b68b90 con 0x558f51c21d40 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.833+0000 7fc4ed7fa640 10 client.15243 handle_command_reply: tid=0 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.833+0000 7fc50e2f8740 1 client.15243 shutdown 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.833+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 msgr2=0x558f51c03a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40039c0 tx=0x7fc4f4003bd0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 shutdown_connections 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51c09a50 0x558f51c092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51bf68a0 0x558f51c03a80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c21d40 0x558f51c24130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2131748106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c03540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 >> 172.21.15.1:0/2131748106 conn(0x558f51bf25f0 msgr2=0x558f51bf1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc4ed7fa640 0 client.15243 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 shutdown_connections 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2131748106 wait complete. 2024-09-19T05:22:00.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.834+0000 7fc50e2f8740 20 client.15243 trim_cache size 0 max 16384 2024-09-19T05:22:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.865+0000 7fc50e2f8740 1 Processor -- start 2024-09-19T05:22:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.865+0000 7fc50e2f8740 1 -- start start 2024-09-19T05:22:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c09230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 0x558f51bfd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b3380 con 0x558f51c09a50 2024-09-19T05:22:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b5c00 con 0x558f51bf68a0 2024-09-19T05:22:00.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b39f0 con 0x558f51bf5f80 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49624/0 (socket says 172.21.15.1:49624) 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2445343951 learned_addr learned my addr 172.21.15.1:0/2445343951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc5094ba640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 0x558f51bfd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c09230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2445343951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 msgr2=0x558f51c09230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c09230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2445343951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 msgr2=0x558f51bfd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 0x558f51bfd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2445343951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f51c03df0 con 0x558f51c09a50 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.866+0000 7fc5094ba640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 0x558f51bfd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.867+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc035000 tx=0x7fc4fc040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c601c1e622c1b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.867+0000 7fc4ef7fe640 1 -- 172.21.15.1:0/2445343951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc034040 con 0x558f51c09a50 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.867+0000 7fc4ef7fe640 1 -- 172.21.15.1:0/2445343951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4fc02fe10 con 0x558f51c09a50 2024-09-19T05:22:00.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.867+0000 7fc4ef7fe640 1 -- 172.21.15.1:0/2445343951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc030440 con 0x558f51c09a50 2024-09-19T05:22:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2445343951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 msgr2=0x558f51c298f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc035000 tx=0x7fc4fc040000 comp rx=0 tx=0).stop 2024-09-19T05:22:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2445343951 shutdown_connections 2024-09-19T05:22:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c298f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf68a0 0x558f51bfd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2445343951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf5f80 0x558f51c09230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2445343951 >> 172.21.15.1:0/2445343951 conn(0x558f51bf25f0 msgr2=0x558f51bf8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2445343951 shutdown_connections 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.868+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2445343951 wait complete. 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 -- start start 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 Processor -- start 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51c31a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf68a0 0x558f51c31fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b40c0 con 0x558f51c09a50 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b5530 con 0x558f51bf5f80 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc5041b4790 con 0x558f51bf68a0 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.869+0000 7fc50e2f8740 10 client.0 _ll_register_callbacks cb 0x7fc4f4004750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:00.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49630/0 (socket says 172.21.15.1:49630) 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2644184644 learned_addr learned my addr 172.21.15.1:0/2644184644 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51c31a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf68a0 msgr2=0x558f51c31fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf68a0 0x558f51c31fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2644184644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 msgr2=0x558f51c31a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:00.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51c31a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 -- 172.21.15.1:0/2644184644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f51c8bc80 con 0x558f51c09a50 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51c31a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc50a4bc640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc042040 tx=0x7fc4fc02f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f8e95f395fac4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.870+0000 7fc4ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc056070 con 0x558f51c09a50 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc4fc004040 con 0x558f51c09a50 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4fc02fe10 con 0x558f51c09a50 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc4fc062050 con 0x558f51c09a50 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 10 client.15249 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558f51c8cf90 con 0x558f51c09a50 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4fc02fe10 con 0x558f51c09a50 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc4fc052430 con 0x558f51c09a50 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 10 client.15249 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 10 client.15249 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 20 client.15249 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c8d600 0x558f51c8fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.871+0000 7fc50e2f8740 4 client.15249 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "57d41255", "release": true, "await": true}] 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.872+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "57d41255", "release": true, "await": true}) -- 0x558f51b630a0 con 0x558f51c8d600 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.872+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c8d600 0x558f51c8fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.872+0000 7fc4ed7fa640 10 client.15249 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.872+0000 7fc509cbb640 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c8d600 0x558f51c8fa40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41296eaf09d9d03 server_cookie=296e768400947bf4 in_seq=0 out_seq=0 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.873+0000 7fc4ed7fa640 1 -- 172.21.15.1:0/2644184644 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558f51b630a0 con 0x558f51c8d600 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.873+0000 7fc4ed7fa640 10 client.15249 handle_command_reply: tid=0 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.873+0000 7fc50e2f8740 1 client.15249 shutdown 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 msgr2=0x558f51c8b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc042040 tx=0x7fc4fc02f5a0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 shutdown_connections 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558f51c09a50 0x558f51c8b740 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558f51c8d600 0x558f51c8fa40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558f51bf68a0 0x558f51c31fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 --2- 172.21.15.1:0/2644184644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f51bf5f80 0x558f51c31a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 >> 172.21.15.1:0/2644184644 conn(0x558f51bf25f0 msgr2=0x558f51bf7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc4ed7fa640 0 client.15249 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 shutdown_connections 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 1 -- 172.21.15.1:0/2644184644 wait complete. 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.874+0000 7fc50e2f8740 20 client.15249 trim_cache size 0 max 16384 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:22:00.880 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 4, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "57d41255": { 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 4, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:22:00.881 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:00.882 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:22:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 msgr2=0x7fc4f00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 0x7fc4f00a57c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc005e30 tx=0x7fc4fc009880 comp rx=0 tx=0).stop 2024-09-19T05:22:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 msgr2=0x7fc504073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc50000e9f0 tx=0x7fc50000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 shutdown_connections 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc4f00a3300 0x7fc4f00a57c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc504102ef0 0x7fc50406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc504102570 0x7fc50406daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 --2- 172.21.15.1:0/3590494912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504100e20 0x7fc504073a20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.875+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 >> 172.21.15.1:0/3590494912 conn(0x7fc5040fc7d0 msgr2=0x7fc504103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.876+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 shutdown_connections 2024-09-19T05:22:00.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:00.876+0000 7fc50bf1f640 1 -- 172.21.15.1:0/3590494912 wait complete. 2024-09-19T05:22:01.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:00 smithi060 ceph-mon[35058]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:01.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:00 smithi082 ceph-mon[35195]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:00 smithi001 ceph-mon[30968]: pgmap v376: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:01.619 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '57d41255', total seconds elapsed: 14.8 2024-09-19T05:22:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:02 smithi060 ceph-mon[35058]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:03.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:02 smithi082 ceph-mon[35195]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:02 smithi001 ceph-mon[30968]: pgmap v377: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-19T05:22:05.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:04 smithi060 ceph-mon[35058]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:22:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:04 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:04 smithi082 ceph-mon[35195]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:22:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:04 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:05.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:04 smithi001 ceph-mon[30968]: pgmap v378: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-19T05:22:05.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:05.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:05.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:04 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:06.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:06.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:06.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:05 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:05 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:06.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:06.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:06.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:05 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:22:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:07 smithi082 ceph-mon[35195]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:07 smithi001 ceph-mon[30968]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:07.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:07 smithi060 ceph-mon[35058]: pgmap v379: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:09 smithi001 ceph-mon[30968]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:09.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:09 smithi060 ceph-mon[35058]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:09.763 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:09 smithi082 ceph-mon[35195]: pgmap v380: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:11 smithi001 ceph-mon[30968]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:11 smithi060 ceph-mon[35058]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:11 smithi082 ceph-mon[35195]: pgmap v381: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:13 smithi001 ceph-mon[30968]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:13.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:13 smithi060 ceph-mon[35058]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:13 smithi082 ceph-mon[35195]: pgmap v382: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:15 smithi001 ceph-mon[30968]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:15.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:15 smithi060 ceph-mon[35058]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:15 smithi082 ceph-mon[35195]: pgmap v383: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:17 smithi001 ceph-mon[30968]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:17.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:17 smithi060 ceph-mon[35058]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:17 smithi082 ceph-mon[35195]: pgmap v384: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:19 smithi001 ceph-mon[30968]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:19.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:19 smithi060 ceph-mon[35058]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:19 smithi082 ceph-mon[35195]: pgmap v385: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:21.553 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:21 smithi060 ceph-mon[35058]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:21.560 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:21 smithi082 ceph-mon[35195]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:21 smithi001 ceph-mon[30968]: pgmap v386: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:22.421 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:22:22.421 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T05:22:22.422 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:22:22.705 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/3878064735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0102d30 msgr2=0x7fa3f0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/3878064735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0102d30 0x7fa3f0103110 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009930 tx=0x7fa3e002a420 comp rx=0 tx=0).stop 2024-09-19T05:22:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/3878064735 shutdown_connections 2024-09-19T05:22:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/3878064735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f01082a0 0x7fa3f010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/3878064735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/3878064735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f0102d30 0x7fa3f0103110 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/3878064735 >> 172.21.15.1:0/3878064735 conn(0x7fa3f00fc7d0 msgr2=0x7fa3f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/3878064735 shutdown_connections 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.173+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/3878064735 wait complete. 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.174+0000 7fa3f5ca2640 1 Processor -- start 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.174+0000 7fa3f5ca2640 1 -- start start 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 0x7fa3f019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:50664/0 (socket says 172.21.15.1:50664) 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3effff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 0x7fa3f019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3ef7fe640 1 -- 172.21.15.1:0/1784000880 learned_addr learned my addr 172.21.15.1:0/1784000880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f01120a0 con 0x7fa3f01082a0 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0111f20 con 0x7fa3f01036e0 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112220 con 0x7fa3f0102d30 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3ef7fe640 1 -- 172.21.15.1:0/1784000880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 msgr2=0x7fa3f0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.175+0000 7fa3ef7fe640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ef7fe640 1 -- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 msgr2=0x7fa3f019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ef7fe640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 0x7fa3f019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ef7fe640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f019d550 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3effff640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 0x7fa3f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ef7fe640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009230 tx=0x7fa3e0004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e003f030 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3e0003ad0 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f019d7e0 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0035070 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.176+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f019dc70 con 0x7fa3f0102d30 2024-09-19T05:22:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.178+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f0103110 con 0x7fa3f0102d30 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.179+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa3e0042030 con 0x7fa3f0102d30 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.179+0000 7fa3ecff9640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 0x7fa3d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.180+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa3e00efe60 con 0x7fa3f0102d30 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.180+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 0x7fa3d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.180+0000 7fa3eeffd640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 0x7fa3d80a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00fee00 tx=0x7fa3e400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.184+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3e00bc770 con 0x7fa3f0102d30 2024-09-19T05:22:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:23 smithi001 ceph-mon[30968]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.400+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f010a2b0 con 0x7fa3f0102d30 2024-09-19T05:22:23.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.401+0000 7fa3ecff9640 1 -- 172.21.15.1:0/1784000880 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fa3e00bc070 con 0x7fa3f0102d30 2024-09-19T05:22:23.404 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:22:23.404 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:22:23.404 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.403+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 msgr2=0x7fa3d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.403+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 0x7fa3d80a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00fee00 tx=0x7fa3e400b5f0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.403+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 msgr2=0x7fa3f01985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.403+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009230 tx=0x7fa3e0004270 comp rx=0 tx=0).stop 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.403+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 shutdown_connections 2024-09-19T05:22:23.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3d80a32c0 0x7fa3d80a5780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3f01082a0 0x7fa3f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3f01036e0 0x7fa3f0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 --2- 172.21.15.1:0/1784000880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f0102d30 0x7fa3f01985a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 >> 172.21.15.1:0/1784000880 conn(0x7fa3f00fc7d0 msgr2=0x7fa3f0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 shutdown_connections 2024-09-19T05:22:23.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:23.404+0000 7fa3f5ca2640 1 -- 172.21.15.1:0/1784000880 wait complete. 2024-09-19T05:22:23.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:23 smithi060 ceph-mon[35058]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:23 smithi082 ceph-mon[35195]: pgmap v387: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:24.145 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T05:22:24.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T05:22:24.445 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:24.567 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:24 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1784000880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:24.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:24 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1784000880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:24.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:24 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1784000880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 -- 172.21.15.1:0/3891271040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c101df0 msgr2=0x7f117c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 --2- 172.21.15.1:0/3891271040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c101df0 0x7f117c1021d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f116c009ca0 tx=0x7f116c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 -- 172.21.15.1:0/3891271040 shutdown_connections 2024-09-19T05:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 --2- 172.21.15.1:0/3891271040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c106f20 0x7f117c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 --2- 172.21.15.1:0/3891271040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 --2- 172.21.15.1:0/3891271040 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c101df0 0x7f117c1021d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 -- 172.21.15.1:0/3891271040 >> 172.21.15.1:0/3891271040 conn(0x7f117c0fd8f0 msgr2=0x7f117c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 -- 172.21.15.1:0/3891271040 shutdown_connections 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.236+0000 7f11846dc640 1 -- 172.21.15.1:0/3891271040 wait complete. 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 Processor -- start 2024-09-19T05:22:25.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 -- start start 2024-09-19T05:22:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 0x7f117c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f117c111f80 con 0x7f117c106f20 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f117c111e00 con 0x7f117c1027a0 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f11846dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f117c112100 con 0x7f117c101df0 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f1182c79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f1182c79640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59976/0 (socket says 172.21.15.1:59976) 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.237+0000 7f1182c79640 1 -- 172.21.15.1:0/1943431347 learned_addr learned my addr 172.21.15.1:0/1943431347 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1181c77640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182478640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 0x7f117c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 -- 172.21.15.1:0/1943431347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 msgr2=0x7f117c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 0x7f117c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 -- 172.21.15.1:0/1943431347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 msgr2=0x7f117c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 -- 172.21.15.1:0/1943431347 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c19d400 con 0x7f117c106f20 2024-09-19T05:22:25.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182478640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 0x7f117c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1181c77640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f1182c79640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f117400d750 tx=0x7f117400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f117b7fe640 1 -- 172.21.15.1:0/1943431347 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174017070 con 0x7f117c106f20 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c19d6f0 con 0x7f117c106f20 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f117b7fe640 1 -- 172.21.15.1:0/1943431347 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1174005500 con 0x7f117c106f20 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f117b7fe640 1 -- 172.21.15.1:0/1943431347 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174004d90 con 0x7f117c106f20 2024-09-19T05:22:25.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.238+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c1a4fd0 con 0x7f117c106f20 2024-09-19T05:22:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f117b7fe640 1 -- 172.21.15.1:0/1943431347 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1174004f30 con 0x7f117c106f20 2024-09-19T05:22:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 Processor -- start 2024-09-19T05:22:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 -- start start 2024-09-19T05:22:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658f4e40 0x5644658f7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56446584a160 con 0x5644658e9c60 2024-09-19T05:22:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5644657f1720 con 0x5644658ea580 2024-09-19T05:22:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.241+0000 7f1186ab5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564465846120 con 0x5644658f4e40 2024-09-19T05:22:25.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f117b7fe640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 0x7f11640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59990/0 (socket says 172.21.15.1:59990) 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 -- 172.21.15.1:0/2911122248 learned_addr learned my addr 172.21.15.1:0/2911122248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1182478640 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f117b7fe640 1 -- 172.21.15.1:0/1943431347 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f11740cf6c0 con 0x7f117c106f20 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1182c79640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 0x7f11640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658f4e40 0x5644658f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 -- 172.21.15.1:0/2911122248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658f4e40 msgr2=0x5644658f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658f4e40 0x5644658f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 -- 172.21.15.1:0/2911122248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 msgr2=0x5644658f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1181c77640 1 -- 172.21.15.1:0/2911122248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644655bbba0 con 0x5644658e9c60 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.242+0000 7f1182c79640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 0x7f11640a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f117409b8c0 tx=0x7f1174009bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1181c77640 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f11700058c0 tx=0x7f117000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10674bae19963cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1178ff9640 1 -- 172.21.15.1:0/2911122248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170019030 con 0x5644658e9c60 2024-09-19T05:22:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1178ff9640 1 -- 172.21.15.1:0/2911122248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1170011a20 con 0x5644658e9c60 2024-09-19T05:22:25.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1178ff9640 1 -- 172.21.15.1:0/2911122248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117001db30 con 0x5644658e9c60 2024-09-19T05:22:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1186ab5740 1 -- 172.21.15.1:0/2911122248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 msgr2=0x5644658ea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.243+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f11700058c0 tx=0x7f117000b730 comp rx=0 tx=0).stop 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 -- 172.21.15.1:0/2911122248 shutdown_connections 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658f4e40 0x5644658f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2911122248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658e9c60 0x5644658ea040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 -- 172.21.15.1:0/2911122248 >> 172.21.15.1:0/2911122248 conn(0x5644658e61f0 msgr2=0x5644658e65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 -- 172.21.15.1:0/2911122248 shutdown_connections 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 -- 172.21.15.1:0/2911122248 wait complete. 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 -- start start 2024-09-19T05:22:25.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 Processor -- start 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.244+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1186ab5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5644658f7a10 con 0x5644658f4e40 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1186ab5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5644657d2900 con 0x5644658ea580 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1186ab5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5644658f7b90 con 0x5644658e9c60 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1186ab5740 10 client.0 _ll_register_callbacks cb 0x5644657d0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59992/0 (socket says 172.21.15.1:59992) 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 -- 172.21.15.1:0/4042323276 learned_addr learned my addr 172.21.15.1:0/4042323276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1182478640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 -- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 msgr2=0x5644658f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 -- 172.21.15.1:0/4042323276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 msgr2=0x5644658f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 -- 172.21.15.1:0/4042323276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564465812c50 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1181c77640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f117001d810 tx=0x7f117001d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5e92cdee770cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.245+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170019040 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1170011a20 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1170011bd0 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1170032050 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 10 client.15267 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5644659036d0 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1170011a20 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1170005030 con 0x5644658f4e40 2024-09-19T05:22:25.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 10 client.15267 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 10 client.15267 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 20 client.15267 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x564465906ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 4 client.15267 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.246+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564465857890 con 0x564465904ae0 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.247+0000 7f1182478640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x564465906ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.247+0000 7f1182478640 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x564465906ed0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a9f1acadcb6ae0 server_cookie=cea51f7abada2d5d in_seq=0 out_seq=0 2024-09-19T05:22:25.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.247+0000 7f1161ffb640 10 client.15267 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:25.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1161ffb640 1 -- 172.21.15.1:0/4042323276 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564465857890 con 0x564465904ae0 2024-09-19T05:22:25.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1161ffb640 10 client.15267 handle_command_reply: tid=0 2024-09-19T05:22:25.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 client.15267 shutdown 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 msgr2=0x5644658f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f117001d810 tx=0x7f117001d710 comp rx=0 tx=0).stop 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 shutdown_connections 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x5644658f27c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x5644658f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x564465906ed0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1161ffb640 0 client.15267 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 --2- 172.21.15.1:0/4042323276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 >> 172.21.15.1:0/4042323276 conn(0x5644658e61f0 msgr2=0x5644658ebf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 shutdown_connections 2024-09-19T05:22:25.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 1 -- 172.21.15.1:0/4042323276 wait complete. 2024-09-19T05:22:25.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.248+0000 7f1186ab5740 20 client.15267 trim_cache size 0 max 16384 2024-09-19T05:22:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.265+0000 7f1186ab5740 1 Processor -- start 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.265+0000 7f1186ab5740 1 -- start start 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.265+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.265+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x564465909ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1186ab5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1aac40 con 0x5644658f4e40 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1186ab5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1ad4c0 con 0x5644658ea580 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1186ab5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1ab2b0 con 0x5644658e9c60 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60002/0 (socket says 172.21.15.1:60002) 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 -- 172.21.15.1:0/143459820 learned_addr learned my addr 172.21.15.1:0/143459820 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1182478640 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x564465909ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 -- 172.21.15.1:0/143459820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 msgr2=0x5644658f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 -- 172.21.15.1:0/143459820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 msgr2=0x564465909ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x564465909ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 -- 172.21.15.1:0/143459820 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644658dd3f0 con 0x5644658f4e40 2024-09-19T05:22:25.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1181c77640 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f117001d520 tx=0x7f11700045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a546d517058fcc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.266+0000 7f1163fff640 1 -- 172.21.15.1:0/143459820 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170019070 con 0x5644658f4e40 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1163fff640 1 -- 172.21.15.1:0/143459820 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1170005620 con 0x5644658f4e40 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1163fff640 1 -- 172.21.15.1:0/143459820 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11700117a0 con 0x5644658f4e40 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 -- 172.21.15.1:0/143459820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 msgr2=0x56446590a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f117001d520 tx=0x7f11700045a0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 -- 172.21.15.1:0/143459820 shutdown_connections 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x56446590a430 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658ea580 0x564465909ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 --2- 172.21.15.1:0/143459820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658e9c60 0x5644658f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 -- 172.21.15.1:0/143459820 >> 172.21.15.1:0/143459820 conn(0x5644658e61f0 msgr2=0x5644658f3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 -- 172.21.15.1:0/143459820 shutdown_connections 2024-09-19T05:22:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.267+0000 7f1186ab5740 1 -- 172.21.15.1:0/143459820 wait complete. 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 -- start start 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 Processor -- start 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658e9c60 0x56446590a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 0x5644659077d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1ab980 con 0x5644658f4e40 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1acdf0 con 0x5644658e9c60 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1ac050 con 0x5644658ea580 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1186ab5740 10 client.0 _ll_register_callbacks cb 0x7f116c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1181c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60008/0 (socket says 172.21.15.1:60008) 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1181c77640 1 -- 172.21.15.1:0/2103480731 learned_addr learned my addr 172.21.15.1:0/2103480731 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1181c77640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658e9c60 0x56446590a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.268+0000 7f1182478640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 0x5644659077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 -- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 msgr2=0x5644659077d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 0x5644659077d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 -- 172.21.15.1:0/2103480731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658e9c60 msgr2=0x56446590a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658e9c60 0x56446590a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 -- 172.21.15.1:0/2103480731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564465908350 con 0x5644658f4e40 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1182478640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 0x5644659077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1181c77640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f117000bd10 tx=0x7f1170015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3b6770791c304f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170019030 con 0x5644658f4e40 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f117000b3e0 con 0x5644658f4e40 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1170005620 con 0x5644658f4e40 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f117001dd90 con 0x5644658f4e40 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1186ab5740 10 client.15273 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56446596f230 con 0x5644658f4e40 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.269+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1170005620 con 0x5644658f4e40 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1170028070 con 0x5644658f4e40 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 10 client.15273 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 10 client.15273 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 20 client.15273 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x5644659718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 4 client.15273 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x564465851be0 con 0x564465904ae0 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1182478640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x5644659718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1182478640 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x5644659718b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c4db711d3277caa server_cookie=8b6a3bcf29529162 in_seq=0 out_seq=0 2024-09-19T05:22:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.270+0000 7f1161ffb640 10 client.15273 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1161ffb640 1 -- 172.21.15.1:0/2103480731 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564465851be0 con 0x564465904ae0 2024-09-19T05:22:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1161ffb640 10 client.15273 handle_command_reply: tid=0 2024-09-19T05:22:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 client.15273 shutdown 2024-09-19T05:22:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 msgr2=0x564465907d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f117000bd10 tx=0x7f1170015040 comp rx=0 tx=0).stop 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 shutdown_connections 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5644658f4e40 0x564465907d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564465904ae0 0x5644659718b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5644658ea580 0x5644659077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 --2- 172.21.15.1:0/2103480731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644658e9c60 0x56446590a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 >> 172.21.15.1:0/2103480731 conn(0x5644658e61f0 msgr2=0x5644658f1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1161ffb640 0 client.15273 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 shutdown_connections 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 1 -- 172.21.15.1:0/2103480731 wait complete. 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.274+0000 7f1186ab5740 20 client.15273 trim_cache size 0 max 16384 2024-09-19T05:22:25.278 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 6, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "339365af": { 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 6, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:22:25.279 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:25.280 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 msgr2=0x7f11640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 0x7f11640a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f117409b8c0 tx=0x7f1174009bd0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 msgr2=0x7f117c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f117400d750 tx=0x7f117400dc10 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 shutdown_connections 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f11640a3240 0x7f11640a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f117c106f20 0x7f117c19cd20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f117c1027a0 0x7f117c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 --2- 172.21.15.1:0/1943431347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101df0 0x7f117c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 >> 172.21.15.1:0/1943431347 conn(0x7f117c0fd8f0 msgr2=0x7f117c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 shutdown_connections 2024-09-19T05:22:25.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:25.275+0000 7f11846dc640 1 -- 172.21.15.1:0/1943431347 wait complete. 2024-09-19T05:22:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:25 smithi001 ceph-mon[30968]: pgmap v388: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:25 smithi060 ceph-mon[35058]: pgmap v388: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:25 smithi082 ceph-mon[35195]: pgmap v388: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:26.138 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '339365af', quiesce took 3.7 seconds. Will release after: 16.650000000000002 2024-09-19T05:22:26.513 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 90% (11650/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T05:22:27.279 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T05:22:27.280 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T05:22:27.284 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T05:22:27.313 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T05:22:27.315 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:22:27.316 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T05:22:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:27 smithi001 ceph-mon[30968]: pgmap v389: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:27 smithi060 ceph-mon[35058]: pgmap v389: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:27 smithi082 ceph-mon[35195]: pgmap v389: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:27.970 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T05:22:28.048 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T05:22:28.089 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:22:28.091 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:22:28.091 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T05:22:28.131 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:22:28.134 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:22:28.135 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T05:22:28.191 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-09-19T05:22:28.192 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-19T05:22:28.193 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-09-19T05:22:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:29 smithi001 ceph-mon[30968]: pgmap v390: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:29.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:29 smithi060 ceph-mon[35058]: pgmap v390: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:29 smithi082 ceph-mon[35195]: pgmap v390: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T05:22:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:31 smithi001 ceph-mon[30968]: pgmap v391: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:31 smithi060 ceph-mon[35058]: pgmap v391: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:31 smithi082 ceph-mon[35195]: pgmap v391: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:33 smithi001 ceph-mon[30968]: pgmap v392: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:33 smithi060 ceph-mon[35058]: pgmap v392: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:33 smithi082 ceph-mon[35195]: pgmap v392: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:35 smithi001 ceph-mon[30968]: pgmap v393: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:35 smithi060 ceph-mon[35058]: pgmap v393: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:35 smithi082 ceph-mon[35195]: pgmap v393: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:37.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:37 smithi001 ceph-mon[30968]: pgmap v394: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:37.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:37 smithi060 ceph-mon[35058]: pgmap v394: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:37 smithi082 ceph-mon[35195]: pgmap v394: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:39.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:39 smithi001 ceph-mon[30968]: pgmap v395: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:39.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:39 smithi060 ceph-mon[35058]: pgmap v395: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:39 smithi082 ceph-mon[35195]: pgmap v395: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:41.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:41 smithi001 ceph-mon[30968]: pgmap v396: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:41.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:41 smithi060 ceph-mon[35058]: pgmap v396: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:41 smithi082 ceph-mon[35195]: pgmap v396: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:42.790 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:22:43.064 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:43.460 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:43 smithi001 ceph-mon[30968]: pgmap v397: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 -- 172.21.15.1:0/2717226957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440101de0 msgr2=0x7f54401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 --2- 172.21.15.1:0/2717226957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440101de0 0x7f54401021c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5430009900 tx=0x7f543002a410 comp rx=0 tx=0).stop 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 -- 172.21.15.1:0/2717226957 shutdown_connections 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 --2- 172.21.15.1:0/2717226957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440106f10 0x7f544010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 --2- 172.21.15.1:0/2717226957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440102790 0x7f54401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 --2- 172.21.15.1:0/2717226957 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440101de0 0x7f54401021c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 -- 172.21.15.1:0/2717226957 >> 172.21.15.1:0/2717226957 conn(0x7f54400fd8c0 msgr2=0x7f54400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 -- 172.21.15.1:0/2717226957 shutdown_connections 2024-09-19T05:22:43.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.542+0000 7f5447eda640 1 -- 172.21.15.1:0/2717226957 wait complete. 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 Processor -- start 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 -- start start 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440101de0 0x7f544019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 0x7f544019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5440111f90 con 0x7f5440106f10 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5440111e10 con 0x7f5440101de0 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5447eda640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5440112110 con 0x7f5440102790 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5446477640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5446477640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35026/0 (socket says 172.21.15.1:35026) 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.543+0000 7f5446477640 1 -- 172.21.15.1:0/116390900 learned_addr learned my addr 172.21.15.1:0/116390900 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:43.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5445475640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 0x7f544019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5445c76640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440101de0 0x7f544019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 -- 172.21.15.1:0/116390900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 msgr2=0x7f544019acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 0x7f544019acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 -- 172.21.15.1:0/116390900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440101de0 msgr2=0x7f544019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440101de0 0x7f544019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 -- 172.21.15.1:0/116390900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544019f680 con 0x7f5440106f10 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5445475640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 0x7f544019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5446477640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f543800b970 tx=0x7f543800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438019070 con 0x7f5440106f10 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f543800cb40 con 0x7f5440106f10 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438007650 con 0x7f5440106f10 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544019f970 con 0x7f5440106f10 2024-09-19T05:22:43.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.544+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a7250 con 0x7f5440106f10 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.545+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54401021c0 con 0x7f5440106f10 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.547+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f543801c070 con 0x7f5440106f10 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.548+0000 7f543effd640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 0x7f54280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.548+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f54380cfec0 con 0x7f5440106f10 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.548+0000 7f5445c76640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 0x7f54280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.548+0000 7f5445c76640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 0x7f54280a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5430005ab0 tx=0x7f5430005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:43.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.551+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5438023030 con 0x7f5440106f10 2024-09-19T05:22:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:43 smithi060 ceph-mon[35058]: pgmap v397: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:43 smithi082 ceph-mon[35195]: pgmap v397: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-19T05:22:43.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.764+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f544019bad0 con 0x7f5440106f10 2024-09-19T05:22:43.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.765+0000 7f543effd640 1 -- 172.21.15.1:0/116390900 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f544019bad0 con 0x7f5440106f10 2024-09-19T05:22:43.766 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:22:43.767 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:22:43.767 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:22:43.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 msgr2=0x7f54280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 0x7f54280a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5430005ab0 tx=0x7f5430005a20 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 msgr2=0x7f544019efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f543800b970 tx=0x7f543800be30 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 shutdown_connections 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f54280a3240 0x7f54280a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5440106f10 0x7f544019efa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440102790 0x7f544019acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 --2- 172.21.15.1:0/116390900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5440101de0 0x7f544019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 >> 172.21.15.1:0/116390900 conn(0x7f54400fd8c0 msgr2=0x7f54400fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 shutdown_connections 2024-09-19T05:22:43.769 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:43.767+0000 7f5447eda640 1 -- 172.21.15.1:0/116390900 wait complete. 2024-09-19T05:22:44.416 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 339365af --release --await' 2024-09-19T05:22:44.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 339365af --release --await 2024-09-19T05:22:44.445 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:44 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/116390900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:44.679 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:44.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:44 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/116390900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:44.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:44 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/116390900' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:45.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 -- 172.21.15.1:0/3479203599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0106a80 msgr2=0x7fdea0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 --2- 172.21.15.1:0/3479203599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0106a80 0x7fdea0106e60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde90009930 tx=0x7fde9002a420 comp rx=0 tx=0).stop 2024-09-19T05:22:45.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 -- 172.21.15.1:0/3479203599 shutdown_connections 2024-09-19T05:22:45.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 --2- 172.21.15.1:0/3479203599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0101420 0x7fdea010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 --2- 172.21.15.1:0/3479203599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0100a80 0x7fdea0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 --2- 172.21.15.1:0/3479203599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0106a80 0x7fdea0106e60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 -- 172.21.15.1:0/3479203599 >> 172.21.15.1:0/3479203599 conn(0x7fdea00fc7a0 msgr2=0x7fdea00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 -- 172.21.15.1:0/3479203599 shutdown_connections 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.181+0000 7fdea50e6640 1 -- 172.21.15.1:0/3479203599 wait complete. 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 Processor -- start 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 -- start start 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0100a80 0x7fdea0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0106a80 0x7fdea019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0110e80 con 0x7fdea0101420 2024-09-19T05:22:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0110d00 con 0x7fdea0100a80 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fdea50e6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0111000 con 0x7fdea0106a80 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fde9e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fde9e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38956/0 (socket says 172.21.15.1:38956) 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.182+0000 7fde9e59c640 1 -- 172.21.15.1:0/2395038973 learned_addr learned my addr 172.21.15.1:0/2395038973 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0106a80 0x7fdea019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0100a80 0x7fdea0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 -- 172.21.15.1:0/2395038973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0106a80 msgr2=0x7fdea019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0106a80 0x7fdea019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 -- 172.21.15.1:0/2395038973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0100a80 msgr2=0x7fdea0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0100a80 0x7fdea0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 -- 172.21.15.1:0/2395038973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea019d410 con 0x7fdea0101420 2024-09-19T05:22:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde9e59c640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c970 tx=0x7fde9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde87fff640 1 -- 172.21.15.1:0/2395038973 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94007bb0 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea019d700 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde87fff640 1 -- 172.21.15.1:0/2395038973 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94007d50 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fde87fff640 1 -- 172.21.15.1:0/2395038973 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9400f450 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.183+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a4fe0 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.185+0000 7fde87fff640 1 -- 172.21.15.1:0/2395038973 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fde94005020 con 0x7fdea0101420 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 Processor -- start 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 -- start start 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039a3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8038fb620 con 0x55d803996060 2024-09-19T05:22:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d8038a2e50 con 0x55d803996980 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fdea74bf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8038f75e0 con 0x55d8039a1240 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38970/0 (socket says 172.21.15.1:38970) 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 -- 172.21.15.1:0/1865050791 learned_addr learned my addr 172.21.15.1:0/1865050791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde87fff640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 -- 172.21.15.1:0/1865050791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 msgr2=0x55d8039a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 -- 172.21.15.1:0/1865050791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 msgr2=0x55d8039a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.186+0000 7fde9f59e640 1 -- 172.21.15.1:0/1865050791 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d803893d40 con 0x55d803996060 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde9f59e640 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fde98009f70 tx=0x7fde98010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99c9ebdec847c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde87fff640 1 -- 172.21.15.1:0/2395038973 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fde940cfaa0 con 0x7fdea0101420 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde857fa640 1 -- 172.21.15.1:0/1865050791 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98016070 con 0x55d803996060 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde857fa640 1 -- 172.21.15.1:0/1865050791 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde98012450 con 0x55d803996060 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.187+0000 7fde857fa640 1 -- 172.21.15.1:0/1865050791 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde980116e0 con 0x55d803996060 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- 172.21.15.1:0/1865050791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 msgr2=0x55d803996440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 0x7fde880a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde98011010 tx=0x7fde98011ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fde98009f70 tx=0x7fde98010800 comp rx=0 tx=0).stop 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- 172.21.15.1:0/1865050791 shutdown_connections 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 --2- 172.21.15.1:0/1865050791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803996440 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- 172.21.15.1:0/1865050791 >> 172.21.15.1:0/1865050791 conn(0x55d8039925f0 msgr2=0x55d8039929d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- 172.21.15.1:0/1865050791 shutdown_connections 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- 172.21.15.1:0/1865050791 wait complete. 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 -- start start 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 Processor -- start 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.188+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d803996060 0x55d80399e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d80399e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d8039a3e10 con 0x55d8039a1240 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d803883f10 con 0x55d803996980 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d8039a3f90 con 0x55d803996060 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 10 client.0 _ll_register_callbacks cb 0x55d8038a7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38984/0 (socket says 172.21.15.1:38984) 2024-09-19T05:22:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 -- 172.21.15.1:0/2765107164 learned_addr learned my addr 172.21.15.1:0/2765107164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9e59c640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d80399e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d803996060 0x55d80399e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 -- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d803996060 msgr2=0x55d80399e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d803996060 0x55d80399e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 -- 172.21.15.1:0/2765107164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 msgr2=0x55d80399e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d80399e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 -- 172.21.15.1:0/2765107164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80360a580 con 0x55d8039a1240 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde9f59e640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fde98006010 tx=0x7fde9801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4524fd79edda28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:45.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98035060 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fde9801bc30 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.189+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde98012450 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fde98016040 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 10 client.15291 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d8036d4960 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde98012450 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fde9800f040 con 0x55d8039a1240 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 10 client.15291 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 10 client.15291 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:45.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 20 client.15291 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d8039b0d50 0x55d8039b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 4 client.15291 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d803908b90 con 0x55d8039b0d50 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.190+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d8039b0d50 0x55d8039b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.191+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d8039b0d50 0x55d8039b3140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6452e3776a980e1 server_cookie=6a0f5e6e85c58c7a in_seq=0 out_seq=0 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.191+0000 7fde82ff5640 10 client.15291 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.191+0000 7fde82ff5640 1 -- 172.21.15.1:0/2765107164 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d803908b90 con 0x55d8039b0d50 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.191+0000 7fde82ff5640 10 client.15291 handle_command_reply: tid=0 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.191+0000 7fdea74bf740 1 client.15291 shutdown 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 msgr2=0x55d80399ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fde98006010 tx=0x7fde9801b000 comp rx=0 tx=0).stop 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 shutdown_connections 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d8039a1240 0x55d80399ebb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d80399e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d8039b0d50 0x55d8039b3140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fde82ff5640 0 client.15291 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2765107164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d803996060 0x55d80399e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 >> 172.21.15.1:0/2765107164 conn(0x55d8039925f0 msgr2=0x55d803998320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 shutdown_connections 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 1 -- 172.21.15.1:0/2765107164 wait complete. 2024-09-19T05:22:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.192+0000 7fdea74bf740 20 client.15291 trim_cache size 0 max 16384 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 Processor -- start 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 -- start start 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01ace10 con 0x55d803996060 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01af690 con 0x55d803996980 2024-09-19T05:22:45.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fdea74bf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01ad480 con 0x55d8039a1240 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38990/0 (socket says 172.21.15.1:38990) 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 -- 172.21.15.1:0/2982000383 learned_addr learned my addr 172.21.15.1:0/2982000383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9e59c640 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 -- 172.21.15.1:0/2982000383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 msgr2=0x55d8039b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 -- 172.21.15.1:0/2982000383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 msgr2=0x55d8039b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039b8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.209+0000 7fde9ed9d640 1 -- 172.21.15.1:0/2982000383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d803992420 con 0x55d803996060 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fde9002a940 tx=0x7fde90005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c345889307000c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fde84ff9640 1 -- 172.21.15.1:0/2982000383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90035040 con 0x55d803996060 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fde84ff9640 1 -- 172.21.15.1:0/2982000383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde90047070 con 0x55d803996060 2024-09-19T05:22:45.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fde84ff9640 1 -- 172.21.15.1:0/2982000383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90004920 con 0x55d803996060 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 -- 172.21.15.1:0/2982000383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 msgr2=0x55d803991640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fde9002a940 tx=0x7fde90005e70 comp rx=0 tx=0).stop 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 -- 172.21.15.1:0/2982000383 shutdown_connections 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d8039b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 --2- 172.21.15.1:0/2982000383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d803991640 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.210+0000 7fdea74bf740 1 -- 172.21.15.1:0/2982000383 >> 172.21.15.1:0/2982000383 conn(0x55d8039925f0 msgr2=0x55d803990f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- 172.21.15.1:0/2982000383 shutdown_connections 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- 172.21.15.1:0/2982000383 wait complete. 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- start start 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 Processor -- start 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d803a1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01adb50 con 0x55d803996060 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01aefc0 con 0x55d803996980 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01ae220 con 0x55d8039a1240 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fdea74bf740 10 client.0 _ll_register_callbacks cb 0x7fde98012c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38996/0 (socket says 172.21.15.1:38996) 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.211+0000 7fde9ed9d640 1 -- 172.21.15.1:0/295461342 learned_addr learned my addr 172.21.15.1:0/295461342 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9e59c640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9f59e640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d803a1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 -- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 msgr2=0x55d803a1a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d803a1a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 -- 172.21.15.1:0/295461342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 msgr2=0x55d8039a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 -- 172.21.15.1:0/295461342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d803993280 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9f59e640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d803a1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9e59c640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde9ed9d640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fde90032eb0 tx=0x7fde90004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5d1a7255753f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9004f020 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fde900035f0 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde90047070 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fde90035040 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fdea74bf740 10 client.15297 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d803a1be30 con 0x55d803996060 2024-09-19T05:22:45.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.212+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde900044b0 con 0x55d803996060 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fde90031ae0 con 0x55d803996060 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 10 client.15297 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 10 client.15297 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 20 client.15297 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d803a1c540 0x55d803a1e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 4 client.15297 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "339365af", "release": true, "await": true}] 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "339365af", "release": true, "await": true}) -- 0x7fde90047070 con 0x55d803a1c540 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fde9e59c640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d803a1c540 0x55d803a1e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fde9e59c640 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d803a1c540 0x55d803a1e930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5b048fc5a76d8d server_cookie=ad65b1caa962c316 in_seq=0 out_seq=0 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.213+0000 7fde82ff5640 10 client.15297 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fde82ff5640 1 -- 172.21.15.1:0/295461342 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fde90047070 con 0x55d803a1c540 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fde82ff5640 10 client.15297 handle_command_reply: tid=0 2024-09-19T05:22:45.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 client.15297 shutdown 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 msgr2=0x55d8039a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fde90032eb0 tx=0x7fde90004040 comp rx=0 tx=0).stop 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 shutdown_connections 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d803a1c540 0x55d803a1e930 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d8039a1240 0x55d803a1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d803996980 0x55d8039a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fde82ff5640 0 client.15297 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 --2- 172.21.15.1:0/295461342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d803996060 0x55d8039a5730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 >> 172.21.15.1:0/295461342 conn(0x55d8039925f0 msgr2=0x55d8039982d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 shutdown_connections 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 1 -- 172.21.15.1:0/295461342 wait complete. 2024-09-19T05:22:45.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.216+0000 7fdea74bf740 20 client.15297 trim_cache size 0 max 16384 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 8, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "339365af": { 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 8, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:22:45.226 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:45.227 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:45.228 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:45.228 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 msgr2=0x7fde880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 0x7fde880a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde98011010 tx=0x7fde98011ee0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 msgr2=0x7fdea01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c970 tx=0x7fde9400ce30 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 shutdown_connections 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fde880a3240 0x7fde880a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdea0106a80 0x7fdea019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdea0101420 0x7fdea01989a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 --2- 172.21.15.1:0/2395038973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea0100a80 0x7fdea0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 >> 172.21.15.1:0/2395038973 conn(0x7fdea00fc7a0 msgr2=0x7fdea006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 shutdown_connections 2024-09-19T05:22:45.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:45.217+0000 7fdea50e6640 1 -- 172.21.15.1:0/2395038973 wait complete. 2024-09-19T05:22:45.230 INFO:tasks.workunit.client.0.smithi001.stderr:+ dbench 1 2024-09-19T05:22:45.234 INFO:tasks.workunit.client.0.smithi001.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-19T05:22:45.234 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:22:45.234 INFO:tasks.workunit.client.0.smithi001.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-19T05:22:45.263 INFO:tasks.workunit.client.0.smithi001.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-19T05:22:45.363 INFO:tasks.workunit.client.0.smithi001.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-19T05:22:45.363 INFO:tasks.workunit.client.0.smithi001.stdout:releasing clients 2024-09-19T05:22:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:45 smithi001 ceph-mon[30968]: pgmap v398: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:45 smithi060 ceph-mon[35058]: pgmap v398: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:45.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:45 smithi082 ceph-mon[35195]: pgmap v398: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-19T05:22:45.998 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '339365af', total seconds elapsed: 23.6 2024-09-19T05:22:45.998 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T05:22:45.998 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:22:46.306 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:46.363 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3844 39.76 MB/sec warmup 1 sec latency 7.872 ms 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- 172.21.15.1:0/2378352181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80102790 msgr2=0x7efc801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 --2- 172.21.15.1:0/2378352181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80102790 0x7efc801067e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efc70009900 tx=0x7efc7002a410 comp rx=0 tx=0).stop 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- 172.21.15.1:0/2378352181 shutdown_connections 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 --2- 172.21.15.1:0/2378352181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80106f10 0x7efc8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 --2- 172.21.15.1:0/2378352181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80102790 0x7efc801067e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 --2- 172.21.15.1:0/2378352181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80101de0 0x7efc801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- 172.21.15.1:0/2378352181 >> 172.21.15.1:0/2378352181 conn(0x7efc800fd8c0 msgr2=0x7efc800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- 172.21.15.1:0/2378352181 shutdown_connections 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- 172.21.15.1:0/2378352181 wait complete. 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 Processor -- start 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.773+0000 7efc86e98640 1 -- start start 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 0x7efc801984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 0x7efc801989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc80111f70 con 0x7efc80106f10 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc80111df0 con 0x7efc80101de0 2024-09-19T05:22:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc86e98640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc801120f0 con 0x7efc80102790 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc84c34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 0x7efc801984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39012/0 (socket says 172.21.15.1:39012) 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 -- 172.21.15.1:0/3090852767 learned_addr learned my addr 172.21.15.1:0/3090852767 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc7ffff640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 0x7efc801989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 -- 172.21.15.1:0/3090852767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 msgr2=0x7efc801989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 0x7efc801989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 -- 172.21.15.1:0/3090852767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 msgr2=0x7efc801984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 0x7efc801984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 -- 172.21.15.1:0/3090852767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8019d460 con 0x7efc80106f10 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc84c34640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 0x7efc801984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc7ffff640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 0x7efc801989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:46.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.774+0000 7efc85435640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e970 tx=0x7efc6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.775+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6800ccc0 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.775+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc6800ce60 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.775+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc8019d750 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.775+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68010490 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.775+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc801a5030 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.776+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc801021c0 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.777+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7efc68005020 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.778+0000 7efc7dffb640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 0x7efc6c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.778+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7efc680d00c0 con 0x7efc80106f10 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.778+0000 7efc84c34640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 0x7efc6c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:46.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.778+0000 7efc84c34640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 0x7efc6c0a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc78005fd0 tx=0x7efc78009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:46.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:46.782+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc6809c9d0 con 0x7efc80106f10 2024-09-19T05:22:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.004+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc8010a180 con 0x7efc80106f10 2024-09-19T05:22:47.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.005+0000 7efc7dffb640 1 -- 172.21.15.1:0/3090852767 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7efc6809c2d0 con 0x7efc80106f10 2024-09-19T05:22:47.007 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:22:47.007 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:22:47.007 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:22:47.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 msgr2=0x7efc6c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:47.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 0x7efc6c0a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc78005fd0 tx=0x7efc78009500 comp rx=0 tx=0).stop 2024-09-19T05:22:47.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 msgr2=0x7efc8019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e970 tx=0x7efc6800ed70 comp rx=0 tx=0).stop 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 shutdown_connections 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc6c0a32c0 0x7efc6c0a5780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc80106f10 0x7efc8019cd80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc80102790 0x7efc801989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 --2- 172.21.15.1:0/3090852767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc80101de0 0x7efc801984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:47.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 >> 172.21.15.1:0/3090852767 conn(0x7efc800fd8c0 msgr2=0x7efc800fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 shutdown_connections 2024-09-19T05:22:47.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:47.008+0000 7efc86e98640 1 -- 172.21.15.1:0/3090852767 wait complete. 2024-09-19T05:22:47.363 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7336 29.44 MB/sec warmup 2 sec latency 51.013 ms 2024-09-19T05:22:47.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:47 smithi001 ceph-mon[30968]: pgmap v399: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:47.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:47 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3090852767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:47.715 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T05:22:47.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T05:22:47.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:47 smithi060 ceph-mon[35058]: pgmap v399: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:47.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:47 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3090852767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:47 smithi082 ceph-mon[35195]: pgmap v399: 129 pgs: 129 active+clean; 657 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T05:22:47.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:47 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3090852767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:47.990 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:48.363 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10709 25.61 MB/sec warmup 3 sec latency 37.111 ms 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/3490201933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 msgr2=0x7f9ad4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/3490201933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad4106e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009930 tx=0x7f9ac402a420 comp rx=0 tx=0).stop 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/3490201933 shutdown_connections 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/3490201933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 0x7f9ad410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/3490201933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/3490201933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad4106e60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/3490201933 >> 172.21.15.1:0/3490201933 conn(0x7f9ad40fc7a0 msgr2=0x7f9ad40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/3490201933 shutdown_connections 2024-09-19T05:22:48.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.500+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/3490201933 wait complete. 2024-09-19T05:22:48.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.501+0000 7f9ad8c5d640 1 Processor -- start 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.501+0000 7f9ad8c5d640 1 -- start start 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 0x7f9ad4197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4110e80 con 0x7f9ad4106a80 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4110d00 con 0x7f9ad4100a80 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad8c5d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4111000 con 0x7f9ad4101420 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 0x7f9ad4197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56024/0 (socket says 172.21.15.1:56024) 2024-09-19T05:22:48.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 -- 172.21.15.1:0/1554679344 learned_addr learned my addr 172.21.15.1:0/1554679344 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 -- 172.21.15.1:0/1554679344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 msgr2=0x7f9ad4197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 0x7f9ad4197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 -- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 msgr2=0x7f9ad419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad259c640 1 -- 172.21.15.1:0/1554679344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad419c2b0 con 0x7f9ad4100a80 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.502+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009230 tx=0x7f9ac4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9acbfff640 1 -- 172.21.15.1:0/1554679344 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac403f030 con 0x7f9ad4100a80 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad419c540 con 0x7f9ad4100a80 2024-09-19T05:22:48.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9acbfff640 1 -- 172.21.15.1:0/1554679344 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac4004440 con 0x7f9ad4100a80 2024-09-19T05:22:48.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9acbfff640 1 -- 172.21.15.1:0/1554679344 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4035070 con 0x7f9ad4100a80 2024-09-19T05:22:48.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.503+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad406a790 con 0x7f9ad4100a80 2024-09-19T05:22:48.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.506+0000 7f9acbfff640 1 -- 172.21.15.1:0/1554679344 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9ac4042030 con 0x7f9ad4100a80 2024-09-19T05:22:48.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.506+0000 7f9adb036740 1 Processor -- start 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.506+0000 7f9adb036740 1 -- start start 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d4a282f160 con 0x55d4a28cb170 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d4a27d6720 con 0x55d4a28ca850 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9adb036740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4a282b120 con 0x55d4a28d5a30 2024-09-19T05:22:48.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56030/0 (socket says 172.21.15.1:56030) 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39040/0 (socket says 172.21.15.1:39040) 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/3509099104 learned_addr learned my addr 172.21.15.1:0/3509099104 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9acbfff640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 0x7f9ac00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/3509099104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 msgr2=0x55d4a28d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/3509099104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 msgr2=0x55d4a28d54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9acbfff640 1 -- 172.21.15.1:0/1554679344 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9ac40effe0 con 0x7f9ad4100a80 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/3509099104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a25a0ba0 con 0x55d4a28ca850 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.507+0000 7f9ad259c640 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 0x7f9ac00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0118d0 tx=0x7f9acc011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f9cd618a4e572c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ac8d99640 1 -- 172.21.15.1:0/3509099104 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc017070 con 0x55d4a28ca850 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ac8d99640 1 -- 172.21.15.1:0/3509099104 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9acc0046a0 con 0x55d4a28ca850 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ac8d99640 1 -- 172.21.15.1:0/3509099104 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc01ce60 con 0x55d4a28ca850 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.508+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 0x7f9ac00a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9acc023000 tx=0x7f9acc024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- 172.21.15.1:0/3509099104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 msgr2=0x55d4a28cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0118d0 tx=0x7f9acc011d90 comp rx=0 tx=0).stop 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- 172.21.15.1:0/3509099104 shutdown_connections 2024-09-19T05:22:48.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 --2- 172.21.15.1:0/3509099104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28cac30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- 172.21.15.1:0/3509099104 >> 172.21.15.1:0/3509099104 conn(0x55d4a28c6de0 msgr2=0x55d4a28c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- 172.21.15.1:0/3509099104 shutdown_connections 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- 172.21.15.1:0/3509099104 wait complete. 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 -- start start 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.509+0000 7f9adb036740 1 Processor -- start 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d4a28d8600 con 0x55d4a28cb170 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d4a27b7900 con 0x55d4a28ca850 2024-09-19T05:22:48.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4a28d8780 con 0x55d4a28d5a30 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 10 client.0 _ll_register_callbacks cb 0x55d4a27b5780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39042/0 (socket says 172.21.15.1:39042) 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 -- 172.21.15.1:0/1628098798 learned_addr learned my addr 172.21.15.1:0/1628098798 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 -- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 msgr2=0x55d4a28d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 -- 172.21.15.1:0/1628098798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 msgr2=0x55d4a28d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28d2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 -- 172.21.15.1:0/1628098798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a27f7c50 con 0x55d4a28cb170 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9abc012730 tx=0x7f9abc012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446572162eb5891d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ab9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:48.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc004050 con 0x55d4a28cb170 2024-09-19T05:22:48.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9abc0041f0 con 0x55d4a28cb170 2024-09-19T05:22:48.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.510+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9acc0046a0 con 0x55d4a28cb170 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9abc025050 con 0x55d4a28cb170 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 10 client.15315 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d4a28e4360 con 0x55d4a28cb170 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9acc0046a0 con 0x55d4a28cb170 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9abc003950 con 0x55d4a28cb170 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 10 client.15315 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 10 client.15315 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 20 client.15315 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a28e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 4 client.15315 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:48.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4a283c890 con 0x55d4a28e5820 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.511+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a28e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a28e7c70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5ebfd84f90f57d server_cookie=dc4d0cea1be52dc0 in_seq=0 out_seq=0 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9ab9ffb640 10 client.15315 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1628098798 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4a283c890 con 0x55d4a28e5820 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9ab9ffb640 10 client.15315 handle_command_reply: tid=0 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 client.15315 shutdown 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 msgr2=0x55d4a28d2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9abc012730 tx=0x7f9abc012bf0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 shutdown_connections 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a28e7c70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28d5a30 0x55d4a28d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9ab9ffb640 0 client.15315 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28d2eb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 --2- 172.21.15.1:0/1628098798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28ca850 0x55d4a28d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.512+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 >> 172.21.15.1:0/1628098798 conn(0x55d4a28c6de0 msgr2=0x55d4a28ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.513+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 shutdown_connections 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.513+0000 7f9adb036740 1 -- 172.21.15.1:0/1628098798 wait complete. 2024-09-19T05:22:48.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.513+0000 7f9adb036740 20 client.15315 trim_cache size 0 max 16384 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 Processor -- start 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 -- start start 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28d5a30 0x55d4a28cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41acd60 con 0x55d4a28cb170 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41af5e0 con 0x55d4a28d5a30 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9adb036740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41ad3d0 con 0x55d4a28ca850 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:57064/0 (socket says 172.21.15.1:57064) 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 -- 172.21.15.1:0/3523440880 learned_addr learned my addr 172.21.15.1:0/3523440880 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39050/0 (socket says 172.21.15.1:39050) 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28d5a30 0x55d4a28cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 -- 172.21.15.1:0/3523440880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28d5a30 msgr2=0x55d4a28cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28d5a30 0x55d4a28cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 -- 172.21.15.1:0/3523440880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 msgr2=0x55d4a28edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ad259c640 1 -- 172.21.15.1:0/3523440880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a28c7e90 con 0x55d4a28ca850 2024-09-19T05:22:48.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.530+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:48.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9ad259c640 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac40ed5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a442e8b6b86f5def server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9abbfff640 1 -- 172.21.15.1:0/3523440880 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4049040 con 0x55d4a28ca850 2024-09-19T05:22:48.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9abbfff640 1 -- 172.21.15.1:0/3523440880 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac40b6e50 con 0x55d4a28ca850 2024-09-19T05:22:48.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9abbfff640 1 -- 172.21.15.1:0/3523440880 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40b8950 con 0x55d4a28ca850 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 -- 172.21.15.1:0/3523440880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 msgr2=0x55d4a28ed580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac40ed5e0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 -- 172.21.15.1:0/3523440880 shutdown_connections 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28d5a30 0x55d4a28cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28cb170 0x55d4a28edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 --2- 172.21.15.1:0/3523440880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28ed580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 -- 172.21.15.1:0/3523440880 >> 172.21.15.1:0/3523440880 conn(0x55d4a28c6de0 msgr2=0x55d4a28ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.531+0000 7f9adb036740 1 -- 172.21.15.1:0/3523440880 shutdown_connections 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 -- 172.21.15.1:0/3523440880 wait complete. 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 -- start start 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 Processor -- start 2024-09-19T05:22:48.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 0x55d4a2949590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41adaa0 con 0x55d4a28d5a30 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41aef10 con 0x55d4a28cb170 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41ae170 con 0x55d4a28ca850 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9adb036740 10 client.0 _ll_register_callbacks cb 0x7f9abc0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 0x55d4a2949590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ad259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28d9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:57076/0 (socket says 172.21.15.1:57076) 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ac9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56056/0 (socket says 172.21.15.1:56056) 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.532+0000 7f9ad259c640 1 -- 172.21.15.1:0/1784975275 learned_addr learned my addr 172.21.15.1:0/1784975275 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:22:48.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 msgr2=0x55d4a28d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28d9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/1784975275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 msgr2=0x55d4a28da520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 -- 172.21.15.1:0/1784975275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a28c7a70 con 0x55d4a28d5a30 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ac9d9b640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ad2d9d640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 0x55d4a2949590 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009520 tx=0x7f9acc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae3caed76b2eda2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ab9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc037020 con 0x55d4a28d5a30 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9acc005240 con 0x55d4a28d5a30 2024-09-19T05:22:48.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac40b6e50 con 0x55d4a28d5a30 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9acc042050 con 0x55d4a28d5a30 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9adb036740 10 client.15321 fetch_fsmap learned FSMap version 21 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.533+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d4a2950d80 con 0x55d4a28d5a30 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ac40b6e50 con 0x55d4a28d5a30 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9acc01b070 con 0x55d4a28d5a30 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 10 client.15321 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 10 client.15321 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 20 client.15321 populate_metadata read hostname 'smithi001' 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a29533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 4 client.15321 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T05:22:48.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55d4a2836be0 con 0x55d4a28e5820 2024-09-19T05:22:48.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a29533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:48.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9ad259c640 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a29533d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cccb117c1ca8e466 server_cookie=4095c651cfc850e7 in_seq=0 out_seq=0 2024-09-19T05:22:48.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.534+0000 7f9ab9ffb640 10 client.15321 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9ab9ffb640 1 -- 172.21.15.1:0/1784975275 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d4a2836be0 con 0x55d4a28e5820 2024-09-19T05:22:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9ab9ffb640 10 client.15321 handle_command_reply: tid=0 2024-09-19T05:22:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 client.15321 shutdown 2024-09-19T05:22:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 msgr2=0x55d4a2949590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 0x55d4a2949590 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009520 tx=0x7f9acc000f40 comp rx=0 tx=0).stop 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 shutdown_connections 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d4a28d5a30 0x55d4a2949590 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d4a28cb170 0x55d4a28da520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d4a28e5820 0x55d4a29533d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 --2- 172.21.15.1:0/1784975275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4a28ca850 0x55d4a28d9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9ab9ffb640 0 client.15321 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 >> 172.21.15.1:0/1784975275 conn(0x55d4a28c6de0 msgr2=0x55d4a28d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 shutdown_connections 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 1 -- 172.21.15.1:0/1784975275 wait complete. 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.668+0000 7f9adb036740 20 client.15321 trim_cache size 0 max 16384 2024-09-19T05:22:48.671 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 10, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "e033fb57": { 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 10, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:22:48.672 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:48.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:22:48.674 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:22:48.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 msgr2=0x7f9ac00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 0x7f9ac00a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9acc023000 tx=0x7f9acc024000 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 msgr2=0x7f9ad4197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009230 tx=0x7f9ac4004040 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 shutdown_connections 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ac00a3240 0x7f9ac00a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ad4106a80 0x7f9ad419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad4101420 0x7f9ad4197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 --2- 172.21.15.1:0/1554679344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad4100a80 0x7f9ad4197300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 >> 172.21.15.1:0/1554679344 conn(0x7f9ad40fc7a0 msgr2=0x7f9ad40fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:48.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 shutdown_connections 2024-09-19T05:22:48.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:22:48.669+0000 7f9ad8c5d640 1 -- 172.21.15.1:0/1554679344 wait complete. 2024-09-19T05:22:49.348 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e033fb57', quiesce took 3.3 seconds. Will release after: 17.05 2024-09-19T05:22:49.363 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 19.58 MB/sec warmup 4 sec latency 697.186 ms 2024-09-19T05:22:49.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:49 smithi001 ceph-mon[30968]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 290 KiB/s wr, 43 op/s 2024-09-19T05:22:49.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:49 smithi060 ceph-mon[35058]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 290 KiB/s wr, 43 op/s 2024-09-19T05:22:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:49 smithi082 ceph-mon[35195]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 290 KiB/s wr, 43 op/s 2024-09-19T05:22:50.363 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 15.66 MB/sec warmup 5 sec latency 1697.271 ms 2024-09-19T05:22:51.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 13.05 MB/sec warmup 6 sec latency 2697.386 ms 2024-09-19T05:22:51.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:51 smithi001 ceph-mon[30968]: pgmap v401: 129 pgs: 129 active+clean; 3.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 298 KiB/s wr, 42 op/s 2024-09-19T05:22:51.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:51 smithi060 ceph-mon[35058]: pgmap v401: 129 pgs: 129 active+clean; 3.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 298 KiB/s wr, 42 op/s 2024-09-19T05:22:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:51 smithi082 ceph-mon[35195]: pgmap v401: 129 pgs: 129 active+clean; 3.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 298 KiB/s wr, 42 op/s 2024-09-19T05:22:52.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 11.19 MB/sec warmup 7 sec latency 3697.528 ms 2024-09-19T05:22:53.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 9.79 MB/sec warmup 8 sec latency 4697.631 ms 2024-09-19T05:22:53.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:53 smithi001 ceph-mon[30968]: pgmap v402: 129 pgs: 129 active+clean; 5.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-19T05:22:53.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:53 smithi060 ceph-mon[35058]: pgmap v402: 129 pgs: 129 active+clean; 5.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-19T05:22:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:53 smithi082 ceph-mon[35195]: pgmap v402: 129 pgs: 129 active+clean; 5.0 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 457 KiB/s wr, 51 op/s 2024-09-19T05:22:54.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 8.70 MB/sec warmup 9 sec latency 5697.736 ms 2024-09-19T05:22:55.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 7.83 MB/sec warmup 10 sec latency 6697.858 ms 2024-09-19T05:22:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:55 smithi001 ceph-mon[30968]: pgmap v403: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 72 op/s 2024-09-19T05:22:55.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:55 smithi060 ceph-mon[35058]: pgmap v403: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 72 op/s 2024-09-19T05:22:55.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:55 smithi082 ceph-mon[35195]: pgmap v403: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 72 op/s 2024-09-19T05:22:56.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 7.12 MB/sec warmup 11 sec latency 7697.995 ms 2024-09-19T05:22:57.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 6.52 MB/sec warmup 12 sec latency 8698.087 ms 2024-09-19T05:22:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:57 smithi001 ceph-mon[30968]: pgmap v404: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 71 op/s 2024-09-19T05:22:57.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:57 smithi060 ceph-mon[35058]: pgmap v404: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 71 op/s 2024-09-19T05:22:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:57 smithi082 ceph-mon[35195]: pgmap v404: 129 pgs: 129 active+clean; 5.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 540 KiB/s wr, 71 op/s 2024-09-19T05:22:58.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 6.02 MB/sec warmup 13 sec latency 9698.211 ms 2024-09-19T05:22:59.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 5.59 MB/sec warmup 14 sec latency 10698.323 ms 2024-09-19T05:22:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:22:59 smithi001 ceph-mon[30968]: pgmap v405: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 552 KiB/s wr, 73 op/s 2024-09-19T05:22:59.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:22:59 smithi060 ceph-mon[35058]: pgmap v405: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 552 KiB/s wr, 73 op/s 2024-09-19T05:22:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:22:59 smithi082 ceph-mon[35195]: pgmap v405: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 552 KiB/s wr, 73 op/s 2024-09-19T05:23:00.364 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 5.22 MB/sec warmup 15 sec latency 11698.427 ms 2024-09-19T05:23:01.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 4.89 MB/sec warmup 16 sec latency 12698.494 ms 2024-09-19T05:23:01.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:01 smithi001 ceph-mon[30968]: pgmap v406: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 262 KiB/s wr, 32 op/s 2024-09-19T05:23:01.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:01 smithi060 ceph-mon[35058]: pgmap v406: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 262 KiB/s wr, 32 op/s 2024-09-19T05:23:01.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:01 smithi082 ceph-mon[35195]: pgmap v406: 129 pgs: 129 active+clean; 5.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 262 KiB/s wr, 32 op/s 2024-09-19T05:23:02.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 4.61 MB/sec warmup 17 sec latency 13698.803 ms 2024-09-19T05:23:03.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 4.35 MB/sec warmup 18 sec latency 14698.905 ms 2024-09-19T05:23:03.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:03 smithi001 ceph-mon[30968]: pgmap v407: 129 pgs: 129 active+clean; 13 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 841 KiB/s wr, 36 op/s 2024-09-19T05:23:03.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:03 smithi060 ceph-mon[35058]: pgmap v407: 129 pgs: 129 active+clean; 13 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 841 KiB/s wr, 36 op/s 2024-09-19T05:23:03.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:03 smithi082 ceph-mon[35195]: pgmap v407: 129 pgs: 129 active+clean; 13 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 841 KiB/s wr, 36 op/s 2024-09-19T05:23:04.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 4.12 MB/sec warmup 19 sec latency 15699.028 ms 2024-09-19T05:23:05.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 3.91 MB/sec warmup 20 sec latency 16699.166 ms 2024-09-19T05:23:05.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:05 smithi060 ceph-mon[35058]: pgmap v408: 129 pgs: 129 active+clean; 16 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 936 KiB/s wr, 30 op/s 2024-09-19T05:23:05.757 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:05 smithi082 ceph-mon[35195]: pgmap v408: 129 pgs: 129 active+clean; 16 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 936 KiB/s wr, 30 op/s 2024-09-19T05:23:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:05 smithi001 ceph-mon[30968]: pgmap v408: 129 pgs: 129 active+clean; 16 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 936 KiB/s wr, 30 op/s 2024-09-19T05:23:06.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 3.73 MB/sec warmup 21 sec latency 17699.244 ms 2024-09-19T05:23:06.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:23:06.656 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:06.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:06.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:06.777 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:06.778 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.128+0000 7faf3af56640 1 -- 172.21.15.1:0/1964798989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 msgr2=0x7faf341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.128+0000 7faf3af56640 1 --2- 172.21.15.1:0/1964798989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf341067e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faf20009900 tx=0x7faf2002a410 comp rx=0 tx=0).stop 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.128+0000 7faf3af56640 1 -- 172.21.15.1:0/1964798989 shutdown_connections 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.128+0000 7faf3af56640 1 --2- 172.21.15.1:0/1964798989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 0x7faf3410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.128+0000 7faf3af56640 1 --2- 172.21.15.1:0/1964798989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf341067e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 --2- 172.21.15.1:0/1964798989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 0x7faf341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 -- 172.21.15.1:0/1964798989 >> 172.21.15.1:0/1964798989 conn(0x7faf340fd8c0 msgr2=0x7faf340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 -- 172.21.15.1:0/1964798989 shutdown_connections 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 -- 172.21.15.1:0/1964798989 wait complete. 2024-09-19T05:23:07.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 Processor -- start 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.129+0000 7faf3af56640 1 -- start start 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 0x7faf34198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 0x7faf3419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf34111f30 con 0x7faf34102790 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf34111db0 con 0x7faf34106f10 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf3af56640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf341120b0 con 0x7faf34101de0 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47690/0 (socket says 172.21.15.1:47690) 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 -- 172.21.15.1:0/1761284492 learned_addr learned my addr 172.21.15.1:0/1761284492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf38cf2640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 0x7faf34198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:07.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf394f3640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 0x7faf3419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 -- 172.21.15.1:0/1761284492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 msgr2=0x7faf34198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 0x7faf34198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 -- 172.21.15.1:0/1761284492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 msgr2=0x7faf3419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 0x7faf3419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 -- 172.21.15.1:0/1761284492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3419d4c0 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf33fff640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faf20006010 tx=0x7faf200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.130+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2003f030 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.131+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf20003ce0 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.131+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3419d750 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.131+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20035070 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.131+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341a5090 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.132+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf341021c0 con 0x7faf34102790 2024-09-19T05:23:07.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.133+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7faf20042030 con 0x7faf34102790 2024-09-19T05:23:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.134+0000 7faf31ffb640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 0x7faf240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.134+0000 7faf38cf2640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 0x7faf240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.134+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7faf200f02a0 con 0x7faf34102790 2024-09-19T05:23:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.134+0000 7faf38cf2640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 0x7faf240a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf28005d00 tx=0x7faf2800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:07.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.138+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf200bc620 con 0x7faf34102790 2024-09-19T05:23:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.349+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf3410a0f0 con 0x7faf34102790 2024-09-19T05:23:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.350+0000 7faf31ffb640 1 -- 172.21.15.1:0/1761284492 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7faf200c0920 con 0x7faf34102790 2024-09-19T05:23:07.352 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:23:07.353 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:23:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:23:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 msgr2=0x7faf240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 0x7faf240a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf28005d00 tx=0x7faf2800b410 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 msgr2=0x7faf34198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7faf20006010 tx=0x7faf200042f0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 shutdown_connections 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faf240a3240 0x7faf240a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf34106f10 0x7faf3419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34102790 0x7faf34198a50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 --2- 172.21.15.1:0/1761284492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf34101de0 0x7faf34198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 >> 172.21.15.1:0/1761284492 conn(0x7faf340fd8c0 msgr2=0x7faf340fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 shutdown_connections 2024-09-19T05:23:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:07.353+0000 7faf3af56640 1 -- 172.21.15.1:0/1761284492 wait complete. 2024-09-19T05:23:07.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 3.56 MB/sec warmup 22 sec latency 18699.283 ms 2024-09-19T05:23:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:07 smithi060 ceph-mon[35058]: pgmap v409: 129 pgs: 129 active+clean; 25 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-09-19T05:23:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:07 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1761284492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:23:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:07 smithi082 ceph-mon[35195]: pgmap v409: 129 pgs: 129 active+clean; 25 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-09-19T05:23:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:07 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1761284492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:23:08.042 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:07 smithi001 ceph-mon[30968]: pgmap v409: 129 pgs: 129 active+clean; 25 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 19 op/s 2024-09-19T05:23:08.042 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:07 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1761284492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:23:08.073 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e033fb57 --release --await' 2024-09-19T05:23:08.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e033fb57 --release --await 2024-09-19T05:23:08.335 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:23:08.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11013 3.40 MB/sec warmup 23 sec latency 19699.310 ms 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.823+0000 7ffb159ed640 1 -- 172.21.15.1:0/3520744596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 msgr2=0x7ffb10100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 --2- 172.21.15.1:0/3520744596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10100ee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009930 tx=0x7ffaf802a420 comp rx=0 tx=0).stop 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 -- 172.21.15.1:0/3520744596 shutdown_connections 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 --2- 172.21.15.1:0/3520744596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 0x7ffb1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 --2- 172.21.15.1:0/3520744596 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10100ee0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 --2- 172.21.15.1:0/3520744596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 0x7ffb10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 -- 172.21.15.1:0/3520744596 >> 172.21.15.1:0/3520744596 conn(0x7ffb100fc7a0 msgr2=0x7ffb100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 -- 172.21.15.1:0/3520744596 shutdown_connections 2024-09-19T05:23:08.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 -- 172.21.15.1:0/3520744596 wait complete. 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.824+0000 7ffb159ed640 1 Processor -- start 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 -- start start 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 0x7ffb101989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 0x7ffb1019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10110ea0 con 0x7ffb10100a80 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10110d20 con 0x7ffb10101420 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb159ed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10111020 con 0x7ffb10106a80 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47698/0 (socket says 172.21.15.1:47698) 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 -- 172.21.15.1:0/1679674778 learned_addr learned my addr 172.21.15.1:0/1679674778 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 0x7ffb101989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 0x7ffb1019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 -- 172.21.15.1:0/1679674778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 msgr2=0x7ffb1019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 0x7ffb1019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 -- 172.21.15.1:0/1679674778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 msgr2=0x7ffb101989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 0x7ffb101989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.825+0000 7ffb0effd640 1 -- 172.21.15.1:0/1679674778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1019d440 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb0effd640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000ba50 tx=0x7ffb0000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb149eb640 1 -- 172.21.15.1:0/1679674778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00019070 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1019d730 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb149eb640 1 -- 172.21.15.1:0/1679674778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb0000cbe0 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb149eb640 1 -- 172.21.15.1:0/1679674778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb000076e0 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.826+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb101a5010 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.828+0000 7ffb149eb640 1 -- 172.21.15.1:0/1679674778 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ffb0001c070 con 0x7ffb10100a80 2024-09-19T05:23:08.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.829+0000 7ffb149eb640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 0x7ffafc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.829+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 0x7ffafc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.829+0000 7ffb149eb640 1 -- 172.21.15.1:0/1679674778 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb000cf320 con 0x7ffb10100a80 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 Processor -- start 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 -- start start 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 0x7ffafc0a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009900 tx=0x7ffaf80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b4f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b4f980 0x558504b59d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558504ab4620 con 0x558504b5a240 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558504a5be50 con 0x558504b4f980 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558504ab05e0 con 0x558504b4f060 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b4f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47712/0 (socket says 172.21.15.1:47712) 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 -- 172.21.15.1:0/1375845890 learned_addr learned my addr 172.21.15.1:0/1375845890 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b4f980 0x558504b59d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 -- 172.21.15.1:0/1375845890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 msgr2=0x558504b4f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b4f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 -- 172.21.15.1:0/1375845890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b4f980 msgr2=0x558504b59d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b4f980 0x558504b59d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0f7fe640 1 -- 172.21.15.1:0/1375845890 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558504a4cd40 con 0x558504b5a240 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.830+0000 7ffb0effd640 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b4f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.831+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800b700 tx=0x7ffb0800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4004f10e08c92050 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.831+0000 7ffb05ffb640 1 -- 172.21.15.1:0/1375845890 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08003dd0 con 0x558504b5a240 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.831+0000 7ffb05ffb640 1 -- 172.21.15.1:0/1375845890 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb08015070 con 0x558504b5a240 2024-09-19T05:23:08.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.831+0000 7ffb05ffb640 1 -- 172.21.15.1:0/1375845890 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080106a0 con 0x558504b5a240 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- 172.21.15.1:0/1375845890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 msgr2=0x558504b5c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800b700 tx=0x7ffb0800bbc0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- 172.21.15.1:0/1375845890 shutdown_connections 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b5a240 0x558504b5c630 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b4f980 0x558504b59d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/1375845890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b4f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- 172.21.15.1:0/1375845890 >> 172.21.15.1:0/1375845890 conn(0x558504b4b5f0 msgr2=0x558504b4b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- 172.21.15.1:0/1375845890 shutdown_connections 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- 172.21.15.1:0/1375845890 wait complete. 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 -- start start 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.832+0000 7ffb17dc6740 1 Processor -- start 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f980 0x558504b576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b57bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558504b5ce10 con 0x558504b4f060 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558504a3cf10 con 0x558504b5a240 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558504b5cf90 con 0x558504b4f980 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb17dc6740 10 client.0 _ll_register_callbacks cb 0x558504a60db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47714/0 (socket says 172.21.15.1:47714) 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 -- 172.21.15.1:0/3586474675 learned_addr learned my addr 172.21.15.1:0/3586474675 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b57bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f980 0x558504b576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 -- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f980 msgr2=0x558504b576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f980 0x558504b576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 -- 172.21.15.1:0/3586474675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 msgr2=0x558504b57bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b57bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 -- 172.21.15.1:0/3586474675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585047c3580 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffb0effd640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097a40 tx=0x7ffb0009b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc978cfa91072eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffaeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb000bb040 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.833+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb000a3d10 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb08015070 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb000a41a0 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 10 client.15339 fetch_fsmap learned FSMap version 21 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55850488d960 con 0x558504b4f060 2024-09-19T05:23:08.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb08015070 con 0x558504b4f060 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb0009a5c0 con 0x558504b4f060 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 10 client.15339 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 10 client.15339 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 20 client.15339 populate_metadata read hostname 'smithi001' 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504b69d50 0x558504b6c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 4 client.15339 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558504ac1b90 con 0x558504b69d50 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.834+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504b69d50 0x558504b6c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.835+0000 7ffaeeffd640 10 client.15339 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.835+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504b69d50 0x558504b6c140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b648a0d75b4f8cf6 server_cookie=26b2b8dda4437385 in_seq=0 out_seq=0 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffaeeffd640 1 -- 172.21.15.1:0/3586474675 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558504ac1b90 con 0x558504b69d50 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffaeeffd640 10 client.15339 handle_command_reply: tid=0 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 client.15339 shutdown 2024-09-19T05:23:08.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 msgr2=0x558504b57170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb00097a40 tx=0x7ffb0009b6a0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 shutdown_connections 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b57bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504b69d50 0x558504b6c140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f980 0x558504b576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/3586474675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f060 0x558504b57170 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffaeeffd640 0 client.15339 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 >> 172.21.15.1:0/3586474675 conn(0x558504b4b5f0 msgr2=0x558504b512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 shutdown_connections 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 1 -- 172.21.15.1:0/3586474675 wait complete. 2024-09-19T05:23:08.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.836+0000 7ffb17dc6740 20 client.15339 trim_cache size 0 max 16384 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 Processor -- start 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 -- start start 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101aabb0 con 0x558504b4f980 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101ad430 con 0x558504b5a240 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101ab220 con 0x558504b4f060 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb0e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb0e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47716/0 (socket says 172.21.15.1:47716) 2024-09-19T05:23:08.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.853+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/2797869491 learned_addr learned my addr 172.21.15.1:0/2797869491 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0effd640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/2797869491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 msgr2=0x558504b51ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b51ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/2797869491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 msgr2=0x558504b719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/2797869491 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558504b4c280 con 0x558504b4f980 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8031a00 tx=0x7ffaf8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cfc981cc30e05a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb057fa640 1 -- 172.21.15.1:0/2797869491 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8035040 con 0x558504b4f980 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb057fa640 1 -- 172.21.15.1:0/2797869491 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8058070 con 0x558504b4f980 2024-09-19T05:23:08.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.854+0000 7ffb057fa640 1 -- 172.21.15.1:0/2797869491 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8052a60 con 0x558504b4f980 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- 172.21.15.1:0/2797869491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 msgr2=0x558504b4a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8031a00 tx=0x7ffaf8040000 comp rx=0 tx=0).stop 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- 172.21.15.1:0/2797869491 shutdown_connections 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504b719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b4a640 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/2797869491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- 172.21.15.1:0/2797869491 >> 172.21.15.1:0/2797869491 conn(0x558504b4b5f0 msgr2=0x558504b49f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- 172.21.15.1:0/2797869491 shutdown_connections 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- 172.21.15.1:0/2797869491 wait complete. 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.855+0000 7ffb17dc6740 1 -- start start 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 Processor -- start 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b5e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504bd39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101ab8f0 con 0x558504b4f980 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101acd60 con 0x558504b5a240 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101abfc0 con 0x558504b4f060 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb17dc6740 10 client.0 _ll_register_callbacks cb 0x7ffb0009b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47726/0 (socket says 172.21.15.1:47726) 2024-09-19T05:23:08.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/4021439700 learned_addr learned my addr 172.21.15.1:0/4021439700 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0effd640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b5e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504bd39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 msgr2=0x558504b5e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b5e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/4021439700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 msgr2=0x558504bd39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504bd39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0e7fc640 1 -- 172.21.15.1:0/4021439700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558504bd3ef0 con 0x558504b4f980 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.856+0000 7ffb0f7fe640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504bd39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb0e7fc640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffaf802a940 tx=0x7ffaf8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b878899b0166389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8035040 con 0x558504b4f980 2024-09-19T05:23:08.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf8058070 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffaf8051030 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffaf8069050 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 10 client.15345 fetch_fsmap learned FSMap version 21 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558504bd5110 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf8058070 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffaf805c450 con 0x558504b4f980 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 10 client.15345 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 10 client.15345 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 20 client.15345 populate_metadata read hostname 'smithi001' 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504bd5820 0x558504bd7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 4 client.15345 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e033fb57", "release": true, "await": true}] 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.857+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e033fb57", "release": true, "await": true}) -- 0x558504abc0a0 con 0x558504bd5820 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.858+0000 7ffb0effd640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504bd5820 0x558504bd7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:08.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.858+0000 7ffaeeffd640 10 client.15345 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:23:08.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.858+0000 7ffb0effd640 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504bd5820 0x558504bd7c40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b6df31a3159415 server_cookie=95ff4502fc1ce145 in_seq=0 out_seq=0 2024-09-19T05:23:08.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.868+0000 7ffaeeffd640 1 -- 172.21.15.1:0/4021439700 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558504abc0a0 con 0x558504bd5820 2024-09-19T05:23:08.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.868+0000 7ffaeeffd640 10 client.15345 handle_command_reply: tid=0 2024-09-19T05:23:08.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.868+0000 7ffb17dc6740 1 client.15345 shutdown 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 msgr2=0x558504b5e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffaf802a940 tx=0x7ffaf8005fd0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 shutdown_connections 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558504b5a240 0x558504bd39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558504b4f980 0x558504b5e910 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558504bd5820 0x558504bd7c40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffaeeffd640 0 client.15345 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 --2- 172.21.15.1:0/4021439700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558504b4f060 0x558504b5e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 >> 172.21.15.1:0/4021439700 conn(0x558504b4b5f0 msgr2=0x558504b57950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 shutdown_connections 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 1 -- 172.21.15.1:0/4021439700 wait complete. 2024-09-19T05:23:08.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb17dc6740 20 client.15345 trim_cache size 0 max 16384 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 12, 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "e033fb57": { 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 12, 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:23:08.872 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:23:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:23:08.874 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 msgr2=0x7ffafc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 0x7ffafc0a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009900 tx=0x7ffaf80058d0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 msgr2=0x7ffb10198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000ba50 tx=0x7ffb0000bf10 comp rx=0 tx=0).stop 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 shutdown_connections 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffafc0a3240 0x7ffafc0a5700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb10106a80 0x7ffb1019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb10101420 0x7ffb101989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 --2- 172.21.15.1:0/1679674778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb10100a80 0x7ffb10198490 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:08.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.869+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 >> 172.21.15.1:0/1679674778 conn(0x7ffb100fc7a0 msgr2=0x7ffb1006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:08.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.870+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 shutdown_connections 2024-09-19T05:23:08.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:23:08.870+0000 7ffb159ed640 1 -- 172.21.15.1:0/1679674778 wait complete. 2024-09-19T05:23:09.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12258 3.48 MB/sec warmup 24 sec latency 20199.694 ms 2024-09-19T05:23:09.689 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e033fb57', total seconds elapsed: 23.7 2024-09-19T05:23:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:09 smithi060 ceph-mon[35058]: pgmap v410: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-09-19T05:23:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:09 smithi082 ceph-mon[35195]: pgmap v410: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-09-19T05:23:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:09 smithi001 ceph-mon[30968]: pgmap v410: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 32 op/s 2024-09-19T05:23:10.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15433 3.98 MB/sec warmup 25 sec latency 15.418 ms 2024-09-19T05:23:11.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 18927 4.56 MB/sec warmup 26 sec latency 21.001 ms 2024-09-19T05:23:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:11 smithi060 ceph-mon[35058]: pgmap v411: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.4 MiB/s wr, 31 op/s 2024-09-19T05:23:12.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:11 smithi082 ceph-mon[35195]: pgmap v411: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.4 MiB/s wr, 31 op/s 2024-09-19T05:23:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:11 smithi001 ceph-mon[30968]: pgmap v411: 129 pgs: 129 active+clean; 27 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.4 MiB/s wr, 31 op/s 2024-09-19T05:23:12.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 22397 5.10 MB/sec warmup 27 sec latency 20.726 ms 2024-09-19T05:23:13.365 INFO:tasks.workunit.client.0.smithi001.stdout: 1 25982 5.60 MB/sec warmup 28 sec latency 15.558 ms 2024-09-19T05:23:14.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:13 smithi060 ceph-mon[35058]: pgmap v412: 129 pgs: 129 active+clean; 28 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.7 MiB/s wr, 80 op/s 2024-09-19T05:23:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:13 smithi082 ceph-mon[35195]: pgmap v412: 129 pgs: 129 active+clean; 28 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.7 MiB/s wr, 80 op/s 2024-09-19T05:23:14.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:13 smithi001 ceph-mon[30968]: pgmap v412: 129 pgs: 129 active+clean; 28 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.7 MiB/s wr, 80 op/s 2024-09-19T05:23:14.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 29489 6.07 MB/sec warmup 29 sec latency 17.974 ms 2024-09-19T05:23:15.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 32877 6.46 MB/sec warmup 30 sec latency 12.487 ms 2024-09-19T05:23:16.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:15 smithi060 ceph-mon[35058]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:23:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:15 smithi082 ceph-mon[35195]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:23:16.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:15 smithi001 ceph-mon[30968]: pgmap v413: 129 pgs: 129 active+clean; 29 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:23:16.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 36308 6.86 MB/sec warmup 31 sec latency 25.040 ms 2024-09-19T05:23:17.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 39732 7.24 MB/sec warmup 32 sec latency 12.122 ms 2024-09-19T05:23:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:17 smithi060 ceph-mon[35058]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 2.3 MiB/s wr, 120 op/s 2024-09-19T05:23:18.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:17 smithi082 ceph-mon[35195]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 2.3 MiB/s wr, 120 op/s 2024-09-19T05:23:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:17 smithi001 ceph-mon[30968]: pgmap v414: 129 pgs: 129 active+clean; 32 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 2.3 MiB/s wr, 120 op/s 2024-09-19T05:23:18.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 43153 7.59 MB/sec warmup 33 sec latency 21.841 ms 2024-09-19T05:23:19.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 46698 7.93 MB/sec warmup 34 sec latency 19.680 ms 2024-09-19T05:23:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:19 smithi060 ceph-mon[35058]: pgmap v415: 129 pgs: 129 active+clean; 35 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-09-19T05:23:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:19 smithi082 ceph-mon[35195]: pgmap v415: 129 pgs: 129 active+clean; 35 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-09-19T05:23:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:19 smithi001 ceph-mon[30968]: pgmap v415: 129 pgs: 129 active+clean; 35 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 156 op/s 2024-09-19T05:23:20.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 50114 8.25 MB/sec warmup 35 sec latency 11.394 ms 2024-09-19T05:23:21.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 53626 8.55 MB/sec warmup 36 sec latency 12.137 ms 2024-09-19T05:23:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:21 smithi060 ceph-mon[35058]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2024-09-19T05:23:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:21 smithi082 ceph-mon[35195]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2024-09-19T05:23:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:21 smithi001 ceph-mon[30968]: pgmap v416: 129 pgs: 129 active+clean; 35 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 152 op/s 2024-09-19T05:23:22.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 57048 8.83 MB/sec warmup 37 sec latency 16.194 ms 2024-09-19T05:23:23.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 60433 9.07 MB/sec warmup 38 sec latency 23.108 ms 2024-09-19T05:23:24.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:23 smithi060 ceph-mon[35058]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 213 op/s 2024-09-19T05:23:24.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:23 smithi082 ceph-mon[35195]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 213 op/s 2024-09-19T05:23:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:23 smithi001 ceph-mon[30968]: pgmap v417: 129 pgs: 129 active+clean; 40 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 213 op/s 2024-09-19T05:23:24.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 63703 9.24 MB/sec warmup 39 sec latency 12.273 ms 2024-09-19T05:23:25.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 66790 9.44 MB/sec warmup 40 sec latency 21.500 ms 2024-09-19T05:23:26.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:25 smithi060 ceph-mon[35058]: pgmap v418: 129 pgs: 129 active+clean; 45 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2024-09-19T05:23:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:25 smithi082 ceph-mon[35195]: pgmap v418: 129 pgs: 129 active+clean; 45 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2024-09-19T05:23:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:25 smithi001 ceph-mon[30968]: pgmap v418: 129 pgs: 129 active+clean; 45 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2024-09-19T05:23:26.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 69314 9.50 MB/sec warmup 41 sec latency 69.127 ms 2024-09-19T05:23:27.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 72612 9.73 MB/sec warmup 42 sec latency 20.562 ms 2024-09-19T05:23:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:27 smithi060 ceph-mon[35058]: pgmap v419: 129 pgs: 129 active+clean; 46 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 235 op/s 2024-09-19T05:23:28.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:27 smithi082 ceph-mon[35195]: pgmap v419: 129 pgs: 129 active+clean; 46 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 235 op/s 2024-09-19T05:23:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:27 smithi001 ceph-mon[30968]: pgmap v419: 129 pgs: 129 active+clean; 46 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 235 op/s 2024-09-19T05:23:28.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 76229 9.95 MB/sec warmup 43 sec latency 13.345 ms 2024-09-19T05:23:29.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 79534 10.15 MB/sec warmup 44 sec latency 15.902 ms 2024-09-19T05:23:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:29 smithi060 ceph-mon[35058]: pgmap v420: 129 pgs: 129 active+clean; 51 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 267 op/s 2024-09-19T05:23:30.007 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:29 smithi082 ceph-mon[35195]: pgmap v420: 129 pgs: 129 active+clean; 51 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 267 op/s 2024-09-19T05:23:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:29 smithi001 ceph-mon[30968]: pgmap v420: 129 pgs: 129 active+clean; 51 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.1 MiB/s wr, 267 op/s 2024-09-19T05:23:30.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 82822 10.29 MB/sec warmup 45 sec latency 14.888 ms 2024-09-19T05:23:31.366 INFO:tasks.workunit.client.0.smithi001.stdout: 1 86579 10.54 MB/sec warmup 46 sec latency 20.064 ms 2024-09-19T05:23:32.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:31 smithi060 ceph-mon[35058]: pgmap v421: 129 pgs: 129 active+clean; 51 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-19T05:23:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:31 smithi082 ceph-mon[35195]: pgmap v421: 129 pgs: 129 active+clean; 51 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-19T05:23:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:31 smithi001 ceph-mon[30968]: pgmap v421: 129 pgs: 129 active+clean; 51 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-19T05:23:32.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 89984 10.66 MB/sec warmup 47 sec latency 16.161 ms 2024-09-19T05:23:33.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 93679 10.90 MB/sec warmup 48 sec latency 12.207 ms 2024-09-19T05:23:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:33 smithi060 ceph-mon[35058]: pgmap v422: 129 pgs: 129 active+clean; 57 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 302 op/s 2024-09-19T05:23:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:33 smithi082 ceph-mon[35195]: pgmap v422: 129 pgs: 129 active+clean; 57 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 302 op/s 2024-09-19T05:23:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:33 smithi001 ceph-mon[30968]: pgmap v422: 129 pgs: 129 active+clean; 57 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.3 MiB/s wr, 302 op/s 2024-09-19T05:23:34.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 96995 11.01 MB/sec warmup 49 sec latency 22.968 ms 2024-09-19T05:23:35.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 100429 11.17 MB/sec warmup 50 sec latency 43.133 ms 2024-09-19T05:23:36.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:35 smithi060 ceph-mon[35058]: pgmap v423: 129 pgs: 129 active+clean; 57 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:23:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:35 smithi082 ceph-mon[35195]: pgmap v423: 129 pgs: 129 active+clean; 57 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:23:36.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:35 smithi001 ceph-mon[30968]: pgmap v423: 129 pgs: 129 active+clean; 57 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:23:36.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 103846 11.30 MB/sec warmup 51 sec latency 27.570 ms 2024-09-19T05:23:37.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 107241 11.44 MB/sec warmup 52 sec latency 17.856 ms 2024-09-19T05:23:38.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:37 smithi060 ceph-mon[35058]: pgmap v424: 129 pgs: 129 active+clean; 63 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:23:38.182 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:37 smithi001 ceph-mon[30968]: pgmap v424: 129 pgs: 129 active+clean; 63 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:23:38.182 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:37 smithi082 ceph-mon[35195]: pgmap v424: 129 pgs: 129 active+clean; 63 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:23:38.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 110537 11.58 MB/sec warmup 53 sec latency 14.855 ms 2024-09-19T05:23:39.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 113868 11.71 MB/sec warmup 54 sec latency 19.594 ms 2024-09-19T05:23:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:39 smithi060 ceph-mon[35058]: pgmap v425: 129 pgs: 129 active+clean; 65 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-09-19T05:23:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:39 smithi082 ceph-mon[35195]: pgmap v425: 129 pgs: 129 active+clean; 65 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-09-19T05:23:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:39 smithi001 ceph-mon[30968]: pgmap v425: 129 pgs: 129 active+clean; 65 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-09-19T05:23:40.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 117299 11.85 MB/sec warmup 55 sec latency 31.023 ms 2024-09-19T05:23:41.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 120742 11.96 MB/sec warmup 56 sec latency 16.596 ms 2024-09-19T05:23:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:41 smithi060 ceph-mon[35058]: pgmap v426: 129 pgs: 129 active+clean; 66 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2024-09-19T05:23:42.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:41 smithi082 ceph-mon[35195]: pgmap v426: 129 pgs: 129 active+clean; 66 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2024-09-19T05:23:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:41 smithi001 ceph-mon[30968]: pgmap v426: 129 pgs: 129 active+clean; 66 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2024-09-19T05:23:42.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 124142 12.08 MB/sec warmup 57 sec latency 15.406 ms 2024-09-19T05:23:43.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 127812 12.21 MB/sec warmup 58 sec latency 11.681 ms 2024-09-19T05:23:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:43 smithi082 ceph-mon[35195]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-19T05:23:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:43 smithi001 ceph-mon[30968]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-19T05:23:44.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:43 smithi060 ceph-mon[35058]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-19T05:23:44.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 131219 12.32 MB/sec warmup 59 sec latency 15.886 ms 2024-09-19T05:23:45.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 133170 12.23 MB/sec warmup 60 sec latency 116.916 ms 2024-09-19T05:23:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:45 smithi082 ceph-mon[35195]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-19T05:23:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:45 smithi001 ceph-mon[30968]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-19T05:23:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:45 smithi060 ceph-mon[35058]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 218 op/s 2024-09-19T05:23:46.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 136351 12.34 MB/sec warmup 61 sec latency 16.248 ms 2024-09-19T05:23:47.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 139792 12.45 MB/sec warmup 62 sec latency 12.532 ms 2024-09-19T05:23:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:47 smithi082 ceph-mon[35195]: pgmap v429: 129 pgs: 129 active+clean; 80 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-09-19T05:23:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:47 smithi001 ceph-mon[30968]: pgmap v429: 129 pgs: 129 active+clean; 80 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-09-19T05:23:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:47 smithi060 ceph-mon[35058]: pgmap v429: 129 pgs: 129 active+clean; 80 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-09-19T05:23:48.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 142904 12.49 MB/sec warmup 63 sec latency 12.966 ms 2024-09-19T05:23:49.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 146250 12.58 MB/sec warmup 64 sec latency 27.178 ms 2024-09-19T05:23:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:49 smithi082 ceph-mon[35195]: pgmap v430: 129 pgs: 129 active+clean; 79 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-19T05:23:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:49 smithi001 ceph-mon[30968]: pgmap v430: 129 pgs: 129 active+clean; 79 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-19T05:23:50.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:49 smithi060 ceph-mon[35058]: pgmap v430: 129 pgs: 129 active+clean; 79 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-09-19T05:23:50.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 149408 12.68 MB/sec warmup 65 sec latency 55.412 ms 2024-09-19T05:23:51.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 152758 12.77 MB/sec warmup 66 sec latency 25.386 ms 2024-09-19T05:23:52.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:51 smithi060 ceph-mon[35058]: pgmap v431: 129 pgs: 129 active+clean; 82 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-19T05:23:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:51 smithi001 ceph-mon[30968]: pgmap v431: 129 pgs: 129 active+clean; 82 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-19T05:23:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:51 smithi082 ceph-mon[35195]: pgmap v431: 129 pgs: 129 active+clean; 82 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-19T05:23:52.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 156104 12.85 MB/sec warmup 67 sec latency 15.131 ms 2024-09-19T05:23:53.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 159007 12.87 MB/sec warmup 68 sec latency 14.141 ms 2024-09-19T05:23:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:53 smithi001 ceph-mon[30968]: pgmap v432: 129 pgs: 129 active+clean; 88 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 349 op/s 2024-09-19T05:23:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:53 smithi060 ceph-mon[35058]: pgmap v432: 129 pgs: 129 active+clean; 88 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 349 op/s 2024-09-19T05:23:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:53 smithi082 ceph-mon[35195]: pgmap v432: 129 pgs: 129 active+clean; 88 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 349 op/s 2024-09-19T05:23:54.367 INFO:tasks.workunit.client.0.smithi001.stdout: 1 162194 12.89 MB/sec warmup 69 sec latency 19.047 ms 2024-09-19T05:23:55.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 165009 12.94 MB/sec warmup 70 sec latency 103.486 ms 2024-09-19T05:23:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:55 smithi001 ceph-mon[30968]: pgmap v433: 129 pgs: 129 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-19T05:23:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:55 smithi060 ceph-mon[35058]: pgmap v433: 129 pgs: 129 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-19T05:23:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:55 smithi082 ceph-mon[35195]: pgmap v433: 129 pgs: 129 active+clean; 88 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-19T05:23:56.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 167868 12.98 MB/sec warmup 71 sec latency 35.790 ms 2024-09-19T05:23:57.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 171252 13.05 MB/sec warmup 72 sec latency 13.877 ms 2024-09-19T05:23:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:57 smithi001 ceph-mon[30968]: pgmap v434: 129 pgs: 129 active+clean; 93 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 371 op/s 2024-09-19T05:23:58.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:57 smithi060 ceph-mon[35058]: pgmap v434: 129 pgs: 129 active+clean; 93 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 371 op/s 2024-09-19T05:23:58.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:57 smithi082 ceph-mon[35195]: pgmap v434: 129 pgs: 129 active+clean; 93 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 371 op/s 2024-09-19T05:23:58.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 174501 13.13 MB/sec warmup 73 sec latency 18.686 ms 2024-09-19T05:23:59.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 177976 13.20 MB/sec warmup 74 sec latency 21.068 ms 2024-09-19T05:24:00.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:23:59 smithi001 ceph-mon[30968]: pgmap v435: 129 pgs: 129 active+clean; 92 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-09-19T05:24:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:23:59 smithi060 ceph-mon[35058]: pgmap v435: 129 pgs: 129 active+clean; 92 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-09-19T05:24:00.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:23:59 smithi082 ceph-mon[35195]: pgmap v435: 129 pgs: 129 active+clean; 92 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-09-19T05:24:00.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 181337 13.28 MB/sec warmup 75 sec latency 29.703 ms 2024-09-19T05:24:01.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 184284 13.30 MB/sec warmup 76 sec latency 63.749 ms 2024-09-19T05:24:02.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:01 smithi001 ceph-mon[30968]: pgmap v436: 129 pgs: 129 active+clean; 92 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 279 op/s 2024-09-19T05:24:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:01 smithi060 ceph-mon[35058]: pgmap v436: 129 pgs: 129 active+clean; 92 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 279 op/s 2024-09-19T05:24:02.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:01 smithi082 ceph-mon[35195]: pgmap v436: 129 pgs: 129 active+clean; 92 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 279 op/s 2024-09-19T05:24:02.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 187446 13.35 MB/sec warmup 77 sec latency 20.256 ms 2024-09-19T05:24:03.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 190904 13.41 MB/sec warmup 78 sec latency 15.602 ms 2024-09-19T05:24:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:03 smithi001 ceph-mon[30968]: pgmap v437: 129 pgs: 129 active+clean; 97 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 323 op/s 2024-09-19T05:24:04.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:03 smithi060 ceph-mon[35058]: pgmap v437: 129 pgs: 129 active+clean; 97 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 323 op/s 2024-09-19T05:24:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:03 smithi082 ceph-mon[35195]: pgmap v437: 129 pgs: 129 active+clean; 97 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.9 MiB/s wr, 323 op/s 2024-09-19T05:24:04.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 194118 13.44 MB/sec warmup 79 sec latency 15.572 ms 2024-09-19T05:24:05.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 197485 13.50 MB/sec warmup 80 sec latency 12.872 ms 2024-09-19T05:24:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:05 smithi001 ceph-mon[30968]: pgmap v438: 129 pgs: 129 active+clean; 101 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-19T05:24:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:05 smithi060 ceph-mon[35058]: pgmap v438: 129 pgs: 129 active+clean; 101 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-19T05:24:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:05 smithi082 ceph-mon[35195]: pgmap v438: 129 pgs: 129 active+clean; 101 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-19T05:24:06.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 199383 13.48 MB/sec warmup 81 sec latency 81.820 ms 2024-09-19T05:24:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:07.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:07.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:24:07.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:07.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:24:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:24:07.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 202611 13.55 MB/sec warmup 82 sec latency 23.061 ms 2024-09-19T05:24:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:07 smithi001 ceph-mon[30968]: pgmap v439: 129 pgs: 129 active+clean; 100 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 333 op/s 2024-09-19T05:24:08.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:07 smithi060 ceph-mon[35058]: pgmap v439: 129 pgs: 129 active+clean; 100 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 333 op/s 2024-09-19T05:24:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:07 smithi082 ceph-mon[35195]: pgmap v439: 129 pgs: 129 active+clean; 100 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 333 op/s 2024-09-19T05:24:08.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 205989 13.61 MB/sec warmup 83 sec latency 11.856 ms 2024-09-19T05:24:09.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 209370 13.66 MB/sec warmup 84 sec latency 20.057 ms 2024-09-19T05:24:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:09 smithi001 ceph-mon[30968]: pgmap v440: 129 pgs: 129 active+clean; 105 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 338 op/s 2024-09-19T05:24:10.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:09 smithi060 ceph-mon[35058]: pgmap v440: 129 pgs: 129 active+clean; 105 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 338 op/s 2024-09-19T05:24:10.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:09 smithi082 ceph-mon[35195]: pgmap v440: 129 pgs: 129 active+clean; 105 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 338 op/s 2024-09-19T05:24:10.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 212814 13.72 MB/sec warmup 85 sec latency 20.973 ms 2024-09-19T05:24:11.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 215323 13.67 MB/sec warmup 86 sec latency 116.131 ms 2024-09-19T05:24:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:11 smithi001 ceph-mon[30968]: pgmap v441: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:24:12.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:11 smithi060 ceph-mon[35058]: pgmap v441: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:24:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:11 smithi082 ceph-mon[35195]: pgmap v441: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:24:12.368 INFO:tasks.workunit.client.0.smithi001.stdout: 1 217981 13.71 MB/sec warmup 87 sec latency 33.573 ms 2024-09-19T05:24:13.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 221186 13.74 MB/sec warmup 88 sec latency 23.445 ms 2024-09-19T05:24:14.094 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:13 smithi001 ceph-mon[30968]: pgmap v442: 129 pgs: 129 active+clean; 109 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 411 op/s 2024-09-19T05:24:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:13 smithi060 ceph-mon[35058]: pgmap v442: 129 pgs: 129 active+clean; 109 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 411 op/s 2024-09-19T05:24:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:13 smithi082 ceph-mon[35195]: pgmap v442: 129 pgs: 129 active+clean; 109 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 411 op/s 2024-09-19T05:24:14.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 224440 13.78 MB/sec warmup 89 sec latency 11.491 ms 2024-09-19T05:24:15.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 227968 13.84 MB/sec warmup 90 sec latency 15.598 ms 2024-09-19T05:24:16.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:15 smithi001 ceph-mon[30968]: pgmap v443: 129 pgs: 129 active+clean; 109 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 321 op/s 2024-09-19T05:24:16.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:15 smithi060 ceph-mon[35058]: pgmap v443: 129 pgs: 129 active+clean; 109 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 321 op/s 2024-09-19T05:24:16.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:15 smithi082 ceph-mon[35195]: pgmap v443: 129 pgs: 129 active+clean; 109 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 321 op/s 2024-09-19T05:24:16.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 231072 13.89 MB/sec warmup 91 sec latency 94.187 ms 2024-09-19T05:24:17.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 234518 13.95 MB/sec warmup 92 sec latency 25.885 ms 2024-09-19T05:24:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:17 smithi001 ceph-mon[30968]: pgmap v444: 129 pgs: 129 active+clean; 113 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 327 op/s 2024-09-19T05:24:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:17 smithi060 ceph-mon[35058]: pgmap v444: 129 pgs: 129 active+clean; 113 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 327 op/s 2024-09-19T05:24:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:17 smithi082 ceph-mon[35195]: pgmap v444: 129 pgs: 129 active+clean; 113 MiB data, 759 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 327 op/s 2024-09-19T05:24:18.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 237957 14.00 MB/sec warmup 93 sec latency 12.337 ms 2024-09-19T05:24:19.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 241359 14.04 MB/sec warmup 94 sec latency 21.947 ms 2024-09-19T05:24:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:19 smithi001 ceph-mon[30968]: pgmap v445: 129 pgs: 129 active+clean; 115 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 405 op/s 2024-09-19T05:24:20.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:19 smithi060 ceph-mon[35058]: pgmap v445: 129 pgs: 129 active+clean; 115 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 405 op/s 2024-09-19T05:24:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:19 smithi082 ceph-mon[35195]: pgmap v445: 129 pgs: 129 active+clean; 115 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.5 MiB/s wr, 405 op/s 2024-09-19T05:24:20.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 244784 14.09 MB/sec warmup 95 sec latency 14.144 ms 2024-09-19T05:24:21.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 247235 14.04 MB/sec warmup 96 sec latency 99.313 ms 2024-09-19T05:24:22.053 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:21 smithi060 ceph-mon[35058]: pgmap v446: 129 pgs: 129 active+clean; 115 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 305 op/s 2024-09-19T05:24:22.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:21 smithi082 ceph-mon[35195]: pgmap v446: 129 pgs: 129 active+clean; 115 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 305 op/s 2024-09-19T05:24:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:21 smithi001 ceph-mon[30968]: pgmap v446: 129 pgs: 129 active+clean; 115 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 305 op/s 2024-09-19T05:24:22.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 250035 14.07 MB/sec warmup 97 sec latency 26.543 ms 2024-09-19T05:24:23.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 253539 14.12 MB/sec warmup 98 sec latency 13.395 ms 2024-09-19T05:24:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:23 smithi001 ceph-mon[30968]: pgmap v447: 129 pgs: 129 active+clean; 117 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 399 op/s 2024-09-19T05:24:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:23 smithi060 ceph-mon[35058]: pgmap v447: 129 pgs: 129 active+clean; 117 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 399 op/s 2024-09-19T05:24:24.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:23 smithi082 ceph-mon[35195]: pgmap v447: 129 pgs: 129 active+clean; 117 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 399 op/s 2024-09-19T05:24:24.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 257125 14.17 MB/sec warmup 99 sec latency 25.930 ms 2024-09-19T05:24:25.276 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T05:24:25.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:24:25.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 260637 14.22 MB/sec warmup 100 sec latency 13.855 ms 2024-09-19T05:24:25.561 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:24:25.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:25 smithi001 ceph-mon[30968]: pgmap v448: 129 pgs: 129 active+clean; 118 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-19T05:24:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 -- 172.21.15.1:0/4017463424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 msgr2=0x7f944c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:26.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 --2- 172.21.15.1:0/4017463424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c1021c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f943c009900 tx=0x7f943c02a410 comp rx=0 tx=0).stop 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 -- 172.21.15.1:0/4017463424 shutdown_connections 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 --2- 172.21.15.1:0/4017463424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c106f10 0x7f944c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 --2- 172.21.15.1:0/4017463424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c102790 0x7f944c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 --2- 172.21.15.1:0/4017463424 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c1021c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 -- 172.21.15.1:0/4017463424 >> 172.21.15.1:0/4017463424 conn(0x7f944c0fd8c0 msgr2=0x7f944c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 -- 172.21.15.1:0/4017463424 shutdown_connections 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.075+0000 7f9451a40640 1 -- 172.21.15.1:0/4017463424 wait complete. 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 Processor -- start 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 -- start start 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c102790 0x7f944c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:26.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c106f10 0x7f944c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f944c111f70 con 0x7f944c101de0 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f944c111df0 con 0x7f944c102790 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.076+0000 7f9451a40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f944c1120f0 con 0x7f944c106f10 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46040/0 (socket says 172.21.15.1:46040) 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 -- 172.21.15.1:0/2930562383 learned_addr learned my addr 172.21.15.1:0/2930562383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944a7fc640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c102790 0x7f944c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944b7fe640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c106f10 0x7f944c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:26.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 -- 172.21.15.1:0/2930562383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c106f10 msgr2=0x7f944c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c106f10 0x7f944c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 -- 172.21.15.1:0/2930562383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c102790 msgr2=0x7f944c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c102790 0x7f944c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 -- 172.21.15.1:0/2930562383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c19f610 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f944affd640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c03f030 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c19f8a0 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f943c004440 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c035070 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.077+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a71e0 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.078+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c1032c0 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.080+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f943c042030 con 0x7f944c101de0 2024-09-19T05:24:26.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.080+0000 7f9450a3e640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.080+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f943c0f0150 con 0x7f944c101de0 2024-09-19T05:24:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.080+0000 7f944a7fc640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.081+0000 7f944a7fc640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f944c10eee0 tx=0x7f9440005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:26.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.084+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f943c0bcac0 con 0x7f944c101de0 2024-09-19T05:24:26.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:25 smithi060 ceph-mon[35058]: pgmap v448: 129 pgs: 129 active+clean; 118 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-19T05:24:26.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:25 smithi082 ceph-mon[35195]: pgmap v448: 129 pgs: 129 active+clean; 118 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-19T05:24:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.301+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f944c1021c0 con 0x7f944c101de0 2024-09-19T05:24:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.302+0000 7f9450a3e640 1 -- 172.21.15.1:0/2930562383 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f944c1021c0 con 0x7f944c101de0 2024-09-19T05:24:26.304 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:24:26.304 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:24:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 msgr2=0x7f94340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f944c10eee0 tx=0x7f9440005f90 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 msgr2=0x7f944c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c004040 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 shutdown_connections 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f94340a3240 0x7f94340a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f944c106f10 0x7f944c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f944c102790 0x7f944c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 --2- 172.21.15.1:0/2930562383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f944c101de0 0x7f944c19a660 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 >> 172.21.15.1:0/2930562383 conn(0x7f944c0fd8c0 msgr2=0x7f944c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 shutdown_connections 2024-09-19T05:24:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:26.304+0000 7f9451a40640 1 -- 172.21.15.1:0/2930562383 wait complete. 2024-09-19T05:24:26.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 263234 14.22 MB/sec warmup 101 sec latency 61.073 ms 2024-09-19T05:24:27.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:26 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2930562383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:27.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:26 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2930562383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:27.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:26 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2930562383' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:27.314 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T05:24:27.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T05:24:27.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 266466 14.27 MB/sec warmup 102 sec latency 23.044 ms 2024-09-19T05:24:27.600 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:24:28.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:27 smithi001 ceph-mon[30968]: pgmap v449: 129 pgs: 129 active+clean; 121 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 359 op/s 2024-09-19T05:24:28.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:27 smithi060 ceph-mon[35058]: pgmap v449: 129 pgs: 129 active+clean; 121 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 359 op/s 2024-09-19T05:24:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:27 smithi082 ceph-mon[35195]: pgmap v449: 129 pgs: 129 active+clean; 121 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 359 op/s 2024-09-19T05:24:28.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269847 14.31 MB/sec warmup 103 sec latency 25.886 ms 2024-09-19T05:24:28.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2563548921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4102790 msgr2=0x7f02e41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2563548921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4102790 0x7f02e41067e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009900 tx=0x7f02d802a410 comp rx=0 tx=0).stop 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2563548921 shutdown_connections 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2563548921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4106f10 0x7f02e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2563548921 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4102790 0x7f02e41067e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2563548921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4101de0 0x7f02e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2563548921 >> 172.21.15.1:0/2563548921 conn(0x7f02e40fd8c0 msgr2=0x7f02e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.344+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2563548921 shutdown_connections 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.345+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2563548921 wait complete. 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.345+0000 7f02ea2d0640 1 Processor -- start 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.345+0000 7f02ea2d0640 1 -- start start 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.345+0000 7f02ea2d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4102790 0x7f02e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4111f70 con 0x7f02e4106f10 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4111df0 con 0x7f02e4101de0 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41120f0 con 0x7f02e4102790 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:48898/0 (socket says 172.21.15.1:48898) 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 -- 172.21.15.1:0/2321118337 learned_addr learned my addr 172.21.15.1:0/2321118337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46066/0 (socket says 172.21.15.1:46066) 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e37fe640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4102790 0x7f02e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 -- 172.21.15.1:0/2321118337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4102790 msgr2=0x7f02e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4102790 0x7f02e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 -- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 msgr2=0x7f02e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 -- 172.21.15.1:0/2321118337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e41a68f0 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e886d640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e3fff640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02d400e9f0 tx=0x7f02d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02e17fa640 1 -- 172.21.15.1:0/2321118337 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d400cd80 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.346+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e41a6be0 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.347+0000 7f02e17fa640 1 -- 172.21.15.1:0/2321118337 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d4010910 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.347+0000 7f02e17fa640 1 -- 172.21.15.1:0/2321118337 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d40188f0 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.347+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e41a7140 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02e17fa640 1 -- 172.21.15.1:0/2321118337 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f02d4010ac0 con 0x7f02e4101de0 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 Processor -- start 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 -- start start 2024-09-19T05:24:28.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9505400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb9507d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cdb94602a0 con 0x55cdb94fa760 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cdb9407b10 con 0x55cdb94fb080 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cdb945c260 con 0x55cdb9505940 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.349+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46072/0 (socket says 172.21.15.1:46072) 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e886d640 1 -- 172.21.15.1:0/1104975509 learned_addr learned my addr 172.21.15.1:0/1104975509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9505400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb9507d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e17fa640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 0x7f02cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 -- 172.21.15.1:0/1104975509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 msgr2=0x55cdb9505400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9505400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 -- 172.21.15.1:0/1104975509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 msgr2=0x55cdb94fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 -- 172.21.15.1:0/1104975509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb91d1b90 con 0x55cdb9505940 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e886d640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e886d640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 0x7f02cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e17fa640 1 -- 172.21.15.1:0/2321118337 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f02d40d0070 con 0x7f02e4101de0 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb9507d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005940 tx=0x7f02d8005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8776bddbeb7ccc17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02ca7fc640 1 -- 172.21.15.1:0/1104975509 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8040070 con 0x55cdb9505940 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02ca7fc640 1 -- 172.21.15.1:0/1104975509 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d80318f0 con 0x55cdb9505940 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02ca7fc640 1 -- 172.21.15.1:0/1104975509 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8035040 con 0x55cdb9505940 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.350+0000 7f02e886d640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 0x7f02cc0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0092f0 tx=0x7f02dc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1104975509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 msgr2=0x55cdb9507d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb9507d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005940 tx=0x7f02d8005e00 comp rx=0 tx=0).stop 2024-09-19T05:24:28.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1104975509 shutdown_connections 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb9507d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9505400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1104975509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb94fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1104975509 >> 172.21.15.1:0/1104975509 conn(0x55cdb94f6cf0 msgr2=0x55cdb94f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1104975509 shutdown_connections 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1104975509 wait complete. 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.351+0000 7f02ec6a9740 1 -- start start 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 Processor -- start 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 0x55cdb9502ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb95031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cdb9508510 con 0x55cdb9505940 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cdb93e86e0 con 0x55cdb94fa760 2024-09-19T05:24:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cdb9508690 con 0x55cdb94fb080 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02ec6a9740 10 client.0 _ll_register_callbacks cb 0x55cdb940ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb95031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 0x55cdb9502ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:48920/0 (socket says 172.21.15.1:48920) 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 -- 172.21.15.1:0/1969438630 learned_addr learned my addr 172.21.15.1:0/1969438630 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 0x55cdb9502ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:38942/0 (socket says 172.21.15.1:38942) 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 -- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 msgr2=0x55cdb9502ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 0x55cdb9502ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 -- 172.21.15.1:0/1969438630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 msgr2=0x55cdb95031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb95031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e3fff640 1 -- 172.21.15.1:0/1969438630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb9511980 con 0x55cdb94fa760 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.352+0000 7f02e886d640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb95031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02d400e9c0 tx=0x7f02d409c160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebf89f346f7d8db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d409c390 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f02d40d2110 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d80318f0 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f02d40a0690 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 10 client.25016 fetch_fsmap learned FSMap version 21 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cdb9514370 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02d80318f0 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f02d409b7e0 con 0x55cdb94fa760 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 10 client.25016 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:24:28.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 10 client.25016 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 20 client.25016 populate_metadata read hostname 'smithi001' 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb9515780 0x55cdb9517b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 4 client.25016 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.353+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdb946d9d0 con 0x55cdb9515780 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.354+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb9515780 0x55cdb9517b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.354+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb9515780 0x55cdb9517b70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55ae4386f12afa4 server_cookie=a621123771e46224 in_seq=0 out_seq=0 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.354+0000 7f02c37fe640 10 client.25016 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02c37fe640 1 -- 172.21.15.1:0/1969438630 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdb946d9d0 con 0x55cdb9515780 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02c37fe640 10 client.25016 handle_command_reply: tid=0 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 client.25016 shutdown 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 msgr2=0x55cdb9502760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02d400e9c0 tx=0x7f02d409c160 comp rx=0 tx=0).stop 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 shutdown_connections 2024-09-19T05:24:28.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb95031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb9515780 0x55cdb9517b70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fb080 0x55cdb9502ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1969438630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fa760 0x55cdb9502760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02c37fe640 0 client.25016 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 >> 172.21.15.1:0/1969438630 conn(0x55cdb94f6cf0 msgr2=0x55cdb94fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 shutdown_connections 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1969438630 wait complete. 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.355+0000 7f02ec6a9740 20 client.25016 trim_cache size 0 max 16384 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 Processor -- start 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 -- start start 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 0x55cdb9501a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9504630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41aeeb0 con 0x55cdb9505940 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41b1730 con 0x55cdb94fb080 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41af520 con 0x55cdb94fa760 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02e886d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46084/0 (socket says 172.21.15.1:46084) 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02e886d640 1 -- 172.21.15.1:0/3349227497 learned_addr learned my addr 172.21.15.1:0/3349227497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02e3fff640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 0x55cdb9501a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.375+0000 7f02e37fe640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9504630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 -- 172.21.15.1:0/3349227497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 msgr2=0x55cdb9501a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 0x55cdb9501a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 -- 172.21.15.1:0/3349227497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 msgr2=0x55cdb9504630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9504630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 -- 172.21.15.1:0/3349227497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb94f6b20 con 0x55cdb9505940 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e3fff640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 0x55cdb9501a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e37fe640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9504630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02e886d640 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005ee0 tx=0x7f02dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7de08da64f05b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02c9ffb640 1 -- 172.21.15.1:0/3349227497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc013e40 con 0x55cdb9505940 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02c9ffb640 1 -- 172.21.15.1:0/3349227497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc029960 con 0x55cdb9505940 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.376+0000 7f02c9ffb640 1 -- 172.21.15.1:0/3349227497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc01cab0 con 0x55cdb9505940 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- 172.21.15.1:0/3349227497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 msgr2=0x55cdb94fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005ee0 tx=0x7f02dc017000 comp rx=0 tx=0).stop 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- 172.21.15.1:0/3349227497 shutdown_connections 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb9505940 0x55cdb94fd1c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb9504630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/3349227497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb94fa760 0x55cdb9501a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- 172.21.15.1:0/3349227497 >> 172.21.15.1:0/3349227497 conn(0x55cdb94f6cf0 msgr2=0x55cdb94f5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- 172.21.15.1:0/3349227497 shutdown_connections 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- 172.21.15.1:0/3349227497 wait complete. 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 -- start start 2024-09-19T05:24:28.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.377+0000 7f02ec6a9740 1 Processor -- start 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb950a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb95793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41afbf0 con 0x55cdb94fa760 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41b1060 con 0x55cdb94fb080 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41b02c0 con 0x55cdb9505940 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02ec6a9740 10 client.0 _ll_register_callbacks cb 0x7f02d4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46098/0 (socket says 172.21.15.1:46098) 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 -- 172.21.15.1:0/1949669943 learned_addr learned my addr 172.21.15.1:0/1949669943 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb950a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e886d640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb95793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 -- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 msgr2=0x55cdb95793b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb95793b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 -- 172.21.15.1:0/1949669943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 msgr2=0x55cdb950a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb950a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.378+0000 7f02e3fff640 1 -- 172.21.15.1:0/1949669943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb94f2260 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.380+0000 7f02e3fff640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f02d409a640 tx=0x7f02d409c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d188ad8fba3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.380+0000 7f02c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.381+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d409c390 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.381+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f02d4010430 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.382+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02dc029960 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.383+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f02d40a4f50 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 10 client.15369 fetch_fsmap learned FSMap version 21 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cdb9580b60 con 0x55cdb94fa760 2024-09-19T05:24:28.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc029960 con 0x55cdb94fa760 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f02d4018a90 con 0x55cdb94fa760 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 10 client.15369 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 10 client.15369 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 20 client.15369 populate_metadata read hostname 'smithi001' 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb95812a0 0x55cdb95836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 4 client.15369 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.384+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x55cdb9467d20 con 0x55cdb95812a0 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.386+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb95812a0 0x55cdb95836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.390+0000 7f02e37fe640 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb95812a0 0x55cdb95836c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee8704720a8e2c7 server_cookie=e0581fb471b5fe49 in_seq=0 out_seq=0 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.390+0000 7f02c37fe640 10 client.15369 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02c37fe640 1 -- 172.21.15.1:0/1949669943 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55cdb9467d20 con 0x55cdb95812a0 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02c37fe640 10 client.15369 handle_command_reply: tid=0 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 client.15369 shutdown 2024-09-19T05:24:28.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 msgr2=0x55cdb9509ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f02d409a640 tx=0x7f02d409c290 comp rx=0 tx=0).stop 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 shutdown_connections 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55cdb95812a0 0x55cdb95836c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cdb9505940 0x55cdb95793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.499+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cdb94fb080 0x55cdb950a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ec6a9740 1 --2- 172.21.15.1:0/1949669943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cdb94fa760 0x55cdb9509ea0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02c37fe640 0 client.15369 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:24:28.711 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 14, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "5968a338": { 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 14, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:24:28.712 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:24:28.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 >> 172.21.15.1:0/1949669943 conn(0x55cdb94f6cf0 msgr2=0x55cdb9502f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 shutdown_connections 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ec6a9740 1 -- 172.21.15.1:0/1949669943 wait complete. 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ec6a9740 20 client.15369 trim_cache size 0 max 16384 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 msgr2=0x7f02cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 0x7f02cc0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0092f0 tx=0x7f02dc004a40 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 msgr2=0x7f02e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.500+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02d400e9f0 tx=0x7f02d400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 shutdown_connections 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02cc0a3240 0x7f02cc0a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02e4106f10 0x7f02e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02e4102790 0x7f02e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 --2- 172.21.15.1:0/2321118337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02e4101de0 0x7f02e40744f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:28.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 >> 172.21.15.1:0/2321118337 conn(0x7f02e40fd8c0 msgr2=0x7f02e40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 shutdown_connections 2024-09-19T05:24:28.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:28.501+0000 7f02ea2d0640 1 -- 172.21.15.1:0/2321118337 wait complete. 2024-09-19T05:24:29.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 14.17 MB/sec warmup 104 sec latency 868.290 ms 2024-09-19T05:24:29.559 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5968a338', quiesce took 4.3 seconds. Will release after: 12.3 2024-09-19T05:24:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:29 smithi001 ceph-mon[30968]: pgmap v450: 129 pgs: 129 active+clean; 120 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 334 op/s 2024-09-19T05:24:30.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:29 smithi060 ceph-mon[35058]: pgmap v450: 129 pgs: 129 active+clean; 120 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 334 op/s 2024-09-19T05:24:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:29 smithi082 ceph-mon[35195]: pgmap v450: 129 pgs: 129 active+clean; 120 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 334 op/s 2024-09-19T05:24:30.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 14.04 MB/sec warmup 105 sec latency 1868.394 ms 2024-09-19T05:24:31.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.91 MB/sec warmup 106 sec latency 2868.473 ms 2024-09-19T05:24:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:31 smithi001 ceph-mon[30968]: pgmap v451: 129 pgs: 129 active+clean; 120 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-19T05:24:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:31 smithi060 ceph-mon[35058]: pgmap v451: 129 pgs: 129 active+clean; 120 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-19T05:24:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:31 smithi082 ceph-mon[35195]: pgmap v451: 129 pgs: 129 active+clean; 120 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-19T05:24:32.369 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.78 MB/sec warmup 107 sec latency 3868.595 ms 2024-09-19T05:24:33.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.65 MB/sec warmup 108 sec latency 4868.701 ms 2024-09-19T05:24:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:33 smithi001 ceph-mon[30968]: pgmap v452: 129 pgs: 129 active+clean; 123 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 329 op/s 2024-09-19T05:24:34.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:33 smithi060 ceph-mon[35058]: pgmap v452: 129 pgs: 129 active+clean; 123 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 329 op/s 2024-09-19T05:24:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:33 smithi082 ceph-mon[35195]: pgmap v452: 129 pgs: 129 active+clean; 123 MiB data, 991 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 329 op/s 2024-09-19T05:24:34.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.52 MB/sec warmup 109 sec latency 5868.793 ms 2024-09-19T05:24:35.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.40 MB/sec warmup 110 sec latency 6868.895 ms 2024-09-19T05:24:36.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:35 smithi001 ceph-mon[30968]: pgmap v453: 129 pgs: 129 active+clean; 125 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-19T05:24:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:35 smithi060 ceph-mon[35058]: pgmap v453: 129 pgs: 129 active+clean; 125 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-19T05:24:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:35 smithi082 ceph-mon[35195]: pgmap v453: 129 pgs: 129 active+clean; 125 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 235 op/s 2024-09-19T05:24:36.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.28 MB/sec warmup 111 sec latency 7869.001 ms 2024-09-19T05:24:37.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.16 MB/sec warmup 112 sec latency 8869.130 ms 2024-09-19T05:24:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:37 smithi001 ceph-mon[30968]: pgmap v454: 129 pgs: 129 active+clean; 125 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 232 op/s 2024-09-19T05:24:38.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:37 smithi060 ceph-mon[35058]: pgmap v454: 129 pgs: 129 active+clean; 125 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 232 op/s 2024-09-19T05:24:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:37 smithi082 ceph-mon[35195]: pgmap v454: 129 pgs: 129 active+clean; 125 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 232 op/s 2024-09-19T05:24:38.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 13.04 MB/sec warmup 113 sec latency 9869.238 ms 2024-09-19T05:24:39.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.93 MB/sec warmup 114 sec latency 10869.346 ms 2024-09-19T05:24:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:39 smithi001 ceph-mon[30968]: pgmap v455: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-09-19T05:24:40.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:39 smithi060 ceph-mon[35058]: pgmap v455: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-09-19T05:24:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:39 smithi082 ceph-mon[35195]: pgmap v455: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 186 op/s 2024-09-19T05:24:40.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.82 MB/sec warmup 115 sec latency 11869.474 ms 2024-09-19T05:24:41.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.71 MB/sec warmup 116 sec latency 12869.535 ms 2024-09-19T05:24:41.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:24:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:41 smithi001 ceph-mon[30968]: pgmap v456: 129 pgs: 129 active+clean; 123 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2024-09-19T05:24:42.135 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:24:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:41 smithi060 ceph-mon[35058]: pgmap v456: 129 pgs: 129 active+clean; 123 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2024-09-19T05:24:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:41 smithi082 ceph-mon[35195]: pgmap v456: 129 pgs: 129 active+clean; 123 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 2.6 MiB/s wr, 140 op/s 2024-09-19T05:24:42.370 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.60 MB/sec warmup 117 sec latency 13869.626 ms 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 -- 172.21.15.1:0/1204544494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 msgr2=0x7fd380100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 --2- 172.21.15.1:0/1204544494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380100ee0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd374009930 tx=0x7fd37402a420 comp rx=0 tx=0).stop 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 -- 172.21.15.1:0/1204544494 shutdown_connections 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 --2- 172.21.15.1:0/1204544494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 0x7fd38010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 --2- 172.21.15.1:0/1204544494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380100ee0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 --2- 172.21.15.1:0/1204544494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 0x7fd380106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 -- 172.21.15.1:0/1204544494 >> 172.21.15.1:0/1204544494 conn(0x7fd3800fc7a0 msgr2=0x7fd3800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 -- 172.21.15.1:0/1204544494 shutdown_connections 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.641+0000 7fd386753640 1 -- 172.21.15.1:0/1204544494 wait complete. 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 Processor -- start 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 -- start start 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 0x7fd3801989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 0x7fd38019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd380110e80 con 0x7fd380100a80 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd380110d00 con 0x7fd380106a80 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd386753640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd380111000 con 0x7fd380101420 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd37ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42264/0 (socket says 172.21.15.1:42264) 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd37ffff640 1 -- 172.21.15.1:0/4098792001 learned_addr learned my addr 172.21.15.1:0/4098792001 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:42.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd384cf0640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 0x7fd38019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.642+0000 7fd37f7fe640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 0x7fd3801989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 -- 172.21.15.1:0/4098792001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 msgr2=0x7fd3801989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 0x7fd3801989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 -- 172.21.15.1:0/4098792001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 msgr2=0x7fd38019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 0x7fd38019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 -- 172.21.15.1:0/4098792001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38019d410 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37ffff640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd37000e9f0 tx=0x7fd37000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37000cd80 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd370010910 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38019d700 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370018990 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.643+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3801a4fe0 con 0x7fd380100a80 2024-09-19T05:24:42.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.644+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380100ee0 con 0x7fd380100a80 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.645+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd370010ac0 con 0x7fd380100a80 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.646+0000 7fd37d7fa640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 0x7fd3680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.646+0000 7fd37f7fe640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 0x7fd3680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.646+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd3700cff50 con 0x7fd380100a80 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.647+0000 7fd37f7fe640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 0x7fd3680a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd3740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:42.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.650+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd37009c270 con 0x7fd380100a80 2024-09-19T05:24:42.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.863+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd38010a000 con 0x7fd380100a80 2024-09-19T05:24:42.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.864+0000 7fd37d7fa640 1 -- 172.21.15.1:0/4098792001 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fd3700a0570 con 0x7fd380100a80 2024-09-19T05:24:42.866 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:24:42.867 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:24:42.867 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:24:42.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 msgr2=0x7fd3680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:42.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 0x7fd3680a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd3740058d0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 msgr2=0x7fd380198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd37000e9f0 tx=0x7fd37000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 shutdown_connections 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd3680a3240 0x7fd3680a5700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd380106a80 0x7fd38019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd380101420 0x7fd3801989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 --2- 172.21.15.1:0/4098792001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd380100a80 0x7fd380198460 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 >> 172.21.15.1:0/4098792001 conn(0x7fd3800fc7a0 msgr2=0x7fd38006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 shutdown_connections 2024-09-19T05:24:42.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:42.866+0000 7fd386753640 1 -- 172.21.15.1:0/4098792001 wait complete. 2024-09-19T05:24:43.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.49 MB/sec warmup 118 sec latency 14869.703 ms 2024-09-19T05:24:43.653 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 5968a338 --release --await' 2024-09-19T05:24:43.653 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 5968a338 --release --await 2024-09-19T05:24:43.910 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:24:44.031 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:43 smithi001 ceph-mon[30968]: pgmap v457: 129 pgs: 129 active+clean; 121 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2024-09-19T05:24:44.031 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4098792001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:43 smithi060 ceph-mon[35058]: pgmap v457: 129 pgs: 129 active+clean; 121 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2024-09-19T05:24:44.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4098792001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:43 smithi082 ceph-mon[35195]: pgmap v457: 129 pgs: 129 active+clean; 121 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2024-09-19T05:24:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4098792001' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:24:44.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 269870 12.39 MB/sec warmup 119 sec latency 15869.773 ms 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 -- 172.21.15.1:0/4229739688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624102790 msgr2=0x7fc6241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 --2- 172.21.15.1:0/4229739688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624102790 0x7fc6241067e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc610009900 tx=0x7fc61002a410 comp rx=0 tx=0).stop 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 -- 172.21.15.1:0/4229739688 shutdown_connections 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 --2- 172.21.15.1:0/4229739688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624106f10 0x7fc62410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 --2- 172.21.15.1:0/4229739688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624102790 0x7fc6241067e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 --2- 172.21.15.1:0/4229739688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624101de0 0x7fc6241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.391+0000 7fc62ac86640 1 -- 172.21.15.1:0/4229739688 >> 172.21.15.1:0/4229739688 conn(0x7fc6240fd8c0 msgr2=0x7fc6240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- 172.21.15.1:0/4229739688 shutdown_connections 2024-09-19T05:24:44.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- 172.21.15.1:0/4229739688 wait complete. 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 Processor -- start 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- start start 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624102790 0x7fc6241989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 0x7fc62419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc624111f30 con 0x7fc624101de0 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc624111db0 con 0x7fc624102790 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc62ac86640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241120b0 con 0x7fc624106f10 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37356/0 (socket says 172.21.15.1:37356) 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.392+0000 7fc628a22640 1 -- 172.21.15.1:0/3666864291 learned_addr learned my addr 172.21.15.1:0/3666864291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:44.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc623fff640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624102790 0x7fc6241989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc629223640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 0x7fc62419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 -- 172.21.15.1:0/3666864291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 msgr2=0x7fc62419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 0x7fc62419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 -- 172.21.15.1:0/3666864291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624102790 msgr2=0x7fc6241989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624102790 0x7fc6241989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 -- 172.21.15.1:0/3666864291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62419d440 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc629223640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 0x7fc62419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc628a22640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc61800d950 tx=0x7fc61800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc621ffb640 1 -- 172.21.15.1:0/3666864291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618017070 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc621ffb640 1 -- 172.21.15.1:0/3666864291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc618009c30 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62419d730 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc621ffb640 1 -- 172.21.15.1:0/3666864291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61800f6b0 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.393+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6241a5010 con 0x7fc624101de0 2024-09-19T05:24:44.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.395+0000 7fc621ffb640 1 -- 172.21.15.1:0/3666864291 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc6180109d0 con 0x7fc624101de0 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 Processor -- start 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 -- start start 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0541360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0552a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5607d04a6620 con 0x5607d05418a0 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5607d044de50 con 0x5607d0550650 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc62d05f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607d04a25e0 con 0x5607d0540f80 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc621ffb640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 0x7fc6140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37372/0 (socket says 172.21.15.1:37372) 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc628a22640 1 -- 172.21.15.1:0/3262001693 learned_addr learned my addr 172.21.15.1:0/3262001693 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:44.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc629223640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0541360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc623fff640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0552a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.396+0000 7fc629223640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 0x7fc6140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc621ffb640 1 -- 172.21.15.1:0/3666864291 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc6180cf9b0 con 0x7fc624101de0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 -- 172.21.15.1:0/3262001693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 msgr2=0x5607d0541360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0541360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 -- 172.21.15.1:0/3262001693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 msgr2=0x5607d0552a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0552a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 -- 172.21.15.1:0/3262001693 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d043ed40 con 0x5607d05418a0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc629223640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0541360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc623fff640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0552a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc628a22640 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc61801d000 tx=0x7fc61800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1f69a3f224cd2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc629223640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 0x7fc6140a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc61c005c40 tx=0x7fc61c009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc60effd640 1 -- 172.21.15.1:0/3262001693 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618020070 con 0x5607d05418a0 2024-09-19T05:24:44.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc60effd640 1 -- 172.21.15.1:0/3262001693 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc61809c2c0 con 0x5607d05418a0 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.397+0000 7fc60effd640 1 -- 172.21.15.1:0/3262001693 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618098230 con 0x5607d05418a0 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- 172.21.15.1:0/3262001693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 msgr2=0x5607d0550110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc61801d000 tx=0x7fc61800bf60 comp rx=0 tx=0).stop 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- 172.21.15.1:0/3262001693 shutdown_connections 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0552a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0550110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 --2- 172.21.15.1:0/3262001693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0541360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- 172.21.15.1:0/3262001693 >> 172.21.15.1:0/3262001693 conn(0x5607d053d5f0 msgr2=0x5607d053d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- 172.21.15.1:0/3262001693 shutdown_connections 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- 172.21.15.1:0/3262001693 wait complete. 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 -- start start 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.398+0000 7fc62d05f740 1 Processor -- start 2024-09-19T05:24:44.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d05418a0 0x5607d054daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0550650 0x5607d054e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5607d0553160 con 0x5607d0540f80 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5607d042ef10 con 0x5607d05418a0 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607d05532e0 con 0x5607d0550650 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc62d05f740 10 client.0 _ll_register_callbacks cb 0x5607d0452db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37384/0 (socket says 172.21.15.1:37384) 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 -- 172.21.15.1:0/322817707 learned_addr learned my addr 172.21.15.1:0/322817707 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc623fff640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d05418a0 0x5607d054daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc629223640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0550650 0x5607d054e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 -- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0550650 msgr2=0x5607d054e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0550650 0x5607d054e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 -- 172.21.15.1:0/322817707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d05418a0 msgr2=0x5607d054daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d05418a0 0x5607d054daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 -- 172.21.15.1:0/322817707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d01b5580 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc628a22640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc6180aa1f0 tx=0x7fc618000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b9017e3f403b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.399+0000 7fc603fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618020030 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc6180a2760 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc61809c2c0 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc61809bbc0 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 10 client.15387 fetch_fsmap learned FSMap version 21 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607d027f960 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc61809c2c0 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc6180860b0 con 0x5607d0540f80 2024-09-19T05:24:44.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 10 client.15387 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 10 client.15387 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 20 client.15387 populate_metadata read hostname 'smithi001' 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d0562430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 4 client.15387 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.400+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607d04b3b90 con 0x5607d0560040 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.401+0000 7fc623fff640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d0562430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.401+0000 7fc623fff640 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d0562430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d28b163008926254 server_cookie=87220af57b75219f in_seq=0 out_seq=0 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.401+0000 7fc603fff640 10 client.15387 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc603fff640 1 -- 172.21.15.1:0/322817707 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607d04b3b90 con 0x5607d0560040 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc603fff640 10 client.15387 handle_command_reply: tid=0 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 client.15387 shutdown 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 msgr2=0x5607d054d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc6180aa1f0 tx=0x7fc618000bc0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 shutdown_connections 2024-09-19T05:24:44.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d0562430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc603fff640 0 client.15387 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0550650 0x5607d054e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d05418a0 0x5607d054daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 --2- 172.21.15.1:0/322817707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d054d5b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 >> 172.21.15.1:0/322817707 conn(0x5607d053d5f0 msgr2=0x5607d053c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 shutdown_connections 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 1 -- 172.21.15.1:0/322817707 wait complete. 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.402+0000 7fc62d05f740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 Processor -- start 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 -- start start 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0565450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d054a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241aab00 con 0x5607d05418a0 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ad380 con 0x5607d0550650 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc62d05f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ab170 con 0x5607d0540f80 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc623fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc623fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37392/0 (socket says 172.21.15.1:37392) 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.419+0000 7fc623fff640 1 -- 172.21.15.1:0/4288065699 learned_addr learned my addr 172.21.15.1:0/4288065699 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc629223640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d054a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc628a22640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0565450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 -- 172.21.15.1:0/4288065699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 msgr2=0x5607d0565450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0565450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 -- 172.21.15.1:0/4288065699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 msgr2=0x5607d054a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d054a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 -- 172.21.15.1:0/4288065699 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d0552db0 con 0x5607d05418a0 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc629223640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d054a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc623fff640 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a930 tx=0x7fc610031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f15c79921a80c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc60e7fc640 1 -- 172.21.15.1:0/4288065699 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610035040 con 0x5607d05418a0 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc60e7fc640 1 -- 172.21.15.1:0/4288065699 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc610005500 con 0x5607d05418a0 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.420+0000 7fc60e7fc640 1 -- 172.21.15.1:0/4288065699 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610004d70 con 0x5607d05418a0 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- 172.21.15.1:0/4288065699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 msgr2=0x5607d0565990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a930 tx=0x7fc610031b30 comp rx=0 tx=0).stop 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- 172.21.15.1:0/4288065699 shutdown_connections 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d054a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d05418a0 0x5607d0565990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- 172.21.15.1:0/4288065699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d0540f80 0x5607d0565450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- 172.21.15.1:0/4288065699 >> 172.21.15.1:0/4288065699 conn(0x5607d053d5f0 msgr2=0x5607d055bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- 172.21.15.1:0/4288065699 shutdown_connections 2024-09-19T05:24:44.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- 172.21.15.1:0/4288065699 wait complete. 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 -- start start 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 Processor -- start 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.421+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d05418a0 0x5607d0565a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0563980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ab840 con 0x5607d0540f80 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241accb0 con 0x5607d0550650 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241abf10 con 0x5607d05418a0 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 10 client.0 _ll_register_callbacks cb 0x7fc6180056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37398/0 (socket says 172.21.15.1:37398) 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc629223640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0563980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 -- 172.21.15.1:0/2188503827 learned_addr learned my addr 172.21.15.1:0/2188503827 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:24:44.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc623fff640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d05418a0 0x5607d0565a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 -- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d05418a0 msgr2=0x5607d0565a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d05418a0 0x5607d0565a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 -- 172.21.15.1:0/2188503827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 msgr2=0x5607d0563980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0563980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 -- 172.21.15.1:0/2188503827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d05641b0 con 0x5607d0540f80 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc628a22640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc618098590 tx=0x7fc6180a48b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b1fa4d248a13e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc603fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618020050 con 0x5607d0540f80 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc6180ba2a0 con 0x5607d0540f80 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc610005500 con 0x5607d0540f80 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc61809b990 con 0x5607d0540f80 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 10 client.15393 fetch_fsmap learned FSMap version 21 2024-09-19T05:24:44.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.422+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607d05641b0 con 0x5607d0540f80 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc610005500 con 0x5607d0540f80 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc61809aa80 con 0x5607d0540f80 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 10 client.15393 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 10 client.15393 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 20 client.15393 populate_metadata read hostname 'smithi001' 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d05cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 4 client.15393 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5968a338", "release": true, "await": true}] 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5968a338", "release": true, "await": true}) -- 0x5607d04ae0a0 con 0x5607d0560040 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.423+0000 7fc623fff640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d05cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.424+0000 7fc623fff640 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d05cd880 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61110da5c91769b server_cookie=fac924036b9606e4 in_seq=0 out_seq=0 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.424+0000 7fc603fff640 10 client.15393 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc603fff640 1 -- 172.21.15.1:0/2188503827 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5607d04ae0a0 con 0x5607d0560040 2024-09-19T05:24:44.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc603fff640 10 client.15393 handle_command_reply: tid=0 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 client.15393 shutdown 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 msgr2=0x5607d0565520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc618098590 tx=0x7fc6180a48b0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 shutdown_connections 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5607d0550650 0x5607d0563980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5607d0560040 0x5607d05cd880 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607d05418a0 0x5607d0565a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 --2- 172.21.15.1:0/2188503827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607d0540f80 0x5607d0565520 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc603fff640 0 client.15393 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.435+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 >> 172.21.15.1:0/2188503827 conn(0x5607d053d5f0 msgr2=0x5607d053bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 shutdown_connections 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62d05f740 1 -- 172.21.15.1:0/2188503827 wait complete. 2024-09-19T05:24:44.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62d05f740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 16, 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "5968a338": { 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 16, 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:24:44.523 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:44.524 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 msgr2=0x7fc6140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 0x7fc6140a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc61c005c40 tx=0x7fc61c009280 comp rx=0 tx=0).stop 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 msgr2=0x7fc624198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc61800d950 tx=0x7fc61800de10 comp rx=0 tx=0).stop 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 shutdown_connections 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc6140a3240 0x7fc6140a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc624106f10 0x7fc62419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc624102790 0x7fc6241989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 --2- 172.21.15.1:0/3666864291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc624101de0 0x7fc624198490 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:44.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 >> 172.21.15.1:0/3666864291 conn(0x7fc6240fd8c0 msgr2=0x7fc6240fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:44.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 shutdown_connections 2024-09-19T05:24:44.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:24:44.436+0000 7fc62ac86640 1 -- 172.21.15.1:0/3666864291 wait complete. 2024-09-19T05:24:45.454 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5968a338', total seconds elapsed: 20.2 2024-09-19T05:24:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:45 smithi001 ceph-mon[30968]: pgmap v458: 129 pgs: 129 active+clean; 121 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:24:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:45 smithi060 ceph-mon[35058]: pgmap v458: 129 pgs: 129 active+clean; 121 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:24:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:45 smithi082 ceph-mon[35195]: pgmap v458: 129 pgs: 129 active+clean; 121 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:24:46.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 276513 15.96 MB/sec execute 1 sec latency 15931.247 ms 2024-09-19T05:24:47.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 279571 15.92 MB/sec execute 2 sec latency 64.657 ms 2024-09-19T05:24:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:47 smithi001 ceph-mon[30968]: pgmap v459: 129 pgs: 129 active+clean; 121 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 2.6 MiB/s wr, 102 op/s 2024-09-19T05:24:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:47 smithi060 ceph-mon[35058]: pgmap v459: 129 pgs: 129 active+clean; 121 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 2.6 MiB/s wr, 102 op/s 2024-09-19T05:24:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:47 smithi082 ceph-mon[35195]: pgmap v459: 129 pgs: 129 active+clean; 121 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 2.6 MiB/s wr, 102 op/s 2024-09-19T05:24:48.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 282642 15.58 MB/sec execute 3 sec latency 29.890 ms 2024-09-19T05:24:49.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 285927 16.14 MB/sec execute 4 sec latency 14.675 ms 2024-09-19T05:24:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:49 smithi001 ceph-mon[30968]: pgmap v460: 129 pgs: 129 active+clean; 118 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-19T05:24:50.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:49 smithi060 ceph-mon[35058]: pgmap v460: 129 pgs: 129 active+clean; 118 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-19T05:24:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:49 smithi082 ceph-mon[35195]: pgmap v460: 129 pgs: 129 active+clean; 118 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-19T05:24:50.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 288820 16.61 MB/sec execute 5 sec latency 28.467 ms 2024-09-19T05:24:51.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 291943 16.50 MB/sec execute 6 sec latency 14.456 ms 2024-09-19T05:24:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:51 smithi001 ceph-mon[30968]: pgmap v461: 129 pgs: 129 active+clean; 117 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.6 MiB/s wr, 106 op/s 2024-09-19T05:24:52.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:51 smithi060 ceph-mon[35058]: pgmap v461: 129 pgs: 129 active+clean; 117 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.6 MiB/s wr, 106 op/s 2024-09-19T05:24:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:51 smithi082 ceph-mon[35195]: pgmap v461: 129 pgs: 129 active+clean; 117 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.6 MiB/s wr, 106 op/s 2024-09-19T05:24:52.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 294873 16.60 MB/sec execute 7 sec latency 89.079 ms 2024-09-19T05:24:53.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 298196 16.88 MB/sec execute 8 sec latency 36.876 ms 2024-09-19T05:24:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:53 smithi001 ceph-mon[30968]: pgmap v462: 129 pgs: 129 active+clean; 122 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2024-09-19T05:24:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:53 smithi060 ceph-mon[35058]: pgmap v462: 129 pgs: 129 active+clean; 122 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2024-09-19T05:24:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:53 smithi082 ceph-mon[35195]: pgmap v462: 129 pgs: 129 active+clean; 122 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 230 op/s 2024-09-19T05:24:54.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 301509 16.97 MB/sec execute 9 sec latency 21.281 ms 2024-09-19T05:24:55.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 304871 16.89 MB/sec execute 10 sec latency 15.778 ms 2024-09-19T05:24:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:55 smithi001 ceph-mon[30968]: pgmap v463: 129 pgs: 129 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-19T05:24:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:55 smithi060 ceph-mon[35058]: pgmap v463: 129 pgs: 129 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-19T05:24:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:55 smithi082 ceph-mon[35195]: pgmap v463: 129 pgs: 129 active+clean; 123 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 221 op/s 2024-09-19T05:24:56.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 307993 16.92 MB/sec execute 11 sec latency 12.865 ms 2024-09-19T05:24:57.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 310960 16.63 MB/sec execute 12 sec latency 49.424 ms 2024-09-19T05:24:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:57 smithi001 ceph-mon[30968]: pgmap v464: 129 pgs: 129 active+clean; 126 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 258 op/s 2024-09-19T05:24:58.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:57 smithi060 ceph-mon[35058]: pgmap v464: 129 pgs: 129 active+clean; 126 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 258 op/s 2024-09-19T05:24:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:57 smithi082 ceph-mon[35195]: pgmap v464: 129 pgs: 129 active+clean; 126 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 258 op/s 2024-09-19T05:24:58.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 313376 16.45 MB/sec execute 13 sec latency 38.522 ms 2024-09-19T05:24:59.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 316825 16.64 MB/sec execute 14 sec latency 15.998 ms 2024-09-19T05:25:00.093 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:24:59 smithi001 ceph-mon[30968]: pgmap v465: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 319 op/s 2024-09-19T05:25:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:24:59 smithi060 ceph-mon[35058]: pgmap v465: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 319 op/s 2024-09-19T05:25:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:24:59 smithi082 ceph-mon[35195]: pgmap v465: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.3 MiB/s wr, 319 op/s 2024-09-19T05:25:00.371 INFO:tasks.workunit.client.0.smithi001.stdout: 1 320183 16.72 MB/sec execute 15 sec latency 13.192 ms 2024-09-19T05:25:01.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 323483 16.84 MB/sec execute 16 sec latency 31.087 ms 2024-09-19T05:25:02.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:01 smithi001 ceph-mon[30968]: pgmap v466: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T05:25:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:01 smithi060 ceph-mon[35058]: pgmap v466: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T05:25:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:01 smithi082 ceph-mon[35195]: pgmap v466: 129 pgs: 129 active+clean; 127 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-19T05:25:02.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 326711 16.96 MB/sec execute 17 sec latency 76.191 ms 2024-09-19T05:25:03.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 330086 17.06 MB/sec execute 18 sec latency 47.696 ms 2024-09-19T05:25:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:03 smithi060 ceph-mon[35058]: pgmap v467: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 391 op/s 2024-09-19T05:25:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:03 smithi082 ceph-mon[35195]: pgmap v467: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 391 op/s 2024-09-19T05:25:04.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:03 smithi001 ceph-mon[30968]: pgmap v467: 129 pgs: 129 active+clean; 131 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.1 MiB/s wr, 391 op/s 2024-09-19T05:25:04.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 333420 17.10 MB/sec execute 19 sec latency 13.397 ms 2024-09-19T05:25:05.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 336649 16.99 MB/sec execute 20 sec latency 23.452 ms 2024-09-19T05:25:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:05 smithi060 ceph-mon[35058]: pgmap v468: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-19T05:25:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:05 smithi082 ceph-mon[35195]: pgmap v468: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-19T05:25:06.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:05 smithi001 ceph-mon[30968]: pgmap v468: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-19T05:25:06.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 339585 16.84 MB/sec execute 21 sec latency 16.806 ms 2024-09-19T05:25:07.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:06 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:07.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:06 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:06 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:07.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 341987 16.81 MB/sec execute 22 sec latency 105.415 ms 2024-09-19T05:25:08.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:07 smithi060 ceph-mon[35058]: pgmap v469: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-19T05:25:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:07 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:25:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:07 smithi082 ceph-mon[35195]: pgmap v469: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-19T05:25:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:07 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:25:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:07 smithi001 ceph-mon[30968]: pgmap v469: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-19T05:25:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:08.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:07 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:25:08.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 345017 16.73 MB/sec execute 23 sec latency 13.093 ms 2024-09-19T05:25:09.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 348348 16.81 MB/sec execute 24 sec latency 19.381 ms 2024-09-19T05:25:10.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:09 smithi060 ceph-mon[35058]: pgmap v470: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 337 op/s 2024-09-19T05:25:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:09 smithi082 ceph-mon[35195]: pgmap v470: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 337 op/s 2024-09-19T05:25:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:09 smithi001 ceph-mon[30968]: pgmap v470: 129 pgs: 129 active+clean; 139 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.9 MiB/s wr, 337 op/s 2024-09-19T05:25:10.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 351846 16.89 MB/sec execute 25 sec latency 12.432 ms 2024-09-19T05:25:11.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 355384 16.98 MB/sec execute 26 sec latency 15.724 ms 2024-09-19T05:25:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:11 smithi001 ceph-mon[30968]: pgmap v471: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-19T05:25:12.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:11 smithi060 ceph-mon[35058]: pgmap v471: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-19T05:25:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:11 smithi082 ceph-mon[35195]: pgmap v471: 129 pgs: 129 active+clean; 141 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 274 op/s 2024-09-19T05:25:12.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 358926 17.06 MB/sec execute 27 sec latency 15.769 ms 2024-09-19T05:25:13.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 362470 17.13 MB/sec execute 28 sec latency 20.135 ms 2024-09-19T05:25:14.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:13 smithi060 ceph-mon[35058]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 321 op/s 2024-09-19T05:25:14.257 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:13 smithi082 ceph-mon[35195]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 321 op/s 2024-09-19T05:25:14.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:13 smithi001 ceph-mon[30968]: pgmap v472: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 321 op/s 2024-09-19T05:25:14.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 365886 17.19 MB/sec execute 29 sec latency 29.298 ms 2024-09-19T05:25:15.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 369354 17.26 MB/sec execute 30 sec latency 19.598 ms 2024-09-19T05:25:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:15 smithi060 ceph-mon[35058]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-19T05:25:16.300 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:25:16.301 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T05:25:16.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:25:16.302 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:15 smithi082 ceph-mon[35195]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-19T05:25:16.328 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:15 smithi001 ceph-mon[30968]: pgmap v473: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-09-19T05:25:16.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 372830 17.32 MB/sec execute 31 sec latency 21.029 ms 2024-09-19T05:25:16.604 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:17.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 -- 172.21.15.1:0/968854445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc102d30 msgr2=0x7f27cc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 --2- 172.21.15.1:0/968854445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc102d30 0x7f27cc103110 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009930 tx=0x7f27c802a420 comp rx=0 tx=0).stop 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 -- 172.21.15.1:0/968854445 shutdown_connections 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 --2- 172.21.15.1:0/968854445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27cc1082a0 0x7f27cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 --2- 172.21.15.1:0/968854445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27cc1036e0 0x7f27cc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 --2- 172.21.15.1:0/968854445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc102d30 0x7f27cc103110 secure :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009930 tx=0x7f27c802a420 comp rx=0 tx=0).stop 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.131+0000 7f27d45a1640 1 -- 172.21.15.1:0/968854445 >> 172.21.15.1:0/968854445 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.136+0000 7f27d45a1640 1 -- 172.21.15.1:0/968854445 shutdown_connections 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.136+0000 7f27d45a1640 1 -- 172.21.15.1:0/968854445 wait complete. 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.137+0000 7f27d45a1640 1 Processor -- start 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.137+0000 7f27d45a1640 1 -- start start 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27cc1036e0 0x7f27cc073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27cc06d270 0x7f27cc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc1120a0 con 0x7f27cc1082a0 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc111f20 con 0x7f27cc06d270 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d45a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc112220 con 0x7f27cc1036e0 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d1b3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d1b3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50450/0 (socket says 172.21.15.1:50450) 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.138+0000 7f27d1b3c640 1 -- 172.21.15.1:0/110844461 learned_addr learned my addr 172.21.15.1:0/110844461 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.139+0000 7f27d1b3c640 1 -- 172.21.15.1:0/110844461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27cc1036e0 msgr2=0x7f27cc073ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.139+0000 7f27d1b3c640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27cc1036e0 0x7f27cc073ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.139+0000 7f27d1b3c640 1 -- 172.21.15.1:0/110844461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27cc06d270 msgr2=0x7f27cc06d720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.139+0000 7f27d1b3c640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27cc06d270 0x7f27cc06d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.139+0000 7f27d1b3c640 1 -- 172.21.15.1:0/110844461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27cc0719c0 con 0x7f27cc1082a0 2024-09-19T05:25:17.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.140+0000 7f27d1b3c640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00e970 tx=0x7f27bc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.140+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00cd80 con 0x7f27cc1082a0 2024-09-19T05:25:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.140+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27bc0035f0 con 0x7f27cc1082a0 2024-09-19T05:25:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.141+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27bc010690 con 0x7f27cc1082a0 2024-09-19T05:25:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.141+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27cc071c50 con 0x7f27cc1082a0 2024-09-19T05:25:17.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.141+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27cc072140 con 0x7f27cc1082a0 2024-09-19T05:25:17.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.153+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27cc06a850 con 0x7f27cc1082a0 2024-09-19T05:25:17.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.159+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f27bc0037a0 con 0x7f27cc1082a0 2024-09-19T05:25:17.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.160+0000 7f27c37fe640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 0x7f27b80a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.161+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f27bc09a360 con 0x7f27cc1082a0 2024-09-19T05:25:17.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.161+0000 7f27d233d640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 0x7f27b80a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:17.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.167+0000 7f27d233d640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 0x7f27b80a5850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27c8006010 tx=0x7f27c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:17.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.174+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27bc09c9c0 con 0x7f27cc1082a0 2024-09-19T05:25:17.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 376054 17.33 MB/sec execute 32 sec latency 74.955 ms 2024-09-19T05:25:17.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.406+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27cc10a2b0 con 0x7f27cc1082a0 2024-09-19T05:25:17.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.406+0000 7f27c37fe640 1 -- 172.21.15.1:0/110844461 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f27bc0a0670 con 0x7f27cc1082a0 2024-09-19T05:25:17.408 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:25:17.409 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:25:17.409 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:25:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 msgr2=0x7f27b80a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 0x7f27b80a5850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f27c8006010 tx=0x7f27c8000bc0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 msgr2=0x7f27cc06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00e970 tx=0x7f27bc00ee30 comp rx=0 tx=0).stop 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 shutdown_connections 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27b80a3390 0x7f27b80a5850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27cc06d270 0x7f27cc06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27cc1082a0 0x7f27cc06cd30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 --2- 172.21.15.1:0/110844461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27cc1036e0 0x7f27cc073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 >> 172.21.15.1:0/110844461 conn(0x7f27cc0fc7d0 msgr2=0x7f27cc105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 shutdown_connections 2024-09-19T05:25:17.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:17.409+0000 7f27d45a1640 1 -- 172.21.15.1:0/110844461 wait complete. 2024-09-19T05:25:18.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:17 smithi001 ceph-mon[30968]: pgmap v474: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:25:18.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:17 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/110844461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:17 smithi060 ceph-mon[35058]: pgmap v474: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:25:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:17 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/110844461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:17 smithi082 ceph-mon[35195]: pgmap v474: 129 pgs: 129 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:25:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:17 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/110844461' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:18.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 378913 17.21 MB/sec execute 33 sec latency 62.207 ms 2024-09-19T05:25:18.861 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T05:25:18.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T05:25:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:19.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 381964 17.12 MB/sec execute 34 sec latency 16.115 ms 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/1819137311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88101420 msgr2=0x7f9f8810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/1819137311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88101420 0x7f9f8810d950 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009cd0 tx=0x7f9f8002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/1819137311 shutdown_connections 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/1819137311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88101420 0x7f9f8810d950 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/1819137311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/1819137311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88106a80 0x7f9f88106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/1819137311 >> 172.21.15.1:0/1819137311 conn(0x7f9f880fc7a0 msgr2=0x7f9f880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/1819137311 shutdown_connections 2024-09-19T05:25:19.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.671+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/1819137311 wait complete. 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 Processor -- start 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 -- start start 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 0x7f9f881997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 0x7f9f881a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88110e80 con 0x7f9f88106a80 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88110d00 con 0x7f9f88100a80 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8d658640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 0x7f9f881a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8f0bb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88111000 con 0x7f9f88101420 2024-09-19T05:25:19.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40924/0 (socket says 172.21.15.1:40924) 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2517478281 learned_addr learned my addr 172.21.15.1:0/2517478281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.672+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 0x7f9f881997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2517478281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 msgr2=0x7f9f881997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 0x7f9f881997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 msgr2=0x7f9f881a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 0x7f9f881a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2517478281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f881a4850 con 0x7f9f88100a80 2024-09-19T05:25:19.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 0x7f9f881997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:19.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8d658640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 0x7f9f881a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:19.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9f0 tx=0x7f9f7c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f85ffb640 1 -- 172.21.15.1:0/2517478281 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00cd80 con 0x7f9f88100a80 2024-09-19T05:25:19.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f881a4a20 con 0x7f9f88100a80 2024-09-19T05:25:19.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f85ffb640 1 -- 172.21.15.1:0/2517478281 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f7c005500 con 0x7f9f88100a80 2024-09-19T05:25:19.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.673+0000 7f9f85ffb640 1 -- 172.21.15.1:0/2517478281 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c010690 con 0x7f9f88100a80 2024-09-19T05:25:19.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.674+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f881a4ee0 con 0x7f9f88100a80 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.676+0000 7f9f85ffb640 1 -- 172.21.15.1:0/2517478281 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9f7c0046c0 con 0x7f9f88100a80 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.676+0000 7f9f85ffb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 0x7f9f780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.676+0000 7f9f85ffb640 1 -- 172.21.15.1:0/2517478281 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9f7c0d0070 con 0x7f9f88100a80 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.676+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 0x7f9f780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 Processor -- start 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 -- start start 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 0x7f9f780a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f8806b2e0 tx=0x7f9f74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a89514a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a89514d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a8950a12a0 con 0x55a89513bf80 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a895048b10 con 0x55a89514ad50 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f91494740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a89509d260 con 0x55a89513b660 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a89514a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a89514a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50478/0 (socket says 172.21.15.1:50478) 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f87fff640 1 -- 172.21.15.1:0/1515226933 learned_addr learned my addr 172.21.15.1:0/1515226933 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:52212/0 (socket says 172.21.15.1:52212) 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8d658640 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a89514d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1515226933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 msgr2=0x55a89514d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a89514d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1515226933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 msgr2=0x55a89514a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.677+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a89514a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.678+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1515226933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a894e12b90 con 0x55a89513b660 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.678+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c09bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b072b762b5032c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.678+0000 7f9f72ffd640 1 -- 172.21.15.1:0/1515226933 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0b5070 con 0x55a89513b660 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.678+0000 7f9f72ffd640 1 -- 172.21.15.1:0/1515226933 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f7c096e50 con 0x55a89513b660 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.678+0000 7f9f72ffd640 1 -- 172.21.15.1:0/1515226933 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0a4ac0 con 0x55a89513b660 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- 172.21.15.1:0/1515226933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 msgr2=0x55a89513ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c09bee0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- 172.21.15.1:0/1515226933 shutdown_connections 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a89514d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a89514a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 --2- 172.21.15.1:0/1515226933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a89513ba40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- 172.21.15.1:0/1515226933 >> 172.21.15.1:0/1515226933 conn(0x55a895137cf0 msgr2=0x55a8951380d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- 172.21.15.1:0/1515226933 shutdown_connections 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- 172.21.15.1:0/1515226933 wait complete. 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 -- start start 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.679+0000 7f9f91494740 1 Processor -- start 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895147c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513bf80 0x55a8951481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 0x55a895148710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a89514d980 con 0x55a89514ad50 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a8950296e0 con 0x55a89513bf80 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a89514db00 con 0x55a89513b660 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 10 client.0 _ll_register_callbacks cb 0x55a89504da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8d658640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 0x55a895148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8d658640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 0x55a895148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50488/0 (socket says 172.21.15.1:50488) 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8d658640 1 -- 172.21.15.1:0/2999704771 learned_addr learned my addr 172.21.15.1:0/2999704771 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513bf80 0x55a8951481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2999704771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513bf80 msgr2=0x55a8951481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513bf80 0x55a8951481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2999704771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 msgr2=0x55a895148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 0x55a895148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 -- 172.21.15.1:0/2999704771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a895156f00 con 0x55a89513b660 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895147c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0a5110 tx=0x7f9f7c0b5410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d61c26c24dd650 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f67fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0b5040 con 0x55a89513b660 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9f7c0a4cd0 con 0x55a89513b660 2024-09-19T05:25:19.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.680+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f7c096e50 con 0x55a89513b660 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f7c0ad050 con 0x55a89513b660 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 10 client.25057 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a89514d980 con 0x55a89513b660 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f7c096e50 con 0x55a89513b660 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f7c0bc1e0 con 0x55a89513b660 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 10 client.25057 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 10 client.25057 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 20 client.25057 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:19.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a89515aa10 0x55a89515ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 4 client.25057 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8950ae9d0 con 0x55a89515aa10 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.681+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a89515aa10 0x55a89515ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f87fff640 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a89515aa10 0x55a89515ce00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5d68a78d8e2b9b0 server_cookie=323bff4038f680f9 in_seq=0 out_seq=0 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f67fff640 10 client.25057 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f67fff640 1 -- 172.21.15.1:0/2999704771 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8950ae9d0 con 0x55a89515aa10 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f67fff640 10 client.25057 handle_command_reply: tid=0 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f91494740 1 client.25057 shutdown 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 msgr2=0x55a895147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.682+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895147c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0a5110 tx=0x7f9f7c0b5410 comp rx=0 tx=0).stop 2024-09-19T05:25:19.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 shutdown_connections 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89514ad50 0x55a895148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513bf80 0x55a8951481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a89515aa10 0x55a89515ce00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 --2- 172.21.15.1:0/2999704771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895147c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 >> 172.21.15.1:0/2999704771 conn(0x55a895137cf0 msgr2=0x55a89513da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f67fff640 0 client.25057 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 shutdown_connections 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 1 -- 172.21.15.1:0/2999704771 wait complete. 2024-09-19T05:25:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.683+0000 7f9f91494740 20 client.25057 trim_cache size 0 max 16384 2024-09-19T05:25:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 Processor -- start 2024-09-19T05:25:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 -- start start 2024-09-19T05:25:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a895162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881aabb0 con 0x55a89513bf80 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ad430 con 0x55a89514ad50 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f91494740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ab220 con 0x55a89513b660 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50498/0 (socket says 172.21.15.1:50498) 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f87fff640 1 -- 172.21.15.1:0/1963164049 learned_addr learned my addr 172.21.15.1:0/1963164049 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8d658640 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a895162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1963164049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 msgr2=0x55a895162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a895162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1963164049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 msgr2=0x55a895162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f8ce57640 1 -- 172.21.15.1:0/1963164049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a895137b20 con 0x55a89513b660 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.701+0000 7f9f87fff640 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.702+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895146bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c09bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=175f53e6097d4c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.702+0000 7f9f727fc640 1 -- 172.21.15.1:0/1963164049 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0b5040 con 0x55a89513b660 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.702+0000 7f9f727fc640 1 -- 172.21.15.1:0/1963164049 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f7c096e50 con 0x55a89513b660 2024-09-19T05:25:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.702+0000 7f9f727fc640 1 -- 172.21.15.1:0/1963164049 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0a0170 con 0x55a89513b660 2024-09-19T05:25:19.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- 172.21.15.1:0/1963164049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 msgr2=0x55a895146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895146bd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9c0 tx=0x7f9f7c09bee0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- 172.21.15.1:0/1963164049 shutdown_connections 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89514ad50 0x55a895162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 --2- 172.21.15.1:0/1963164049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89513b660 0x55a895146bd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- 172.21.15.1:0/1963164049 >> 172.21.15.1:0/1963164049 conn(0x55a895137cf0 msgr2=0x55a89513d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- 172.21.15.1:0/1963164049 shutdown_connections 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- 172.21.15.1:0/1963164049 wait complete. 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 -- start start 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.703+0000 7f9f91494740 1 Processor -- start 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513b660 0x55a8951530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89514ad50 0x55a89514e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881ab8f0 con 0x55a89513bf80 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881acd60 con 0x55a89513b660 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881abfc0 con 0x55a89514ad50 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50504/0 (socket says 172.21.15.1:50504) 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f91494740 10 client.0 _ll_register_callbacks cb 0x7f9f7c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 -- 172.21.15.1:0/547909750 learned_addr learned my addr 172.21.15.1:0/547909750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f8d658640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89514ad50 0x55a89514e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513b660 0x55a8951530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 -- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89514ad50 msgr2=0x55a89514e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89514ad50 0x55a89514e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 -- 172.21.15.1:0/547909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513b660 msgr2=0x55a8951530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513b660 0x55a8951530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.704+0000 7f9f87fff640 1 -- 172.21.15.1:0/547909750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a89514ed10 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f87fff640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9f74011ca0 tx=0x7f9f74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9369432f7b710f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f67fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7400f480 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9f7400f620 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f7c096e50 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f7403c050 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f91494740 10 client.15417 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a8951c5160 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.705+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f7c096e50 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f74030070 con 0x55a89513bf80 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 10 client.15417 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 10 client.15417 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 20 client.15417 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a8951c5980 0x55a8951c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 4 client.15417 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55a8950a8d20 con 0x55a8951c5980 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a8951c5980 0x55a8951c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f67fff640 10 client.15417 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.706+0000 7f9f8ce57640 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a8951c5980 0x55a8951c7da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6270efd63f618314 server_cookie=9222f58f21c589c7 in_seq=0 out_seq=0 2024-09-19T05:25:19.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f67fff640 1 -- 172.21.15.1:0/547909750 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a8950a8d20 con 0x55a8951c5980 2024-09-19T05:25:19.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f67fff640 10 client.15417 handle_command_reply: tid=0 2024-09-19T05:25:19.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 client.15417 shutdown 2024-09-19T05:25:19.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 msgr2=0x55a895153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9f74011ca0 tx=0x7f9f74004730 comp rx=0 tx=0).stop 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 shutdown_connections 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55a8951c5980 0x55a8951c7da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a89514ad50 0x55a89514e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a89513bf80 0x55a895153620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f67fff640 0 client.15417 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 --2- 172.21.15.1:0/547909750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a89513b660 0x55a8951530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 >> 172.21.15.1:0/547909750 conn(0x55a895137cf0 msgr2=0x55a895136650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 shutdown_connections 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 1 -- 172.21.15.1:0/547909750 wait complete. 2024-09-19T05:25:19.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.788+0000 7f9f91494740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 18, 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "e5ff952b": { 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 18, 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:19.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:19.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:19.794 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:19.794 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:25:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 msgr2=0x7f9f780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 0x7f9f780a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f8806b2e0 tx=0x7f9f74005f90 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 msgr2=0x7f9f88199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9f0 tx=0x7f9f7c00edf0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 shutdown_connections 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f780a3240 0x7f9f780a5700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f88106a80 0x7f9f881a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101420 0x7f9f881997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 --2- 172.21.15.1:0/2517478281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f88100a80 0x7f9f88199290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 >> 172.21.15.1:0/2517478281 conn(0x7f9f880fc7a0 msgr2=0x7f9f880fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 shutdown_connections 2024-09-19T05:25:19.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:19.789+0000 7f9f8f0bb640 1 -- 172.21.15.1:0/2517478281 wait complete. 2024-09-19T05:25:20.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:19 smithi060 ceph-mon[35058]: pgmap v475: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-09-19T05:25:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:19 smithi082 ceph-mon[35195]: pgmap v475: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-09-19T05:25:20.320 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:19 smithi001 ceph-mon[30968]: pgmap v475: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-09-19T05:25:20.372 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 16.93 MB/sec execute 35 sec latency 585.326 ms 2024-09-19T05:25:20.584 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e5ff952b', quiesce took 4.3 seconds. Will release after: 25.5 2024-09-19T05:25:21.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 16.46 MB/sec execute 36 sec latency 1585.428 ms 2024-09-19T05:25:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:21 smithi060 ceph-mon[35058]: pgmap v476: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 209 op/s 2024-09-19T05:25:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:21 smithi082 ceph-mon[35195]: pgmap v476: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 209 op/s 2024-09-19T05:25:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:21 smithi001 ceph-mon[30968]: pgmap v476: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 209 op/s 2024-09-19T05:25:22.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 16.02 MB/sec execute 37 sec latency 2585.494 ms 2024-09-19T05:25:23.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 15.59 MB/sec execute 38 sec latency 3585.603 ms 2024-09-19T05:25:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:23 smithi060 ceph-mon[35058]: pgmap v477: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-09-19T05:25:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:23 smithi082 ceph-mon[35195]: pgmap v477: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-09-19T05:25:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:23 smithi001 ceph-mon[30968]: pgmap v477: 129 pgs: 129 active+clean; 156 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-09-19T05:25:24.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 15.19 MB/sec execute 39 sec latency 4585.718 ms 2024-09-19T05:25:25.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 14.81 MB/sec execute 40 sec latency 5585.819 ms 2024-09-19T05:25:26.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:25 smithi060 ceph-mon[35058]: pgmap v478: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-09-19T05:25:26.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:25 smithi082 ceph-mon[35195]: pgmap v478: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-09-19T05:25:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:25 smithi001 ceph-mon[30968]: pgmap v478: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-09-19T05:25:26.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 14.45 MB/sec execute 41 sec latency 6585.923 ms 2024-09-19T05:25:27.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 14.11 MB/sec execute 42 sec latency 7586.001 ms 2024-09-19T05:25:28.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:27 smithi060 ceph-mon[35058]: pgmap v479: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-19T05:25:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:27 smithi082 ceph-mon[35195]: pgmap v479: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-19T05:25:28.318 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:27 smithi001 ceph-mon[30968]: pgmap v479: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-19T05:25:28.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 13.78 MB/sec execute 43 sec latency 8586.067 ms 2024-09-19T05:25:29.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 13.47 MB/sec execute 44 sec latency 9586.112 ms 2024-09-19T05:25:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:29 smithi001 ceph-mon[30968]: pgmap v480: 129 pgs: 129 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 180 op/s 2024-09-19T05:25:30.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:29 smithi060 ceph-mon[35058]: pgmap v480: 129 pgs: 129 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 180 op/s 2024-09-19T05:25:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:29 smithi082 ceph-mon[35195]: pgmap v480: 129 pgs: 129 active+clean; 157 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 180 op/s 2024-09-19T05:25:30.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 13.17 MB/sec execute 45 sec latency 10586.170 ms 2024-09-19T05:25:31.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:30 smithi060 ceph-mon[35058]: pgmap v481: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 147 op/s 2024-09-19T05:25:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:30 smithi082 ceph-mon[35195]: pgmap v481: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 147 op/s 2024-09-19T05:25:31.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:30 smithi001 ceph-mon[30968]: pgmap v481: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 147 op/s 2024-09-19T05:25:31.373 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 12.88 MB/sec execute 46 sec latency 11586.273 ms 2024-09-19T05:25:32.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 12.61 MB/sec execute 47 sec latency 12586.375 ms 2024-09-19T05:25:33.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:32 smithi060 ceph-mon[35058]: pgmap v482: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 175 op/s 2024-09-19T05:25:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:32 smithi082 ceph-mon[35195]: pgmap v482: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 175 op/s 2024-09-19T05:25:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:32 smithi001 ceph-mon[30968]: pgmap v482: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 175 op/s 2024-09-19T05:25:33.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 12.35 MB/sec execute 48 sec latency 13586.494 ms 2024-09-19T05:25:34.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 12.09 MB/sec execute 49 sec latency 14586.616 ms 2024-09-19T05:25:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:34 smithi060 ceph-mon[35058]: pgmap v483: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2024-09-19T05:25:35.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:34 smithi082 ceph-mon[35195]: pgmap v483: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2024-09-19T05:25:35.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:34 smithi001 ceph-mon[30968]: pgmap v483: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 2.5 MiB/s wr, 121 op/s 2024-09-19T05:25:35.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 11.85 MB/sec execute 50 sec latency 15586.742 ms 2024-09-19T05:25:36.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 11.62 MB/sec execute 51 sec latency 16586.882 ms 2024-09-19T05:25:37.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:36 smithi060 ceph-mon[35058]: pgmap v484: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:25:37.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:36 smithi082 ceph-mon[35195]: pgmap v484: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:25:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:36 smithi001 ceph-mon[30968]: pgmap v484: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:25:37.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 11.40 MB/sec execute 52 sec latency 17587.003 ms 2024-09-19T05:25:38.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 11.18 MB/sec execute 53 sec latency 18587.121 ms 2024-09-19T05:25:39.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:38 smithi060 ceph-mon[35058]: pgmap v485: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.9 MiB/s wr, 108 op/s 2024-09-19T05:25:39.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:38 smithi082 ceph-mon[35195]: pgmap v485: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.9 MiB/s wr, 108 op/s 2024-09-19T05:25:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:38 smithi001 ceph-mon[30968]: pgmap v485: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.9 MiB/s wr, 108 op/s 2024-09-19T05:25:39.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.97 MB/sec execute 54 sec latency 19587.243 ms 2024-09-19T05:25:40.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.77 MB/sec execute 55 sec latency 20587.348 ms 2024-09-19T05:25:41.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:41 smithi082 ceph-mon[35195]: pgmap v486: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-19T05:25:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:41 smithi001 ceph-mon[30968]: pgmap v486: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-19T05:25:41.374 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.58 MB/sec execute 56 sec latency 21587.429 ms 2024-09-19T05:25:41.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:41 smithi060 ceph-mon[35058]: pgmap v486: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-09-19T05:25:42.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.40 MB/sec execute 57 sec latency 22587.535 ms 2024-09-19T05:25:43.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:43 smithi082 ceph-mon[35195]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2024-09-19T05:25:43.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:43 smithi001 ceph-mon[30968]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2024-09-19T05:25:43.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.22 MB/sec execute 58 sec latency 23587.655 ms 2024-09-19T05:25:43.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:43 smithi060 ceph-mon[35058]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2024-09-19T05:25:44.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 10.04 MB/sec execute 59 sec latency 24587.762 ms 2024-09-19T05:25:45.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:45 smithi001 ceph-mon[30968]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.2 MiB/s wr, 85 op/s 2024-09-19T05:25:45.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 9.88 MB/sec execute 60 sec latency 25587.858 ms 2024-09-19T05:25:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:45 smithi060 ceph-mon[35058]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.2 MiB/s wr, 85 op/s 2024-09-19T05:25:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:45 smithi082 ceph-mon[35195]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.2 MiB/s wr, 85 op/s 2024-09-19T05:25:46.085 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:25:46.361 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:46.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 9.71 MB/sec execute 61 sec latency 26587.901 ms 2024-09-19T05:25:47.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:47 smithi001 ceph-mon[30968]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:25:47.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 -- 172.21.15.1:0/2216433897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c106050 msgr2=0x7f169c10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 --2- 172.21.15.1:0/2216433897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c106050 0x7f169c10dbd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1694009ca0 tx=0x7f169402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 -- 172.21.15.1:0/2216433897 shutdown_connections 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 --2- 172.21.15.1:0/2216433897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c106050 0x7f169c10dbd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 --2- 172.21.15.1:0/2216433897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c101df0 0x7f169c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 --2- 172.21.15.1:0/2216433897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 -- 172.21.15.1:0/2216433897 >> 172.21.15.1:0/2216433897 conn(0x7f169c077210 msgr2=0x7f169c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 -- 172.21.15.1:0/2216433897 shutdown_connections 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.870+0000 7f16a3db8640 1 -- 172.21.15.1:0/2216433897 wait complete. 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 Processor -- start 2024-09-19T05:25:47.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 -- start start 2024-09-19T05:25:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 0x7f169c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:47.156 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:25:47.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f169c1110d0 con 0x7f169c101df0 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f169c110f50 con 0x7f169c106050 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a3db8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f169c111250 con 0x7f169c101440 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.871+0000 7f16a1353640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52030/0 (socket says 172.21.15.1:52030) 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 -- 172.21.15.1:0/737604008 learned_addr learned my addr 172.21.15.1:0/737604008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1b54640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a2355640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 0x7f169c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:47.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 -- 172.21.15.1:0/737604008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 msgr2=0x7f169c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 -- 172.21.15.1:0/737604008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 msgr2=0x7f169c19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 0x7f169c19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 -- 172.21.15.1:0/737604008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19d5d0 con 0x7f169c101df0 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1b54640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:47.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a2355640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 0x7f169c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a1353640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c920 tx=0x7f168c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c007c70 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168c007e10 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c19d8c0 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c018890 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.872+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a51a0 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.873+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c101820 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.874+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f168c018a50 con 0x7f169c101df0 2024-09-19T05:25:47.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.875+0000 7f1692ffd640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 0x7f16880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.875+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f168c0d0160 con 0x7f169c101df0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.875+0000 7f16a1b54640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 0x7f16880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.876+0000 7f16a1b54640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 0x7f16880a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1698009930 tx=0x7f1698008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:46.878+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f168c014030 con 0x7f169c101df0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.091+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f169c199980 con 0x7f169c101df0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.092+0000 7f1692ffd640 1 -- 172.21.15.1:0/737604008 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f169c199980 con 0x7f169c101df0 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 msgr2=0x7f16880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 0x7f16880a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1698009930 tx=0x7f1698008040 comp rx=0 tx=0).stop 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 msgr2=0x7f169c198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:47.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c920 tx=0x7f168c00cde0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:25:47.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 shutdown_connections 2024-09-19T05:25:47.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16880a3240 0x7f16880a5700 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169c106050 0x7f169c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f169c101df0 0x7f169c198b60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 --2- 172.21.15.1:0/737604008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f169c101440 0x7f169c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 >> 172.21.15.1:0/737604008 conn(0x7f169c077210 msgr2=0x7f169c100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 shutdown_connections 2024-09-19T05:25:47.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:47.094+0000 7f16a3db8640 1 -- 172.21.15.1:0/737604008 wait complete. 2024-09-19T05:25:47.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 9.56 MB/sec execute 62 sec latency 27587.983 ms 2024-09-19T05:25:47.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:47 smithi060 ceph-mon[35058]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:25:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:47 smithi082 ceph-mon[35195]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:25:48.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e5ff952b --release --await' 2024-09-19T05:25:48.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e5ff952b --release --await 2024-09-19T05:25:48.323 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:48.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/737604008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:48.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383118 9.41 MB/sec execute 63 sec latency 28588.034 ms 2024-09-19T05:25:48.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/737604008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:48.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/737604008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 -- 172.21.15.1:0/1815182066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04102570 msgr2=0x7faf041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1815182066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04102570 0x7faf041029b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7faef8009900 tx=0x7faef802a480 comp rx=0 tx=0).stop 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 -- 172.21.15.1:0/1815182066 shutdown_connections 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1815182066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1815182066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04102570 0x7faf041029b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.839+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1815182066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04100e20 0x7faf04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.840+0000 7faf08cf5640 1 -- 172.21.15.1:0/1815182066 >> 172.21.15.1:0/1815182066 conn(0x7faf040fc7d0 msgr2=0x7faf040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.840+0000 7faf08cf5640 1 -- 172.21.15.1:0/1815182066 shutdown_connections 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.840+0000 7faf08cf5640 1 -- 172.21.15.1:0/1815182066 wait complete. 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.840+0000 7faf08cf5640 1 Processor -- start 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 -- start start 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 0x7faf04197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf04110f80 con 0x7faf04100e20 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf04110e00 con 0x7faf04102570 2024-09-19T05:25:48.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf08cf5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf04111100 con 0x7faf04102ef0 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52046/0 (socket says 172.21.15.1:52046) 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 0x7faf04197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 -- 172.21.15.1:0/1852690978 learned_addr learned my addr 172.21.15.1:0/1852690978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf02d9d640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 -- 172.21.15.1:0/1852690978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 msgr2=0x7faf0419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 -- 172.21.15.1:0/1852690978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 msgr2=0x7faf04197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 0x7faf04197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf0259c640 1 -- 172.21.15.1:0/1852690978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0419c2b0 con 0x7faf04100e20 2024-09-19T05:25:48.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf02d9d640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.841+0000 7faf01d9b640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 0x7faf04197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faf0259c640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faef400c920 tx=0x7faef400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faef37fe640 1 -- 172.21.15.1:0/1852690978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4007c70 con 0x7faf04100e20 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0419c5a0 con 0x7faf04100e20 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faef37fe640 1 -- 172.21.15.1:0/1852690978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef4007e10 con 0x7faf04100e20 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faef37fe640 1 -- 172.21.15.1:0/1852690978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4018890 con 0x7faf04100e20 2024-09-19T05:25:48.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.842+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf04069f70 con 0x7faf04100e20 2024-09-19T05:25:48.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.844+0000 7faef37fe640 1 -- 172.21.15.1:0/1852690978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7faef4018a50 con 0x7faf04100e20 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.844+0000 7faf0b0ce740 1 Processor -- start 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 -- start start 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee13440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee20630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5605ded78620 con 0x5605dee13980 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5605ded1fe50 con 0x5605dee13060 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605ded745e0 con 0x5605dee1e240 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faef37fe640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 0x7faeec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52052/0 (socket says 172.21.15.1:52052) 2024-09-19T05:25:48.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf0259c640 1 -- 172.21.15.1:0/3234334148 learned_addr learned my addr 172.21.15.1:0/3234334148 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee20630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf02d9d640 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee13440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf02d9d640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 0x7faeec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faef37fe640 1 -- 172.21.15.1:0/1852690978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7faef40cfd80 con 0x7faf04100e20 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.845+0000 7faf01d9b640 1 -- 172.21.15.1:0/3234334148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 msgr2=0x5605dee13440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee13440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf01d9b640 1 -- 172.21.15.1:0/3234334148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 msgr2=0x5605dee1dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf01d9b640 1 -- 172.21.15.1:0/3234334148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ded10d40 con 0x5605dee1e240 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee20630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef8005940 tx=0x7faef8004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a94c1fb2e45dd3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faf02d9d640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 0x7faeec0a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faefc0099e0 tx=0x7faefc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faef0ff9640 1 -- 172.21.15.1:0/3234334148 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8035030 con 0x5605dee1e240 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faef0ff9640 1 -- 172.21.15.1:0/3234334148 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef8040070 con 0x5605dee1e240 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.846+0000 7faef0ff9640 1 -- 172.21.15.1:0/3234334148 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8003850 con 0x5605dee1e240 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3234334148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 msgr2=0x5605dee20630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee20630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faef8005940 tx=0x7faef8004470 comp rx=0 tx=0).stop 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3234334148 shutdown_connections 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee20630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3234334148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee13440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3234334148 >> 172.21.15.1:0/3234334148 conn(0x5605dee0f5f0 msgr2=0x5605dee0f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3234334148 shutdown_connections 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3234334148 wait complete. 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 -- start start 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.847+0000 7faf0b0ce740 1 Processor -- start 2024-09-19T05:25:48.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee1e240 0x5605dee1bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5605dee20e10 con 0x5605dee13980 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5605ded00f10 con 0x5605dee1e240 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5605dee20f90 con 0x5605dee13060 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0b0ce740 10 client.0 _ll_register_callbacks cb 0x5605ded24db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:38488/0 (socket says 172.21.15.1:38488) 2024-09-19T05:25:48.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 -- 172.21.15.1:0/2790655763 learned_addr learned my addr 172.21.15.1:0/2790655763 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf02d9d640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee1e240 0x5605dee1bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 -- 172.21.15.1:0/2790655763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee1e240 msgr2=0x5605dee1bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee1e240 0x5605dee1bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 -- 172.21.15.1:0/2790655763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 msgr2=0x5605dee1b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 -- 172.21.15.1:0/2790655763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605dea87580 con 0x5605dee13060 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faf0259c640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faef400fee0 tx=0x7faef409ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19612a2e8eac58a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.848+0000 7faee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef40b4070 con 0x5605dee13060 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faef8040070 con 0x5605dee13060 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7faef400fb30 con 0x5605dee13060 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faef409bff0 con 0x5605dee13060 2024-09-19T05:25:48.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 10 client.25078 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5605deb51960 con 0x5605dee13060 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef8040070 con 0x5605dee13060 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faef40b8020 con 0x5605dee13060 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 10 client.25078 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 10 client.25078 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 20 client.25078 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee2de00 0x5605dee301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 4 client.25078 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:48.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605ded85b90 con 0x5605dee2de00 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.849+0000 7faf01d9b640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee2de00 0x5605dee301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faf01d9b640 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee2de00 0x5605dee301f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d8332606ac9bb0 server_cookie=6c602aec89c5a8a in_seq=0 out_seq=0 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faee9ffb640 10 client.25078 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faee9ffb640 1 -- 172.21.15.1:0/2790655763 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605ded85b90 con 0x5605dee2de00 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faee9ffb640 10 client.25078 handle_command_reply: tid=0 2024-09-19T05:25:48.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faf0b0ce740 1 client.25078 shutdown 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 msgr2=0x5605dee1b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.850+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faef400fee0 tx=0x7faef409ba20 comp rx=0 tx=0).stop 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 shutdown_connections 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee1e240 0x5605dee1bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee1b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee2de00 0x5605dee301f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/2790655763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee13060 0x5605dee1b180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faee9ffb640 0 client.25078 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 >> 172.21.15.1:0/2790655763 conn(0x5605dee0f5f0 msgr2=0x5605dee15320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 shutdown_connections 2024-09-19T05:25:48.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 1 -- 172.21.15.1:0/2790655763 wait complete. 2024-09-19T05:25:48.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.851+0000 7faf0b0ce740 20 client.25078 trim_cache size 0 max 16384 2024-09-19T05:25:48.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 Processor -- start 2024-09-19T05:25:48.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 -- start start 2024-09-19T05:25:48.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee15b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee0e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf041aaa10 con 0x5605dee13980 2024-09-19T05:25:48.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf041ad290 con 0x5605dee13060 2024-09-19T05:25:48.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf041ab080 con 0x5605dee1e240 2024-09-19T05:25:48.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52062/0 (socket says 172.21.15.1:52062) 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 -- 172.21.15.1:0/3442333510 learned_addr learned my addr 172.21.15.1:0/3442333510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0259c640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee15b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 -- 172.21.15.1:0/3442333510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 msgr2=0x5605dee0e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf02d9d640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee0e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee0e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 -- 172.21.15.1:0/3442333510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 msgr2=0x5605dee15b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee15b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 -- 172.21.15.1:0/3442333510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605dee1d0c0 con 0x5605dee13980 2024-09-19T05:25:48.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf0259c640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee15b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:48.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.868+0000 7faf01d9b640 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faef8005940 tx=0x7faef8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8f9285797e804a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faeebfff640 1 -- 172.21.15.1:0/3442333510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8035040 con 0x5605dee13980 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faeebfff640 1 -- 172.21.15.1:0/3442333510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef8040040 con 0x5605dee13980 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faeebfff640 1 -- 172.21.15.1:0/3442333510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8031d30 con 0x5605dee13980 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3442333510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 msgr2=0x5605dee16480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faef8005940 tx=0x7faef8004750 comp rx=0 tx=0).stop 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3442333510 shutdown_connections 2024-09-19T05:25:48.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee0e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee16480 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/3442333510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee15b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3442333510 >> 172.21.15.1:0/3442333510 conn(0x5605dee0f5f0 msgr2=0x5605dee0df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3442333510 shutdown_connections 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.869+0000 7faf0b0ce740 1 -- 172.21.15.1:0/3442333510 wait complete. 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 -- start start 2024-09-19T05:25:48.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 Processor -- start 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee95ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf041ab750 con 0x5605dee13980 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf041acbc0 con 0x5605dee13060 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf041abe20 con 0x5605dee1e240 2024-09-19T05:25:48.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0b0ce740 10 client.0 _ll_register_callbacks cb 0x7faef409bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52070/0 (socket says 172.21.15.1:52070) 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 -- 172.21.15.1:0/1941085446 learned_addr learned my addr 172.21.15.1:0/1941085446 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf02d9d640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee95ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf0259c640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 -- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 msgr2=0x5605dee95ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee95ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 -- 172.21.15.1:0/1941085446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 msgr2=0x5605dee227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:48.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.870+0000 7faf01d9b640 1 -- 172.21.15.1:0/1941085446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605dee964b0 con 0x5605dee13980 2024-09-19T05:25:48.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faf01d9b640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faef803f040 tx=0x7faef8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad83c90b97fbbeff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:48.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:25:48.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8035070 con 0x5605dee13980 2024-09-19T05:25:48.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7faef8031dc0 con 0x5605dee13980 2024-09-19T05:25:48.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faef8040040 con 0x5605dee13980 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faef8068050 con 0x5605dee13980 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faf0b0ce740 10 client.15441 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5605dee9d850 con 0x5605dee13980 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faef8040040 con 0x5605dee13980 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.871+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faef8051810 con 0x5605dee13980 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 10 client.15441 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:48.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 10 client.15441 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 20 client.15441 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee9daf0 0x5605dee9ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 4 client.15441 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e5ff952b", "release": true, "await": true}] 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e5ff952b", "release": true, "await": true}) -- 0x5605ded800a0 con 0x5605dee9daf0 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0259c640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee9daf0 0x5605dee9ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faee9ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:48.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.872+0000 7faf0259c640 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee9daf0 0x5605dee9ff10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db746ae60282743 server_cookie=d7dd1491077192d3 in_seq=0 out_seq=0 2024-09-19T05:25:48.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faee9ffb640 1 -- 172.21.15.1:0/1941085446 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5605ded800a0 con 0x5605dee9daf0 2024-09-19T05:25:48.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faee9ffb640 10 client.15441 handle_command_reply: tid=0 2024-09-19T05:25:48.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faf0b0ce740 1 client.15441 shutdown 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 msgr2=0x5605dee22d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faef803f040 tx=0x7faef8005fd0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 shutdown_connections 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.883+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5605dee9daf0 0x5605dee9ff10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faee9ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5605dee1e240 0x5605dee95ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5605dee13980 0x5605dee22d20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 --2- 172.21.15.1:0/1941085446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5605dee13060 0x5605dee227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 >> 172.21.15.1:0/1941085446 conn(0x5605dee0f5f0 msgr2=0x5605dee0e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 shutdown_connections 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 1 -- 172.21.15.1:0/1941085446 wait complete. 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf0b0ce740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 20, 2024-09-19T05:25:48.892 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "e5ff952b": { 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 20, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:25:48.893 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:48.894 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 msgr2=0x7faeec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 0x7faeec0a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faefc0099e0 tx=0x7faefc009500 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 msgr2=0x7faf04197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faef400c920 tx=0x7faef400cde0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 shutdown_connections 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7faeec0a3240 0x7faeec0a5700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf04102ef0 0x7faf0419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf04102570 0x7faf04197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 --2- 172.21.15.1:0/1852690978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf04100e20 0x7faf04197300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 >> 172.21.15.1:0/1852690978 conn(0x7faf040fc7d0 msgr2=0x7faf04106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:48.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.884+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 shutdown_connections 2024-09-19T05:25:48.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:48.885+0000 7faf08cf5640 1 -- 172.21.15.1:0/1852690978 wait complete. 2024-09-19T05:25:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:49 smithi001 ceph-mon[30968]: pgmap v490: 129 pgs: 129 active+clean; 163 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-09-19T05:25:49.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 383907 9.29 MB/sec execute 64 sec latency 29090.438 ms 2024-09-19T05:25:49.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:49 smithi060 ceph-mon[35058]: pgmap v490: 129 pgs: 129 active+clean; 163 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-09-19T05:25:49.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:49 smithi082 ceph-mon[35195]: pgmap v490: 129 pgs: 129 active+clean; 163 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 2.8 MiB/s wr, 88 op/s 2024-09-19T05:25:50.162 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e5ff952b', total seconds elapsed: 33.9 2024-09-19T05:25:50.162 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T05:25:50.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:25:50.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 387124 9.44 MB/sec execute 65 sec latency 36.279 ms 2024-09-19T05:25:50.445 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:50.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.945+0000 7fbf2bd21640 1 -- 172.21.15.1:0/1059679166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 msgr2=0x7fbf241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.945+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/1059679166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf241021c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009900 tx=0x7fbf2002a410 comp rx=0 tx=0).stop 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 -- 172.21.15.1:0/1059679166 shutdown_connections 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/1059679166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 0x7fbf2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/1059679166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/1059679166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf241021c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 -- 172.21.15.1:0/1059679166 >> 172.21.15.1:0/1059679166 conn(0x7fbf240fd8c0 msgr2=0x7fbf240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 -- 172.21.15.1:0/1059679166 shutdown_connections 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 -- 172.21.15.1:0/1059679166 wait complete. 2024-09-19T05:25:50.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 Processor -- start 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.946+0000 7fbf2bd21640 1 -- start start 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf24198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 0x7fbf2419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24111f70 con 0x7fbf24101de0 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24111df0 con 0x7fbf24106f10 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2bd21640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbf241120f0 con 0x7fbf24102790 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:38520/0 (socket says 172.21.15.1:38520) 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 -- 172.21.15.1:0/151010180 learned_addr learned my addr 172.21.15.1:0/151010180 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf2a2be640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 0x7fbf2419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:50.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf29abd640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf24198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 -- 172.21.15.1:0/151010180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 msgr2=0x7fbf2419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 0x7fbf2419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 -- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 msgr2=0x7fbf24198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf24198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 -- 172.21.15.1:0/151010180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2419d400 con 0x7fbf24102790 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf292bc640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400e9f0 tx=0x7fbf1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.947+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400cd80 con 0x7fbf24102790 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.948+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2419d6f0 con 0x7fbf24102790 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.948+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf14010910 con 0x7fbf24102790 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.948+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140188f0 con 0x7fbf24102790 2024-09-19T05:25:50.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.948+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf241a4fd0 con 0x7fbf24102790 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.949+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf241021c0 con 0x7fbf24102790 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.950+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbf14010ac0 con 0x7fbf24102790 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.951+0000 7fbf1affd640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 0x7fbf100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.951+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbf140d03a0 con 0x7fbf24102790 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.951+0000 7fbf29abd640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 0x7fbf100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.951+0000 7fbf29abd640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 0x7fbf100a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009230 tx=0x7fbf200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:50.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:50.955+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf1409c6c0 con 0x7fbf24102790 2024-09-19T05:25:51.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.187+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf2410a150 con 0x7fbf24102790 2024-09-19T05:25:51.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.187+0000 7fbf1affd640 1 -- 172.21.15.1:0/151010180 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fbf140a09c0 con 0x7fbf24102790 2024-09-19T05:25:51.439 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:25:51.440 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:25:51.440 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:25:51.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 msgr2=0x7fbf100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 0x7fbf100a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009230 tx=0x7fbf200058d0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 msgr2=0x7fbf24198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400e9f0 tx=0x7fbf1400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 shutdown_connections 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbf100a3240 0x7fbf100a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf24106f10 0x7fbf2419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf24102790 0x7fbf24198990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 --2- 172.21.15.1:0/151010180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbf24101de0 0x7fbf24198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 >> 172.21.15.1:0/151010180 conn(0x7fbf240fd8c0 msgr2=0x7fbf240fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 shutdown_connections 2024-09-19T05:25:51.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:51.190+0000 7fbf2bd21640 1 -- 172.21.15.1:0/151010180 wait complete. 2024-09-19T05:25:51.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:51 smithi001 ceph-mon[30968]: pgmap v491: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2024-09-19T05:25:51.442 INFO:tasks.workunit.client.0.smithi001.stdout: 1 390621 9.58 MB/sec execute 66 sec latency 21.308 ms 2024-09-19T05:25:51.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:51 smithi060 ceph-mon[35058]: pgmap v491: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2024-09-19T05:25:51.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:51 smithi082 ceph-mon[35195]: pgmap v491: 129 pgs: 129 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2024-09-19T05:25:52.099 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T05:25:52.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T05:25:52.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:52 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/151010180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:52.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 394055 9.72 MB/sec execute 67 sec latency 28.508 ms 2024-09-19T05:25:52.376 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:25:52.402 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:52 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/151010180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:52.408 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:52 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/151010180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:25:52.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1188340606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198102570 msgr2=0x7fd1981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1188340606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198102570 0x7fd1981029b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd180009900 tx=0x7fd18002a480 comp rx=0 tx=0).stop 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1188340606 shutdown_connections 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1188340606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 0x7fd19810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1188340606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198102570 0x7fd1981029b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1188340606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198100e20 0x7fd198101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1188340606 >> 172.21.15.1:0/1188340606 conn(0x7fd1980fc7d0 msgr2=0x7fd1980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1188340606 shutdown_connections 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.881+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1188340606 wait complete. 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 Processor -- start 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 -- start start 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198102570 0x7fd198198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 0x7fd19819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd198110fd0 con 0x7fd198100e20 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd198110e50 con 0x7fd198102ef0 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19cf5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd198111150 con 0x7fd198102570 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52108/0 (socket says 172.21.15.1:52108) 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 -- 172.21.15.1:0/1971428249 learned_addr learned my addr 172.21.15.1:0/1971428249 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198102570 0x7fd198198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd196d9d640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 0x7fd19819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 -- 172.21.15.1:0/1971428249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198102570 msgr2=0x7fd198198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198102570 0x7fd198198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 -- 172.21.15.1:0/1971428249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 msgr2=0x7fd19819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 0x7fd19819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.882+0000 7fd19659c640 1 -- 172.21.15.1:0/1971428249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19819d500 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd19659c640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd18800e9f0 tx=0x7fd18800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd18f7fe640 1 -- 172.21.15.1:0/1971428249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18800cd80 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd18f7fe640 1 -- 172.21.15.1:0/1971428249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd188005500 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19819d7f0 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd18f7fe640 1 -- 172.21.15.1:0/1971428249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188010690 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.883+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1981a50d0 con 0x7fd198100e20 2024-09-19T05:25:52.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd18f7fe640 1 -- 172.21.15.1:0/1971428249 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd1880046c0 con 0x7fd198100e20 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 Processor -- start 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 -- start start 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406640 0x5565ff406a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 0x5565ff415810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5565ff36c2a0 con 0x5565ff406f60 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5565ff313b10 con 0x5565ff406640 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19f337740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565ff368260 con 0x5565ff415d50 2024-09-19T05:25:52.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 0x5565ff415810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd18ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd18ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:38538/0 (socket says 172.21.15.1:38538) 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd18ffff640 1 -- 172.21.15.1:0/1668288764 learned_addr learned my addr 172.21.15.1:0/1668288764 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.886+0000 7fd196d9d640 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406640 0x5565ff406a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18f7fe640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 0x7fd1840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 -- 172.21.15.1:0/1668288764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406640 msgr2=0x5565ff406a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406640 0x5565ff406a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 -- 172.21.15.1:0/1668288764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 msgr2=0x5565ff415810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 0x5565ff415810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 -- 172.21.15.1:0/1668288764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ff0ddb90 con 0x5565ff415d50 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd19659c640 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 0x5565ff415810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd196d9d640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 0x7fd1840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18f7fe640 1 -- 172.21.15.1:0/1971428249 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd1880d00a0 con 0x7fd198100e20 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd180009900 tx=0x7fd1800040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cbb9fa2d1060ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd196d9d640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 0x7fd1840a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd190007fc0 tx=0x7fd190004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.887+0000 7fd18cff9640 1 -- 172.21.15.1:0/1668288764 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180035040 con 0x5565ff415d50 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd18cff9640 1 -- 172.21.15.1:0/1668288764 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd180005520 con 0x5565ff415d50 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd18cff9640 1 -- 172.21.15.1:0/1668288764 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180003850 con 0x5565ff415d50 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 -- 172.21.15.1:0/1668288764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 msgr2=0x5565ff418140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd180009900 tx=0x7fd1800040f0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 -- 172.21.15.1:0/1668288764 shutdown_connections 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff418140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406f60 0x5565ff415810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 --2- 172.21.15.1:0/1668288764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406640 0x5565ff406a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 -- 172.21.15.1:0/1668288764 >> 172.21.15.1:0/1668288764 conn(0x5565ff402cf0 msgr2=0x5565ff4030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:52.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 -- 172.21.15.1:0/1668288764 shutdown_connections 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.888+0000 7fd19f337740 1 -- 172.21.15.1:0/1668288764 wait complete. 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 -- start start 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 Processor -- start 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff4136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5565ff418920 con 0x5565ff406640 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5565ff2f46e0 con 0x5565ff406f60 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565ff418aa0 con 0x5565ff415d50 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19f337740 10 client.0 _ll_register_callbacks cb 0x5565ff318a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52128/0 (socket says 172.21.15.1:52128) 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd19659c640 1 -- 172.21.15.1:0/1508594209 learned_addr learned my addr 172.21.15.1:0/1508594209 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:52.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd196d9d640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff4136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.889+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 -- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 msgr2=0x5565ff4136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff4136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 -- 172.21.15.1:0/1508594209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 msgr2=0x5565ff413190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 -- 172.21.15.1:0/1508594209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ff421e80 con 0x5565ff406640 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19659c640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c6a0 tx=0x7fd188009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690b3dd61de615da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd17dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18809c0e0 con 0x5565ff406640 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd1880d3df0 con 0x5565ff406640 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd180005520 con 0x5565ff406640 2024-09-19T05:25:52.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd18809bc70 con 0x5565ff406640 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19f337740 10 client.15459 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5565ff424850 con 0x5565ff406640 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.890+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd180005520 con 0x5565ff406640 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd1880d20d0 con 0x5565ff406640 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 10 client.15459 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 10 client.15459 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 20 client.15459 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff425c60 0x5565ff428050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 4 client.15459 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565ff3799d0 con 0x5565ff425c60 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff425c60 0x5565ff428050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd17dffb640 10 client.15459 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:52.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.891+0000 7fd18ffff640 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff425c60 0x5565ff428050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b10ab3fda739dea server_cookie=56a8947e50b9078e in_seq=0 out_seq=0 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd17dffb640 1 -- 172.21.15.1:0/1508594209 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565ff3799d0 con 0x5565ff425c60 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd17dffb640 10 client.15459 handle_command_reply: tid=0 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 client.15459 shutdown 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 msgr2=0x5565ff412c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c6a0 tx=0x7fd188009310 comp rx=0 tx=0).stop 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 shutdown_connections 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff425c60 0x5565ff428050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff415d50 0x5565ff4136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 --2- 172.21.15.1:0/1508594209 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff412c50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 >> 172.21.15.1:0/1508594209 conn(0x5565ff402cf0 msgr2=0x5565ff408a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.892+0000 7fd17dffb640 0 client.15459 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:52.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.893+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 shutdown_connections 2024-09-19T05:25:52.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.893+0000 7fd19f337740 1 -- 172.21.15.1:0/1508594209 wait complete. 2024-09-19T05:25:52.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.893+0000 7fd19f337740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T05:25:52.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 Processor -- start 2024-09-19T05:25:52.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 -- start start 2024-09-19T05:25:52.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406640 0x5565ff413320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff415d50 0x5565ff42d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981aabf0 con 0x5565ff415d50 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ad470 con 0x5565ff406f60 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19f337740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ab260 con 0x5565ff406640 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd196d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff415d50 0x5565ff42d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:55600/0 (socket says 172.21.15.1:55600) 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 -- 172.21.15.1:0/2236277281 learned_addr learned my addr 172.21.15.1:0/2236277281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd19659c640 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406640 0x5565ff413320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 -- 172.21.15.1:0/2236277281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406640 msgr2=0x5565ff413320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406640 0x5565ff413320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 -- 172.21.15.1:0/2236277281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff415d50 msgr2=0x5565ff42d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.911+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff415d50 0x5565ff42d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.912+0000 7fd18ffff640 1 -- 172.21.15.1:0/2236277281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565ff4283c0 con 0x5565ff406f60 2024-09-19T05:25:52.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.912+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd180004d80 tx=0x7fd180004db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ceb1d960c57e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.912+0000 7fd17ffff640 1 -- 172.21.15.1:0/2236277281 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180035040 con 0x5565ff406f60 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.912+0000 7fd17ffff640 1 -- 172.21.15.1:0/2236277281 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1800048c0 con 0x5565ff406f60 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.912+0000 7fd17ffff640 1 -- 172.21.15.1:0/2236277281 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1800038e0 con 0x5565ff406f60 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- 172.21.15.1:0/2236277281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 msgr2=0x5565ff413860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd180004d80 tx=0x7fd180004db0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- 172.21.15.1:0/2236277281 shutdown_connections 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff415d50 0x5565ff42d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff406f60 0x5565ff413860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 --2- 172.21.15.1:0/2236277281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406640 0x5565ff413320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- 172.21.15.1:0/2236277281 >> 172.21.15.1:0/2236277281 conn(0x5565ff402cf0 msgr2=0x5565ff412c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- 172.21.15.1:0/2236277281 shutdown_connections 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- 172.21.15.1:0/2236277281 wait complete. 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.913+0000 7fd19f337740 1 -- start start 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 Processor -- start 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 0x5565ff41a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff415d50 0x5565ff48f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ab930 con 0x5565ff406640 2024-09-19T05:25:52.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981acda0 con 0x5565ff415d50 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981ac000 con 0x5565ff406f60 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19f337740 10 client.0 _ll_register_callbacks cb 0x7fd188009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52160/0 (socket says 172.21.15.1:52160) 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd18ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 0x5565ff41a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 -- 172.21.15.1:0/2347968484 learned_addr learned my addr 172.21.15.1:0/2347968484 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd196d9d640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff415d50 0x5565ff48f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 -- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 msgr2=0x5565ff41a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 0x5565ff41a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 -- 172.21.15.1:0/2347968484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff415d50 msgr2=0x5565ff48f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff415d50 0x5565ff48f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd19659c640 1 -- 172.21.15.1:0/2347968484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565ff48fe10 con 0x5565ff406640 2024-09-19T05:25:52.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.914+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 0x5565ff41a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd19659c640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd18809c010 tx=0x7fd1880a4d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ba098c42aa1491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18809be50 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd1880bc0b0 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1800048c0 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd18809c0e0 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd19f337740 10 client.15465 fetch_fsmap learned FSMap version 21 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5565ff490f50 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1800048c0 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.915+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd18809b1d0 con 0x5565ff406640 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 10 client.15465 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 10 client.15465 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 20 client.15465 populate_metadata read hostname 'smithi001' 2024-09-19T05:25:52.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff4916e0 0x5565ff493ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:52.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 4 client.15465 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T05:25:52.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x5565ff373d20 con 0x5565ff4916e0 2024-09-19T05:25:52.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff4916e0 0x5565ff493ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:52.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd18ffff640 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff4916e0 0x5565ff493ad0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68e6f86683e1f4fa server_cookie=8086fc673a2ffa27 in_seq=0 out_seq=0 2024-09-19T05:25:52.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:52.916+0000 7fd17dffb640 10 client.15465 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:53.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.013+0000 7fd17dffb640 1 -- 172.21.15.1:0/2347968484 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5565ff373d20 con 0x5565ff4916e0 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.013+0000 7fd17dffb640 10 client.15465 handle_command_reply: tid=0 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.013+0000 7fd19f337740 1 client.15465 shutdown 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 msgr2=0x5565ff419e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd18809c010 tx=0x7fd1880a4d00 comp rx=0 tx=0).stop 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 shutdown_connections 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565ff415d50 0x5565ff48f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5565ff4916e0 0x5565ff493ad0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565ff406f60 0x5565ff41a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd17dffb640 0 client.15465 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 --2- 172.21.15.1:0/2347968484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5565ff406640 0x5565ff419e50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 >> 172.21.15.1:0/2347968484 conn(0x5565ff402cf0 msgr2=0x5565ff413430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:53.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 shutdown_connections 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 1 -- 172.21.15.1:0/2347968484 wait complete. 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19f337740 20 client.15465 trim_cache size 0 max 16384 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:25:53.017 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 22, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "fb000a21": { 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 22, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:25:53.018 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:25:53.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 msgr2=0x7fd1840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 0x7fd1840a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd190007fc0 tx=0x7fd190004a40 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 msgr2=0x7fd198198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.014+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd18800e9f0 tx=0x7fd18800edf0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 shutdown_connections 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd1840a3240 0x7fd1840a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd198102ef0 0x7fd19819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd198102570 0x7fd198198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 --2- 172.21.15.1:0/1971428249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd198100e20 0x7fd198198550 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 >> 172.21.15.1:0/1971428249 conn(0x7fd1980fc7d0 msgr2=0x7fd19806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 shutdown_connections 2024-09-19T05:25:53.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:25:53.015+0000 7fd19cf5e640 1 -- 172.21.15.1:0/1971428249 wait complete. 2024-09-19T05:25:53.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:53 smithi001 ceph-mon[30968]: pgmap v492: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.2 MiB/s wr, 116 op/s 2024-09-19T05:25:53.375 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.66 MB/sec execute 68 sec latency 460.121 ms 2024-09-19T05:25:53.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:53 smithi060 ceph-mon[35058]: pgmap v492: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.2 MiB/s wr, 116 op/s 2024-09-19T05:25:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:53 smithi082 ceph-mon[35195]: pgmap v492: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 3.2 MiB/s wr, 116 op/s 2024-09-19T05:25:53.928 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fb000a21', quiesce took 3.8 seconds. Will release after: 26.0 2024-09-19T05:25:54.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.52 MB/sec execute 69 sec latency 1460.247 ms 2024-09-19T05:25:55.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:55 smithi001 ceph-mon[30968]: pgmap v493: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 2.9 MiB/s wr, 152 op/s 2024-09-19T05:25:55.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.38 MB/sec execute 70 sec latency 2460.352 ms 2024-09-19T05:25:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:55 smithi060 ceph-mon[35058]: pgmap v493: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 2.9 MiB/s wr, 152 op/s 2024-09-19T05:25:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:55 smithi082 ceph-mon[35195]: pgmap v493: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 2.9 MiB/s wr, 152 op/s 2024-09-19T05:25:56.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.25 MB/sec execute 71 sec latency 3460.465 ms 2024-09-19T05:25:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:57 smithi001 ceph-mon[30968]: pgmap v494: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-09-19T05:25:57.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.12 MB/sec execute 72 sec latency 4460.598 ms 2024-09-19T05:25:57.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:57 smithi060 ceph-mon[35058]: pgmap v494: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-09-19T05:25:57.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:57 smithi082 ceph-mon[35195]: pgmap v494: 129 pgs: 129 active+clean; 152 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-09-19T05:25:58.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 9.00 MB/sec execute 73 sec latency 5460.689 ms 2024-09-19T05:25:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:25:59 smithi001 ceph-mon[30968]: pgmap v495: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:25:59.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.87 MB/sec execute 74 sec latency 6460.812 ms 2024-09-19T05:25:59.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:25:59 smithi060 ceph-mon[35058]: pgmap v495: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:25:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:25:59 smithi082 ceph-mon[35195]: pgmap v495: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:26:00.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.76 MB/sec execute 75 sec latency 7460.889 ms 2024-09-19T05:26:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:01 smithi001 ceph-mon[30968]: pgmap v496: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-09-19T05:26:01.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.64 MB/sec execute 76 sec latency 8461.016 ms 2024-09-19T05:26:01.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:01 smithi060 ceph-mon[35058]: pgmap v496: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-09-19T05:26:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:01 smithi082 ceph-mon[35195]: pgmap v496: 129 pgs: 129 active+clean; 156 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-09-19T05:26:02.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.53 MB/sec execute 77 sec latency 9461.126 ms 2024-09-19T05:26:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:03 smithi001 ceph-mon[30968]: pgmap v497: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 157 op/s 2024-09-19T05:26:03.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.42 MB/sec execute 78 sec latency 10461.220 ms 2024-09-19T05:26:03.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:03 smithi060 ceph-mon[35058]: pgmap v497: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 157 op/s 2024-09-19T05:26:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:03 smithi082 ceph-mon[35195]: pgmap v497: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 157 op/s 2024-09-19T05:26:04.376 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.31 MB/sec execute 79 sec latency 11461.263 ms 2024-09-19T05:26:05.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:05 smithi001 ceph-mon[30968]: pgmap v498: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2024-09-19T05:26:05.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.21 MB/sec execute 80 sec latency 12461.387 ms 2024-09-19T05:26:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:05 smithi060 ceph-mon[35058]: pgmap v498: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2024-09-19T05:26:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:05 smithi082 ceph-mon[35195]: pgmap v498: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2024-09-19T05:26:06.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.11 MB/sec execute 81 sec latency 13461.497 ms 2024-09-19T05:26:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:07 smithi001 ceph-mon[30968]: pgmap v499: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 641 KiB/s wr, 37 op/s 2024-09-19T05:26:07.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 8.01 MB/sec execute 82 sec latency 14461.557 ms 2024-09-19T05:26:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:07 smithi060 ceph-mon[35058]: pgmap v499: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 641 KiB/s wr, 37 op/s 2024-09-19T05:26:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:07 smithi082 ceph-mon[35195]: pgmap v499: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 641 KiB/s wr, 37 op/s 2024-09-19T05:26:08.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:08.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:08.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:08.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:26:08.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.91 MB/sec execute 83 sec latency 15461.654 ms 2024-09-19T05:26:08.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:08.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:08.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:08.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:26:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:26:09.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.82 MB/sec execute 84 sec latency 16461.758 ms 2024-09-19T05:26:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:09 smithi001 ceph-mon[30968]: pgmap v500: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-09-19T05:26:10.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:09 smithi060 ceph-mon[35058]: pgmap v500: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-09-19T05:26:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:09 smithi082 ceph-mon[35195]: pgmap v500: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-09-19T05:26:10.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.73 MB/sec execute 85 sec latency 17461.860 ms 2024-09-19T05:26:11.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.64 MB/sec execute 86 sec latency 18461.993 ms 2024-09-19T05:26:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:11 smithi001 ceph-mon[30968]: pgmap v501: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-09-19T05:26:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:11 smithi060 ceph-mon[35058]: pgmap v501: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-09-19T05:26:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:11 smithi082 ceph-mon[35195]: pgmap v501: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-09-19T05:26:12.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.55 MB/sec execute 87 sec latency 19462.116 ms 2024-09-19T05:26:13.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.46 MB/sec execute 88 sec latency 20462.223 ms 2024-09-19T05:26:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:13 smithi060 ceph-mon[35058]: pgmap v502: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-19T05:26:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:13 smithi082 ceph-mon[35195]: pgmap v502: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-19T05:26:14.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:13 smithi001 ceph-mon[30968]: pgmap v502: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-19T05:26:14.377 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.38 MB/sec execute 89 sec latency 21462.336 ms 2024-09-19T05:26:15.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.30 MB/sec execute 90 sec latency 22462.448 ms 2024-09-19T05:26:16.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:15 smithi060 ceph-mon[35058]: pgmap v503: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-19T05:26:16.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:15 smithi082 ceph-mon[35195]: pgmap v503: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-19T05:26:16.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:15 smithi001 ceph-mon[30968]: pgmap v503: 129 pgs: 129 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-19T05:26:16.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.22 MB/sec execute 91 sec latency 23462.559 ms 2024-09-19T05:26:17.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.14 MB/sec execute 92 sec latency 24462.668 ms 2024-09-19T05:26:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:17 smithi060 ceph-mon[35058]: pgmap v504: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 301 KiB/s wr, 8 op/s 2024-09-19T05:26:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:17 smithi082 ceph-mon[35195]: pgmap v504: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 301 KiB/s wr, 8 op/s 2024-09-19T05:26:18.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:17 smithi001 ceph-mon[30968]: pgmap v504: 129 pgs: 129 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 301 KiB/s wr, 8 op/s 2024-09-19T05:26:18.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 7.06 MB/sec execute 93 sec latency 25462.795 ms 2024-09-19T05:26:19.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 6.99 MB/sec execute 94 sec latency 26462.915 ms 2024-09-19T05:26:19.932 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:26:20.205 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:26:20.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:19 smithi060 ceph-mon[35058]: pgmap v505: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 821 KiB/s wr, 18 op/s 2024-09-19T05:26:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:19 smithi082 ceph-mon[35195]: pgmap v505: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 821 KiB/s wr, 18 op/s 2024-09-19T05:26:20.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:19 smithi001 ceph-mon[30968]: pgmap v505: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 821 KiB/s wr, 18 op/s 2024-09-19T05:26:20.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 6.91 MB/sec execute 95 sec latency 27463.036 ms 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2140302306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100e30 msgr2=0x7f9fd8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2140302306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100e30 0x7f9fd8104e80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009900 tx=0x7f9fc002b620 comp rx=0 tx=0).stop 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2140302306 shutdown_connections 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2140302306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd81055b0 0x7f9fd810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2140302306 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100e30 0x7f9fd8104e80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2140302306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd8100480 0x7f9fd8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2140302306 >> 172.21.15.1:0/2140302306 conn(0x7f9fd8077210 msgr2=0x7f9fd80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2140302306 shutdown_connections 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.705+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2140302306 wait complete. 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 Processor -- start 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 -- start start 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 0x7f9fd80fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 0x7f9fd80fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd810fd90 con 0x7f9fd8100480 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd810fc10 con 0x7f9fd81055b0 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fde3e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd810ff10 con 0x7f9fd8100e30 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:20.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41442/0 (socket says 172.21.15.1:41442) 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.706+0000 7f9fd7fff640 1 -- 172.21.15.1:0/2021701428 learned_addr learned my addr 172.21.15.1:0/2021701428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fcffff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 0x7f9fd80fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fdc985640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 0x7f9fd80fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 -- 172.21.15.1:0/2021701428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 msgr2=0x7f9fd80fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 0x7f9fd80fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 -- 172.21.15.1:0/2021701428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 msgr2=0x7f9fd80fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 0x7f9fd80fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 -- 172.21.15.1:0/2021701428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd81a6960 con 0x7f9fd8100480 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fcffff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 0x7f9fd80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fdc985640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 0x7f9fd80fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd7fff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800d950 tx=0x7f9fc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8017030 con 0x7f9fd8100480 2024-09-19T05:26:20.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd81a6c50 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8004020 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80047a0 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.707+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd81a7190 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.708+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd8100860 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.709+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9fc80041d0 con 0x7f9fd8100480 2024-09-19T05:26:20.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.710+0000 7f9fd5ffb640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 0x7f9fc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.710+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9fc80cf7b0 con 0x7f9fd8100480 2024-09-19T05:26:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.710+0000 7f9fcffff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 0x7f9fc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:20.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.711+0000 7f9fcffff640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 0x7f9fc40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00096c0 tx=0x7f9fc0032490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:20.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.716+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fc809c0c0 con 0x7f9fd8100480 2024-09-19T05:26:20.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.928+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fd80fdbc0 con 0x7f9fd8100480 2024-09-19T05:26:20.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.928+0000 7f9fd5ffb640 1 -- 172.21.15.1:0/2021701428 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f9fc809b9c0 con 0x7f9fd8100480 2024-09-19T05:26:20.930 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:26:20.930 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:26:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:26:20.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.930+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 msgr2=0x7f9fc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.930+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 0x7f9fc40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00096c0 tx=0x7f9fc0032490 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.930+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 msgr2=0x7f9fd80fc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800d950 tx=0x7f9fc800de10 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 shutdown_connections 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9fc40a32c0 0x7f9fc40a5780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fd81055b0 0x7f9fd80fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fd8100e30 0x7f9fd80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 --2- 172.21.15.1:0/2021701428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9fd8100480 0x7f9fd80fc690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 >> 172.21.15.1:0/2021701428 conn(0x7f9fd8077210 msgr2=0x7f9fd8103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 shutdown_connections 2024-09-19T05:26:20.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:20.931+0000 7f9fde3e8640 1 -- 172.21.15.1:0/2021701428 wait complete. 2024-09-19T05:26:21.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 6.84 MB/sec execute 96 sec latency 28463.109 ms 2024-09-19T05:26:21.840 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id fb000a21 --release --await' 2024-09-19T05:26:21.840 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id fb000a21 --release --await 2024-09-19T05:26:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:21 smithi001 ceph-mon[30968]: pgmap v506: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 823 KiB/s wr, 17 op/s 2024-09-19T05:26:22.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:21 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2021701428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:26:22.104 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:26:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:21 smithi060 ceph-mon[35058]: pgmap v506: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 823 KiB/s wr, 17 op/s 2024-09-19T05:26:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:21 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2021701428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:26:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:21 smithi082 ceph-mon[35195]: pgmap v506: 129 pgs: 129 active+clean; 159 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 823 KiB/s wr, 17 op/s 2024-09-19T05:26:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:21 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2021701428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:26:22.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395177 6.77 MB/sec execute 97 sec latency 29463.149 ms 2024-09-19T05:26:22.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 -- 172.21.15.1:0/3896227697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c101280 msgr2=0x7fd93c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 --2- 172.21.15.1:0/3896227697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c101280 0x7fd93c10df40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009900 tx=0x7fd92c02a410 comp rx=0 tx=0).stop 2024-09-19T05:26:22.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 -- 172.21.15.1:0/3896227697 shutdown_connections 2024-09-19T05:26:22.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 --2- 172.21.15.1:0/3896227697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 0x7fd93c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 --2- 172.21.15.1:0/3896227697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c101280 0x7fd93c10df40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 --2- 172.21.15.1:0/3896227697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c1008d0 0x7fd93c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.542+0000 7fd943c1b640 1 -- 172.21.15.1:0/3896227697 >> 172.21.15.1:0/3896227697 conn(0x7fd93c0fc7a0 msgr2=0x7fd93c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 -- 172.21.15.1:0/3896227697 shutdown_connections 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 -- 172.21.15.1:0/3896227697 wait complete. 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 Processor -- start 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 -- start start 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c101280 0x7fd93c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.543+0000 7fd943c1b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 0x7fd93c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd943c1b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c114190 con 0x7fd93c1008d0 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd943c1b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c114010 con 0x7fd93c101280 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd943c1b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c114310 con 0x7fd93c10e480 2024-09-19T05:26:22.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41466/0 (socket says 172.21.15.1:41466) 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 -- 172.21.15.1:0/2921230219 learned_addr learned my addr 172.21.15.1:0/2921230219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9411b6640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c101280 0x7fd93c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9421b8640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 0x7fd93c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 -- 172.21.15.1:0/2921230219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 msgr2=0x7fd93c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 0x7fd93c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 -- 172.21.15.1:0/2921230219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c101280 msgr2=0x7fd93c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c101280 0x7fd93c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 -- 172.21.15.1:0/2921230219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c19f660 con 0x7fd93c1008d0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d950 tx=0x7fd93800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.544+0000 7fd932ffd640 1 -- 172.21.15.1:0/2921230219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938017070 con 0x7fd93c1008d0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.545+0000 7fd932ffd640 1 -- 172.21.15.1:0/2921230219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938009c30 con 0x7fd93c1008d0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.545+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c19f950 con 0x7fd93c1008d0 2024-09-19T05:26:22.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.545+0000 7fd932ffd640 1 -- 172.21.15.1:0/2921230219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93800f6b0 con 0x7fd93c1008d0 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.545+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c1a7230 con 0x7fd93c1008d0 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.547+0000 7fd932ffd640 1 -- 172.21.15.1:0/2921230219 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd9380109d0 con 0x7fd93c1008d0 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 Processor -- start 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 -- start start 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426060 0x5640b1426440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd932ffd640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 0x7fd9280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1431240 0x5640b1433630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5640b138b620 con 0x5640b1426980 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5640b1332e50 con 0x5640b1431240 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd945ff4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5640b13875e0 con 0x5640b1426060 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd9411b6640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 0x7fd9280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41480/0 (socket says 172.21.15.1:41480) 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd9419b7640 1 -- 172.21.15.1:0/1819576572 learned_addr learned my addr 172.21.15.1:0/1819576572 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd932ffd640 1 -- 172.21.15.1:0/2921230219 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd9380cf860 con 0x7fd93c1008d0 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.548+0000 7fd9421b8640 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1431240 0x5640b1433630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9421b8640 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426060 0x5640b1426440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 -- 172.21.15.1:0/1819576572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426060 msgr2=0x5640b1426440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426060 0x5640b1426440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 -- 172.21.15.1:0/1819576572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1431240 msgr2=0x5640b1433630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1431240 0x5640b1433630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 -- 172.21.15.1:0/1819576572 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b1323d40 con 0x5640b1426980 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9411b6640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 0x7fd9280a5780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009230 tx=0x7fd92c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd938097f80 tx=0x7fd93800dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5e3705e766bacf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd927fff640 1 -- 172.21.15.1:0/1819576572 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938020070 con 0x5640b1426980 2024-09-19T05:26:22.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd927fff640 1 -- 172.21.15.1:0/1819576572 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938009de0 con 0x5640b1426980 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.549+0000 7fd927fff640 1 -- 172.21.15.1:0/1819576572 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380a1790 con 0x5640b1426980 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- 172.21.15.1:0/1819576572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 msgr2=0x5640b1430d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd938097f80 tx=0x7fd93800dfa0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- 172.21.15.1:0/1819576572 shutdown_connections 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1431240 0x5640b1433630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1430d00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1819576572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426060 0x5640b1426440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- 172.21.15.1:0/1819576572 >> 172.21.15.1:0/1819576572 conn(0x5640b14225f0 msgr2=0x5640b14229d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- 172.21.15.1:0/1819576572 shutdown_connections 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- 172.21.15.1:0/1819576572 wait complete. 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 -- start start 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.550+0000 7fd945ff4740 1 Processor -- start 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b142e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b142e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5640b1433e10 con 0x5640b1431240 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5640b1313f10 con 0x5640b1426060 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5640b1433f90 con 0x5640b1426980 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd945ff4740 10 client.0 _ll_register_callbacks cb 0x5640b1337db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41490/0 (socket says 172.21.15.1:41490) 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 -- 172.21.15.1:0/2288366523 learned_addr learned my addr 172.21.15.1:0/2288366523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b142e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9411b6640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b142e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 -- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 msgr2=0x5640b142e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b142e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 -- 172.21.15.1:0/2288366523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 msgr2=0x5640b142e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b142e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9421b8640 1 -- 172.21.15.1:0/2288366523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b109a580 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.551+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b142e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9421b8640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd934012b40 tx=0x7fd934009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17ab2fe77126a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934011d00 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd938009de0 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd934003970 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd934029050 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 10 client.15483 fetch_fsmap learned FSMap version 21 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5640b1164960 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938009de0 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd93400f040 con 0x5640b1431240 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 10 client.15483 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:26:22.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 10 client.15483 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 20 client.15483 populate_metadata read hostname 'smithi001' 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1440e50 0x5640b1443280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 4 client.15483 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.552+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b1398b90 con 0x5640b1440e50 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.553+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1440e50 0x5640b1443280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.553+0000 7fd9257fa640 10 client.15483 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.553+0000 7fd9419b7640 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1440e50 0x5640b1443280 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e690f238d1f33d9 server_cookie=6542b0206568f95c in_seq=0 out_seq=0 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd9257fa640 1 -- 172.21.15.1:0/2288366523 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5640b1398b90 con 0x5640b1440e50 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd9257fa640 10 client.15483 handle_command_reply: tid=0 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 client.15483 shutdown 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 msgr2=0x5640b142ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd934012b40 tx=0x7fd934009670 comp rx=0 tx=0).stop 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 shutdown_connections 2024-09-19T05:26:22.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1431240 0x5640b142ebf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1440e50 0x5640b1443280 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b142e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 --2- 172.21.15.1:0/2288366523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b142e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd9257fa640 0 client.15483 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 >> 172.21.15.1:0/2288366523 conn(0x5640b14225f0 msgr2=0x5640b1428320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 shutdown_connections 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 1 -- 172.21.15.1:0/2288366523 wait complete. 2024-09-19T05:26:22.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.554+0000 7fd945ff4740 20 client.15483 trim_cache size 0 max 16384 2024-09-19T05:26:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 Processor -- start 2024-09-19T05:26:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 -- start start 2024-09-19T05:26:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1429480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b1421640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1af120 con 0x5640b14225f0 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1b19a0 con 0x5640b1426060 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd945ff4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1af790 con 0x5640b1426980 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41494/0 (socket says 172.21.15.1:41494) 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 -- 172.21.15.1:0/1861654310 learned_addr learned my addr 172.21.15.1:0/1861654310 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9411b6640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1429480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9421b8640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b1421640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 -- 172.21.15.1:0/1861654310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 msgr2=0x5640b1421640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b1421640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 -- 172.21.15.1:0/1861654310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 msgr2=0x5640b1429480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1429480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 -- 172.21.15.1:0/1861654310 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b14300b0 con 0x5640b14225f0 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9421b8640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b1421640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.572+0000 7fd9419b7640 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5640b1423450 tx=0x7fd93809e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedae3308d8a3e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd9277fe640 1 -- 172.21.15.1:0/1861654310 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938020040 con 0x5640b14225f0 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd9277fe640 1 -- 172.21.15.1:0/1861654310 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938009de0 con 0x5640b14225f0 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd9277fe640 1 -- 172.21.15.1:0/1861654310 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380ccfd0 con 0x5640b14225f0 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 -- 172.21.15.1:0/1861654310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 msgr2=0x5640b1428ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x5640b1423450 tx=0x7fd93809e040 comp rx=0 tx=0).stop 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 -- 172.21.15.1:0/1861654310 shutdown_connections 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b1426980 0x5640b1421640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1429480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 --2- 172.21.15.1:0/1861654310 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b14225f0 0x5640b1428ac0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 -- 172.21.15.1:0/1861654310 >> 172.21.15.1:0/1861654310 conn(0x5640b1429b60 msgr2=0x5640b1420f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 -- 172.21.15.1:0/1861654310 shutdown_connections 2024-09-19T05:26:22.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.573+0000 7fd945ff4740 1 -- 172.21.15.1:0/1861654310 wait complete. 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 -- start start 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 Processor -- start 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 0x5640b1434f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1435450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1afe60 con 0x5640b1426980 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1b12d0 con 0x5640b1426060 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1b0530 con 0x5640b14225f0 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd945ff4740 10 client.0 _ll_register_callbacks cb 0x7fd934012730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd9421b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd9421b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41500/0 (socket says 172.21.15.1:41500) 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.574+0000 7fd9421b8640 1 -- 172.21.15.1:0/636550133 learned_addr learned my addr 172.21.15.1:0/636550133 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:26:22.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9411b6640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1435450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9419b7640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 0x5640b1434f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 -- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 msgr2=0x5640b1434f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 0x5640b1434f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 -- 172.21.15.1:0/636550133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 msgr2=0x5640b1435450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1435450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 -- 172.21.15.1:0/636550133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b14aab20 con 0x5640b1426980 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9419b7640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 0x5640b1434f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9421b8640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd934005f40 tx=0x7fd934009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b30a76fc1da845 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9257fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934031020 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd934011e40 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd938009de0 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd93403c050 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd945ff4740 10 client.15489 fetch_fsmap learned FSMap version 21 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.575+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5640b14abd80 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd938009de0 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd934005040 con 0x5640b1426980 2024-09-19T05:26:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 10 client.15489 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 10 client.15489 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 20 client.15489 populate_metadata read hostname 'smithi001' 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1431240 0x5640b14ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 4 client.15489 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fb000a21", "release": true, "await": true}] 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fb000a21", "release": true, "await": true}) -- 0x5640b13930a0 con 0x5640b1431240 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.576+0000 7fd9419b7640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1431240 0x5640b14ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.577+0000 7fd9419b7640 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1431240 0x5640b14ae500 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d870f6fc5fb78b server_cookie=890b4d6965e3b51d in_seq=0 out_seq=0 2024-09-19T05:26:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.577+0000 7fd9257fa640 10 client.15489 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:26:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.585+0000 7fd9257fa640 1 -- 172.21.15.1:0/636550133 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5640b13930a0 con 0x5640b1431240 2024-09-19T05:26:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.585+0000 7fd9257fa640 10 client.15489 handle_command_reply: tid=0 2024-09-19T05:26:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.585+0000 7fd945ff4740 1 client.15489 shutdown 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 msgr2=0x5640b1435990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd934005f40 tx=0x7fd934009d30 comp rx=0 tx=0).stop 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 shutdown_connections 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5640b1426980 0x5640b1435990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640b1426060 0x5640b1435450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5640b1431240 0x5640b14ae500 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 --2- 172.21.15.1:0/636550133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5640b14225f0 0x5640b1434f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd9257fa640 0 client.15489 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 >> 172.21.15.1:0/636550133 conn(0x5640b1429b60 msgr2=0x5640b142e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 shutdown_connections 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 1 -- 172.21.15.1:0/636550133 wait complete. 2024-09-19T05:26:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd945ff4740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 24, 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "fb000a21": { 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 24, 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:26:22.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:26:22.590 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:26:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 msgr2=0x7fd9280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 0x7fd9280a5780 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009230 tx=0x7fd92c0058d0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 msgr2=0x7fd93c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d950 tx=0x7fd93800de10 comp rx=0 tx=0).stop 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 shutdown_connections 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd9280a32c0 0x7fd9280a5780 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd93c10e480 0x7fd93c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd93c101280 0x7fd93c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 --2- 172.21.15.1:0/2921230219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd93c1008d0 0x7fd93c19a6b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.586+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 >> 172.21.15.1:0/2921230219 conn(0x7fd93c0fc7a0 msgr2=0x7fd93c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.587+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 shutdown_connections 2024-09-19T05:26:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:26:22.587+0000 7fd943c1b640 1 -- 172.21.15.1:0/2921230219 wait complete. 2024-09-19T05:26:23.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 397781 6.84 MB/sec execute 98 sec latency 29669.058 ms 2024-09-19T05:26:23.431 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fb000a21', total seconds elapsed: 33.3 2024-09-19T05:26:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:23 smithi060 ceph-mon[35058]: pgmap v507: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 825 KiB/s wr, 29 op/s 2024-09-19T05:26:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:23 smithi082 ceph-mon[35195]: pgmap v507: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 825 KiB/s wr, 29 op/s 2024-09-19T05:26:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:23 smithi001 ceph-mon[30968]: pgmap v507: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 825 KiB/s wr, 29 op/s 2024-09-19T05:26:24.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 401162 6.97 MB/sec execute 99 sec latency 24.803 ms 2024-09-19T05:26:25.378 INFO:tasks.workunit.client.0.smithi001.stdout: 1 404641 7.09 MB/sec execute 100 sec latency 14.361 ms 2024-09-19T05:26:26.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:25 smithi060 ceph-mon[35058]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 874 KiB/s wr, 35 op/s 2024-09-19T05:26:26.263 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:25 smithi082 ceph-mon[35195]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 874 KiB/s wr, 35 op/s 2024-09-19T05:26:26.351 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:25 smithi001 ceph-mon[30968]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 874 KiB/s wr, 35 op/s 2024-09-19T05:26:26.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 408067 7.20 MB/sec execute 101 sec latency 12.498 ms 2024-09-19T05:26:27.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 411481 7.31 MB/sec execute 102 sec latency 28.034 ms 2024-09-19T05:26:28.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:27 smithi060 ceph-mon[35058]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 916 KiB/s wr, 37 op/s 2024-09-19T05:26:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:27 smithi082 ceph-mon[35195]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 916 KiB/s wr, 37 op/s 2024-09-19T05:26:28.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:27 smithi001 ceph-mon[30968]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 916 KiB/s wr, 37 op/s 2024-09-19T05:26:28.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 414407 7.38 MB/sec execute 103 sec latency 53.232 ms 2024-09-19T05:26:29.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 417539 7.44 MB/sec execute 104 sec latency 17.254 ms 2024-09-19T05:26:30.142 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:29 smithi001 ceph-mon[30968]: pgmap v510: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 106 op/s 2024-09-19T05:26:30.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:29 smithi060 ceph-mon[35058]: pgmap v510: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 106 op/s 2024-09-19T05:26:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:29 smithi082 ceph-mon[35195]: pgmap v510: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.1 MiB/s wr, 106 op/s 2024-09-19T05:26:30.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 420724 7.53 MB/sec execute 105 sec latency 20.492 ms 2024-09-19T05:26:31.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 423741 7.64 MB/sec execute 106 sec latency 13.477 ms 2024-09-19T05:26:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:31 smithi060 ceph-mon[35058]: pgmap v511: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 647 KiB/s wr, 99 op/s 2024-09-19T05:26:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:31 smithi082 ceph-mon[35195]: pgmap v511: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 647 KiB/s wr, 99 op/s 2024-09-19T05:26:32.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:31 smithi001 ceph-mon[30968]: pgmap v511: 129 pgs: 129 active+clean; 155 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 647 KiB/s wr, 99 op/s 2024-09-19T05:26:32.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 426948 7.72 MB/sec execute 107 sec latency 17.587 ms 2024-09-19T05:26:33.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 430131 7.81 MB/sec execute 108 sec latency 22.295 ms 2024-09-19T05:26:34.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:33 smithi060 ceph-mon[35058]: pgmap v512: 129 pgs: 129 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1011 KiB/s wr, 135 op/s 2024-09-19T05:26:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:33 smithi082 ceph-mon[35195]: pgmap v512: 129 pgs: 129 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1011 KiB/s wr, 135 op/s 2024-09-19T05:26:34.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:33 smithi001 ceph-mon[30968]: pgmap v512: 129 pgs: 129 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1011 KiB/s wr, 135 op/s 2024-09-19T05:26:34.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 433483 7.91 MB/sec execute 109 sec latency 24.364 ms 2024-09-19T05:26:35.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 436820 8.01 MB/sec execute 110 sec latency 23.622 ms 2024-09-19T05:26:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:35 smithi060 ceph-mon[35058]: pgmap v513: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-19T05:26:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:35 smithi082 ceph-mon[35195]: pgmap v513: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-19T05:26:36.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:35 smithi001 ceph-mon[30968]: pgmap v513: 129 pgs: 129 active+clean; 163 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-19T05:26:36.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 440219 8.11 MB/sec execute 111 sec latency 17.591 ms 2024-09-19T05:26:37.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 443540 8.20 MB/sec execute 112 sec latency 22.893 ms 2024-09-19T05:26:38.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:37 smithi060 ceph-mon[35058]: pgmap v514: 129 pgs: 129 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-19T05:26:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:37 smithi082 ceph-mon[35195]: pgmap v514: 129 pgs: 129 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-19T05:26:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:37 smithi001 ceph-mon[30968]: pgmap v514: 129 pgs: 129 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.8 MiB/s wr, 247 op/s 2024-09-19T05:26:38.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 446930 8.29 MB/sec execute 113 sec latency 23.344 ms 2024-09-19T05:26:39.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 450134 8.35 MB/sec execute 114 sec latency 13.372 ms 2024-09-19T05:26:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:39 smithi060 ceph-mon[35058]: pgmap v515: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-19T05:26:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:39 smithi082 ceph-mon[35195]: pgmap v515: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-19T05:26:40.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:39 smithi001 ceph-mon[30968]: pgmap v515: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-19T05:26:40.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 453414 8.44 MB/sec execute 115 sec latency 21.421 ms 2024-09-19T05:26:41.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 456440 8.48 MB/sec execute 116 sec latency 24.506 ms 2024-09-19T05:26:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:41 smithi060 ceph-mon[35058]: pgmap v516: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-09-19T05:26:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:41 smithi082 ceph-mon[35195]: pgmap v516: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-09-19T05:26:42.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:41 smithi001 ceph-mon[30968]: pgmap v516: 129 pgs: 129 active+clean; 168 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.5 MiB/s wr, 188 op/s 2024-09-19T05:26:42.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 458805 8.65 MB/sec execute 117 sec latency 38.268 ms 2024-09-19T05:26:43.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 462296 8.78 MB/sec execute 118 sec latency 13.663 ms 2024-09-19T05:26:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:43 smithi060 ceph-mon[35058]: pgmap v517: 129 pgs: 129 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 287 op/s 2024-09-19T05:26:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:43 smithi082 ceph-mon[35195]: pgmap v517: 129 pgs: 129 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 287 op/s 2024-09-19T05:26:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:43 smithi001 ceph-mon[30968]: pgmap v517: 129 pgs: 129 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.2 MiB/s wr, 287 op/s 2024-09-19T05:26:44.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 465732 8.86 MB/sec execute 119 sec latency 11.737 ms 2024-09-19T05:26:45.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 468943 8.94 MB/sec execute 120 sec latency 21.994 ms 2024-09-19T05:26:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:45 smithi060 ceph-mon[35058]: pgmap v518: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2024-09-19T05:26:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:45 smithi082 ceph-mon[35195]: pgmap v518: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2024-09-19T05:26:46.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:45 smithi001 ceph-mon[30968]: pgmap v518: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.9 MiB/s wr, 257 op/s 2024-09-19T05:26:46.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 472371 9.00 MB/sec execute 121 sec latency 19.384 ms 2024-09-19T05:26:47.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 475745 9.07 MB/sec execute 122 sec latency 17.459 ms 2024-09-19T05:26:48.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:47 smithi060 ceph-mon[35058]: pgmap v519: 129 pgs: 129 active+clean; 174 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:26:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:47 smithi082 ceph-mon[35195]: pgmap v519: 129 pgs: 129 active+clean; 174 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:26:48.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:47 smithi001 ceph-mon[30968]: pgmap v519: 129 pgs: 129 active+clean; 174 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.9 MiB/s wr, 248 op/s 2024-09-19T05:26:48.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 479032 9.14 MB/sec execute 123 sec latency 47.071 ms 2024-09-19T05:26:49.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 482154 9.19 MB/sec execute 124 sec latency 20.707 ms 2024-09-19T05:26:50.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:49 smithi060 ceph-mon[35058]: pgmap v520: 129 pgs: 129 active+clean; 170 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:49 smithi082 ceph-mon[35195]: pgmap v520: 129 pgs: 129 active+clean; 170 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:49 smithi001 ceph-mon[30968]: pgmap v520: 129 pgs: 129 active+clean; 170 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:50.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 485648 9.26 MB/sec execute 125 sec latency 19.322 ms 2024-09-19T05:26:51.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 489011 9.33 MB/sec execute 126 sec latency 12.016 ms 2024-09-19T05:26:52.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:51 smithi060 ceph-mon[35058]: pgmap v521: 129 pgs: 129 active+clean; 172 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:26:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:51 smithi082 ceph-mon[35195]: pgmap v521: 129 pgs: 129 active+clean; 172 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:26:52.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:51 smithi001 ceph-mon[30968]: pgmap v521: 129 pgs: 129 active+clean; 172 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:26:52.379 INFO:tasks.workunit.client.0.smithi001.stdout: 1 492198 9.41 MB/sec execute 127 sec latency 14.294 ms 2024-09-19T05:26:53.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 495511 9.48 MB/sec execute 128 sec latency 19.598 ms 2024-09-19T05:26:54.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:53 smithi060 ceph-mon[35058]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2024-09-19T05:26:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:53 smithi082 ceph-mon[35195]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2024-09-19T05:26:54.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:53 smithi001 ceph-mon[30968]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 278 op/s 2024-09-19T05:26:54.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 498368 9.52 MB/sec execute 129 sec latency 47.097 ms 2024-09-19T05:26:55.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 501921 9.59 MB/sec execute 130 sec latency 12.542 ms 2024-09-19T05:26:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:55 smithi060 ceph-mon[35058]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:55 smithi082 ceph-mon[35195]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:56.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:55 smithi001 ceph-mon[30968]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-09-19T05:26:56.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 505599 9.68 MB/sec execute 131 sec latency 12.176 ms 2024-09-19T05:26:57.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:56 smithi060 ceph-mon[35058]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-19T05:26:57.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:56 smithi082 ceph-mon[35195]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-19T05:26:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:56 smithi001 ceph-mon[30968]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 1.9 MiB/s wr, 208 op/s 2024-09-19T05:26:57.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 508813 9.74 MB/sec execute 132 sec latency 28.833 ms 2024-09-19T05:26:58.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 512371 9.81 MB/sec execute 133 sec latency 14.604 ms 2024-09-19T05:26:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:26:59 smithi001 ceph-mon[30968]: pgmap v525: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.1 MiB/s wr, 209 op/s 2024-09-19T05:26:59.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 515108 9.86 MB/sec execute 134 sec latency 123.025 ms 2024-09-19T05:26:59.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:26:59 smithi060 ceph-mon[35058]: pgmap v525: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.1 MiB/s wr, 209 op/s 2024-09-19T05:26:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:26:59 smithi082 ceph-mon[35195]: pgmap v525: 129 pgs: 129 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.1 MiB/s wr, 209 op/s 2024-09-19T05:27:00.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 518093 9.89 MB/sec execute 135 sec latency 14.521 ms 2024-09-19T05:27:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:01 smithi001 ceph-mon[30968]: pgmap v526: 129 pgs: 129 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:27:01.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 521435 9.95 MB/sec execute 136 sec latency 11.676 ms 2024-09-19T05:27:01.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:01 smithi060 ceph-mon[35058]: pgmap v526: 129 pgs: 129 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:27:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:01 smithi082 ceph-mon[35195]: pgmap v526: 129 pgs: 129 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:27:02.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 524639 9.99 MB/sec execute 137 sec latency 24.281 ms 2024-09-19T05:27:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:03 smithi001 ceph-mon[30968]: pgmap v527: 129 pgs: 129 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-09-19T05:27:03.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 528153 10.05 MB/sec execute 138 sec latency 12.083 ms 2024-09-19T05:27:03.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:03 smithi060 ceph-mon[35058]: pgmap v527: 129 pgs: 129 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-09-19T05:27:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:03 smithi082 ceph-mon[35195]: pgmap v527: 129 pgs: 129 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-09-19T05:27:04.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 530299 10.07 MB/sec execute 139 sec latency 107.164 ms 2024-09-19T05:27:05.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:05 smithi001 ceph-mon[30968]: pgmap v528: 129 pgs: 129 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.2 MiB/s wr, 264 op/s 2024-09-19T05:27:05.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 533484 10.13 MB/sec execute 140 sec latency 23.048 ms 2024-09-19T05:27:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:05 smithi060 ceph-mon[35058]: pgmap v528: 129 pgs: 129 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.2 MiB/s wr, 264 op/s 2024-09-19T05:27:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:05 smithi082 ceph-mon[35195]: pgmap v528: 129 pgs: 129 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 3.2 MiB/s wr, 264 op/s 2024-09-19T05:27:06.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 536968 10.20 MB/sec execute 141 sec latency 12.833 ms 2024-09-19T05:27:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:07 smithi001 ceph-mon[30968]: pgmap v529: 129 pgs: 129 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-09-19T05:27:07.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 540526 10.26 MB/sec execute 142 sec latency 12.029 ms 2024-09-19T05:27:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:07 smithi060 ceph-mon[35058]: pgmap v529: 129 pgs: 129 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-09-19T05:27:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:07 smithi082 ceph-mon[35195]: pgmap v529: 129 pgs: 129 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-09-19T05:27:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:08 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:08.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 543769 10.32 MB/sec execute 143 sec latency 52.904 ms 2024-09-19T05:27:08.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:08 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:08 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:09.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:09 smithi001 ceph-mon[30968]: pgmap v530: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 364 op/s 2024-09-19T05:27:09.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:09.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:09.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:27:09.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 546531 10.34 MB/sec execute 144 sec latency 109.938 ms 2024-09-19T05:27:09.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:09 smithi060 ceph-mon[35058]: pgmap v530: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 364 op/s 2024-09-19T05:27:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:27:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:09 smithi082 ceph-mon[35195]: pgmap v530: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 364 op/s 2024-09-19T05:27:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:27:10.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 549641 10.37 MB/sec execute 145 sec latency 18.436 ms 2024-09-19T05:27:11.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:11 smithi001 ceph-mon[30968]: pgmap v531: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 306 op/s 2024-09-19T05:27:11.380 INFO:tasks.workunit.client.0.smithi001.stdout: 1 553069 10.42 MB/sec execute 146 sec latency 12.736 ms 2024-09-19T05:27:11.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:11 smithi060 ceph-mon[35058]: pgmap v531: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 306 op/s 2024-09-19T05:27:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:11 smithi082 ceph-mon[35195]: pgmap v531: 129 pgs: 129 active+clean; 189 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 306 op/s 2024-09-19T05:27:12.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 556507 10.48 MB/sec execute 147 sec latency 36.413 ms 2024-09-19T05:27:13.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:13 smithi001 ceph-mon[30968]: pgmap v532: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-19T05:27:13.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 559228 10.52 MB/sec execute 148 sec latency 75.341 ms 2024-09-19T05:27:13.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:13 smithi060 ceph-mon[35058]: pgmap v532: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-19T05:27:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:13 smithi082 ceph-mon[35195]: pgmap v532: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-19T05:27:14.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 561920 10.55 MB/sec execute 149 sec latency 75.441 ms 2024-09-19T05:27:15.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:15 smithi001 ceph-mon[30968]: pgmap v533: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-09-19T05:27:15.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 565138 10.60 MB/sec execute 150 sec latency 29.545 ms 2024-09-19T05:27:15.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:15 smithi060 ceph-mon[35058]: pgmap v533: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-09-19T05:27:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:15 smithi082 ceph-mon[35195]: pgmap v533: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-09-19T05:27:16.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 568414 10.65 MB/sec execute 151 sec latency 69.685 ms 2024-09-19T05:27:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:17 smithi001 ceph-mon[30968]: pgmap v534: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-09-19T05:27:17.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 571699 10.69 MB/sec execute 152 sec latency 20.614 ms 2024-09-19T05:27:17.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:17 smithi060 ceph-mon[35058]: pgmap v534: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-09-19T05:27:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:17 smithi082 ceph-mon[35195]: pgmap v534: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-09-19T05:27:18.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 574859 10.73 MB/sec execute 153 sec latency 19.118 ms 2024-09-19T05:27:19.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:19 smithi001 ceph-mon[30968]: pgmap v535: 129 pgs: 129 active+clean; 216 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.3 MiB/s wr, 335 op/s 2024-09-19T05:27:19.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 577324 10.74 MB/sec execute 154 sec latency 126.688 ms 2024-09-19T05:27:19.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:19 smithi060 ceph-mon[35058]: pgmap v535: 129 pgs: 129 active+clean; 216 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.3 MiB/s wr, 335 op/s 2024-09-19T05:27:19.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:19 smithi082 ceph-mon[35195]: pgmap v535: 129 pgs: 129 active+clean; 216 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.3 MiB/s wr, 335 op/s 2024-09-19T05:27:20.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 579934 10.76 MB/sec execute 155 sec latency 30.713 ms 2024-09-19T05:27:21.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:21 smithi001 ceph-mon[30968]: pgmap v536: 129 pgs: 129 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2024-09-19T05:27:21.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 583253 10.81 MB/sec execute 156 sec latency 26.906 ms 2024-09-19T05:27:21.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:21 smithi060 ceph-mon[35058]: pgmap v536: 129 pgs: 129 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2024-09-19T05:27:21.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:21 smithi082 ceph-mon[35195]: pgmap v536: 129 pgs: 129 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 5.3 MiB/s wr, 254 op/s 2024-09-19T05:27:22.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 586679 10.86 MB/sec execute 157 sec latency 27.083 ms 2024-09-19T05:27:23.303 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:23 smithi060 ceph-mon[35058]: pgmap v537: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 373 op/s 2024-09-19T05:27:23.309 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:23 smithi082 ceph-mon[35195]: pgmap v537: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 373 op/s 2024-09-19T05:27:23.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:23 smithi001 ceph-mon[30968]: pgmap v537: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 373 op/s 2024-09-19T05:27:23.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 590000 10.91 MB/sec execute 158 sec latency 30.794 ms 2024-09-19T05:27:24.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 592793 10.93 MB/sec execute 159 sec latency 84.088 ms 2024-09-19T05:27:25.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:25 smithi001 ceph-mon[30968]: pgmap v538: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.5 MiB/s wr, 289 op/s 2024-09-19T05:27:25.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 595560 10.94 MB/sec execute 160 sec latency 22.397 ms 2024-09-19T05:27:25.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:25 smithi060 ceph-mon[35058]: pgmap v538: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.5 MiB/s wr, 289 op/s 2024-09-19T05:27:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:25 smithi082 ceph-mon[35195]: pgmap v538: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.5 MiB/s wr, 289 op/s 2024-09-19T05:27:26.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 598403 10.98 MB/sec execute 161 sec latency 18.552 ms 2024-09-19T05:27:27.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:27 smithi001 ceph-mon[30968]: pgmap v539: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 330 op/s 2024-09-19T05:27:27.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 601904 11.03 MB/sec execute 162 sec latency 11.220 ms 2024-09-19T05:27:27.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:27 smithi060 ceph-mon[35058]: pgmap v539: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 330 op/s 2024-09-19T05:27:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:27 smithi082 ceph-mon[35195]: pgmap v539: 129 pgs: 129 active+clean; 223 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 330 op/s 2024-09-19T05:27:28.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 604991 11.06 MB/sec execute 163 sec latency 17.708 ms 2024-09-19T05:27:29.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:29 smithi001 ceph-mon[30968]: pgmap v540: 129 pgs: 129 active+clean; 228 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-19T05:27:29.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 608023 11.10 MB/sec execute 164 sec latency 103.110 ms 2024-09-19T05:27:29.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:29 smithi060 ceph-mon[35058]: pgmap v540: 129 pgs: 129 active+clean; 228 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-19T05:27:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:29 smithi082 ceph-mon[35195]: pgmap v540: 129 pgs: 129 active+clean; 228 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 334 op/s 2024-09-19T05:27:30.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 611194 11.15 MB/sec execute 165 sec latency 33.550 ms 2024-09-19T05:27:31.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:31 smithi001 ceph-mon[30968]: pgmap v541: 129 pgs: 129 active+clean; 231 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 345 op/s 2024-09-19T05:27:31.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 614400 11.18 MB/sec execute 166 sec latency 16.293 ms 2024-09-19T05:27:31.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:31 smithi060 ceph-mon[35058]: pgmap v541: 129 pgs: 129 active+clean; 231 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 345 op/s 2024-09-19T05:27:31.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:31 smithi082 ceph-mon[35195]: pgmap v541: 129 pgs: 129 active+clean; 231 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.4 MiB/s wr, 345 op/s 2024-09-19T05:27:32.381 INFO:tasks.workunit.client.0.smithi001.stdout: 1 617368 11.20 MB/sec execute 167 sec latency 21.805 ms 2024-09-19T05:27:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:33 smithi001 ceph-mon[30968]: pgmap v542: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 389 op/s 2024-09-19T05:27:33.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 620413 11.22 MB/sec execute 168 sec latency 58.209 ms 2024-09-19T05:27:33.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:33 smithi060 ceph-mon[35058]: pgmap v542: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 389 op/s 2024-09-19T05:27:33.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:33 smithi082 ceph-mon[35195]: pgmap v542: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 389 op/s 2024-09-19T05:27:34.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 623388 11.25 MB/sec execute 169 sec latency 27.709 ms 2024-09-19T05:27:35.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:35 smithi001 ceph-mon[30968]: pgmap v543: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 274 op/s 2024-09-19T05:27:35.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 625794 11.27 MB/sec execute 170 sec latency 48.194 ms 2024-09-19T05:27:35.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:35 smithi060 ceph-mon[35058]: pgmap v543: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 274 op/s 2024-09-19T05:27:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:35 smithi082 ceph-mon[35195]: pgmap v543: 129 pgs: 129 active+clean; 232 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 274 op/s 2024-09-19T05:27:36.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 629228 11.32 MB/sec execute 171 sec latency 29.237 ms 2024-09-19T05:27:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:37 smithi001 ceph-mon[30968]: pgmap v544: 129 pgs: 129 active+clean; 236 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 344 op/s 2024-09-19T05:27:37.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 632574 11.36 MB/sec execute 172 sec latency 11.807 ms 2024-09-19T05:27:37.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:37 smithi060 ceph-mon[35058]: pgmap v544: 129 pgs: 129 active+clean; 236 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 344 op/s 2024-09-19T05:27:37.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:37 smithi082 ceph-mon[35195]: pgmap v544: 129 pgs: 129 active+clean; 236 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 344 op/s 2024-09-19T05:27:38.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 635972 11.40 MB/sec execute 173 sec latency 29.473 ms 2024-09-19T05:27:39.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:39 smithi001 ceph-mon[30968]: pgmap v545: 129 pgs: 129 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:27:39.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 639351 11.44 MB/sec execute 174 sec latency 12.728 ms 2024-09-19T05:27:39.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:39 smithi060 ceph-mon[35058]: pgmap v545: 129 pgs: 129 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:27:39.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:39 smithi082 ceph-mon[35195]: pgmap v545: 129 pgs: 129 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:27:40.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 641592 11.42 MB/sec execute 175 sec latency 43.882 ms 2024-09-19T05:27:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:41 smithi001 ceph-mon[30968]: pgmap v546: 129 pgs: 129 active+clean; 240 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:27:41.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 644468 11.46 MB/sec execute 176 sec latency 15.677 ms 2024-09-19T05:27:41.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:41 smithi060 ceph-mon[35058]: pgmap v546: 129 pgs: 129 active+clean; 240 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:27:41.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:41 smithi082 ceph-mon[35195]: pgmap v546: 129 pgs: 129 active+clean; 240 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:27:42.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 647633 11.48 MB/sec execute 177 sec latency 22.049 ms 2024-09-19T05:27:43.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:43 smithi001 ceph-mon[30968]: pgmap v547: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 314 op/s 2024-09-19T05:27:43.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 650696 11.52 MB/sec execute 178 sec latency 28.331 ms 2024-09-19T05:27:43.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:43 smithi060 ceph-mon[35058]: pgmap v547: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 314 op/s 2024-09-19T05:27:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:43 smithi082 ceph-mon[35195]: pgmap v547: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 314 op/s 2024-09-19T05:27:44.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 653945 11.56 MB/sec execute 179 sec latency 22.027 ms 2024-09-19T05:27:45.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:45 smithi001 ceph-mon[30968]: pgmap v548: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 275 op/s 2024-09-19T05:27:45.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 656787 11.57 MB/sec execute 180 sec latency 107.766 ms 2024-09-19T05:27:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:45 smithi060 ceph-mon[35058]: pgmap v548: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 275 op/s 2024-09-19T05:27:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:45 smithi082 ceph-mon[35195]: pgmap v548: 129 pgs: 129 active+clean; 241 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 275 op/s 2024-09-19T05:27:46.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 659911 11.60 MB/sec execute 181 sec latency 28.503 ms 2024-09-19T05:27:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:47 smithi001 ceph-mon[30968]: pgmap v549: 129 pgs: 129 active+clean; 246 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 353 op/s 2024-09-19T05:27:47.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 662986 11.62 MB/sec execute 182 sec latency 11.236 ms 2024-09-19T05:27:47.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:47 smithi060 ceph-mon[35058]: pgmap v549: 129 pgs: 129 active+clean; 246 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 353 op/s 2024-09-19T05:27:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:47 smithi082 ceph-mon[35195]: pgmap v549: 129 pgs: 129 active+clean; 246 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.7 MiB/s wr, 353 op/s 2024-09-19T05:27:48.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 665963 11.65 MB/sec execute 183 sec latency 15.964 ms 2024-09-19T05:27:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:49 smithi001 ceph-mon[30968]: pgmap v550: 129 pgs: 129 active+clean; 247 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 306 op/s 2024-09-19T05:27:49.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 668810 11.67 MB/sec execute 184 sec latency 17.229 ms 2024-09-19T05:27:49.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:49 smithi060 ceph-mon[35058]: pgmap v550: 129 pgs: 129 active+clean; 247 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 306 op/s 2024-09-19T05:27:49.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:49 smithi082 ceph-mon[35195]: pgmap v550: 129 pgs: 129 active+clean; 247 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.6 MiB/s wr, 306 op/s 2024-09-19T05:27:50.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 671483 11.70 MB/sec execute 185 sec latency 57.721 ms 2024-09-19T05:27:51.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:51 smithi001 ceph-mon[30968]: pgmap v551: 129 pgs: 129 active+clean; 248 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-19T05:27:51.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 674923 11.73 MB/sec execute 186 sec latency 19.319 ms 2024-09-19T05:27:51.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:51 smithi060 ceph-mon[35058]: pgmap v551: 129 pgs: 129 active+clean; 248 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-19T05:27:51.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:51 smithi082 ceph-mon[35195]: pgmap v551: 129 pgs: 129 active+clean; 248 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-19T05:27:52.382 INFO:tasks.workunit.client.0.smithi001.stdout: 1 678274 11.77 MB/sec execute 187 sec latency 19.885 ms 2024-09-19T05:27:53.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:53 smithi001 ceph-mon[30968]: pgmap v552: 129 pgs: 129 active+clean; 252 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-09-19T05:27:53.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 681237 11.78 MB/sec execute 188 sec latency 64.484 ms 2024-09-19T05:27:53.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:53 smithi060 ceph-mon[35058]: pgmap v552: 129 pgs: 129 active+clean; 252 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-09-19T05:27:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:53 smithi082 ceph-mon[35195]: pgmap v552: 129 pgs: 129 active+clean; 252 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-09-19T05:27:54.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 684299 11.79 MB/sec execute 189 sec latency 16.106 ms 2024-09-19T05:27:55.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:55 smithi001 ceph-mon[30968]: pgmap v553: 129 pgs: 129 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:27:55.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 686472 11.80 MB/sec execute 190 sec latency 115.564 ms 2024-09-19T05:27:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:55 smithi060 ceph-mon[35058]: pgmap v553: 129 pgs: 129 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:27:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:55 smithi082 ceph-mon[35195]: pgmap v553: 129 pgs: 129 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 303 op/s 2024-09-19T05:27:56.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 689625 11.83 MB/sec execute 191 sec latency 37.131 ms 2024-09-19T05:27:57.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:57 smithi001 ceph-mon[30968]: pgmap v554: 129 pgs: 129 active+clean; 257 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 319 op/s 2024-09-19T05:27:57.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 693046 11.87 MB/sec execute 192 sec latency 20.177 ms 2024-09-19T05:27:57.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:57 smithi060 ceph-mon[35058]: pgmap v554: 129 pgs: 129 active+clean; 257 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 319 op/s 2024-09-19T05:27:57.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:57 smithi082 ceph-mon[35195]: pgmap v554: 129 pgs: 129 active+clean; 257 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 319 op/s 2024-09-19T05:27:58.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 696429 11.91 MB/sec execute 193 sec latency 21.501 ms 2024-09-19T05:27:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:27:59 smithi001 ceph-mon[30968]: pgmap v555: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 303 op/s 2024-09-19T05:27:59.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 699793 11.94 MB/sec execute 194 sec latency 13.758 ms 2024-09-19T05:27:59.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:27:59 smithi060 ceph-mon[35058]: pgmap v555: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 303 op/s 2024-09-19T05:27:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:27:59 smithi082 ceph-mon[35195]: pgmap v555: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 303 op/s 2024-09-19T05:28:00.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 702159 11.92 MB/sec execute 195 sec latency 157.584 ms 2024-09-19T05:28:01.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 704540 11.95 MB/sec execute 196 sec latency 38.468 ms 2024-09-19T05:28:01.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:01 smithi060 ceph-mon[35058]: pgmap v556: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 268 op/s 2024-09-19T05:28:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:01 smithi082 ceph-mon[35195]: pgmap v556: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 268 op/s 2024-09-19T05:28:01.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:01 smithi001 ceph-mon[30968]: pgmap v556: 129 pgs: 129 active+clean; 262 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 268 op/s 2024-09-19T05:28:02.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 707618 11.96 MB/sec execute 197 sec latency 24.346 ms 2024-09-19T05:28:03.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 710956 12.00 MB/sec execute 198 sec latency 21.185 ms 2024-09-19T05:28:03.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:03 smithi060 ceph-mon[35058]: pgmap v557: 129 pgs: 129 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 368 op/s 2024-09-19T05:28:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:03 smithi082 ceph-mon[35195]: pgmap v557: 129 pgs: 129 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 368 op/s 2024-09-19T05:28:03.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:03 smithi001 ceph-mon[30968]: pgmap v557: 129 pgs: 129 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.0 MiB/s wr, 368 op/s 2024-09-19T05:28:04.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 714207 12.03 MB/sec execute 199 sec latency 10.032 ms 2024-09-19T05:28:05.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 717140 12.04 MB/sec execute 200 sec latency 72.904 ms 2024-09-19T05:28:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:05 smithi060 ceph-mon[35058]: pgmap v558: 129 pgs: 129 active+clean; 267 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-09-19T05:28:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:05 smithi082 ceph-mon[35195]: pgmap v558: 129 pgs: 129 active+clean; 267 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-09-19T05:28:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:05 smithi001 ceph-mon[30968]: pgmap v558: 129 pgs: 129 active+clean; 267 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-09-19T05:28:06.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 719708 12.04 MB/sec execute 201 sec latency 32.446 ms 2024-09-19T05:28:07.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 722344 12.06 MB/sec execute 202 sec latency 11.684 ms 2024-09-19T05:28:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:07 smithi060 ceph-mon[35058]: pgmap v559: 129 pgs: 129 active+clean; 265 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-19T05:28:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:07 smithi082 ceph-mon[35195]: pgmap v559: 129 pgs: 129 active+clean; 265 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-19T05:28:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:07 smithi001 ceph-mon[30968]: pgmap v559: 129 pgs: 129 active+clean; 265 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-19T05:28:08.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 725307 12.08 MB/sec execute 203 sec latency 20.471 ms 2024-09-19T05:28:09.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 728531 12.11 MB/sec execute 204 sec latency 10.022 ms 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: pgmap v560: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:09.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:09.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:28:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: pgmap v560: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-09-19T05:28:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:09.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:28:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: pgmap v560: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 370 op/s 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:09.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:28:10.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 731321 12.12 MB/sec execute 205 sec latency 56.079 ms 2024-09-19T05:28:10.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:10 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:28:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:10 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:28:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:10 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:28:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:10 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:28:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:10 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:28:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:10 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:28:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:10 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:28:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:10 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:28:10.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:10 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:28:10.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:10 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:28:10.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:10 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:28:10.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:10 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:28:11.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 734049 12.12 MB/sec execute 206 sec latency 30.996 ms 2024-09-19T05:28:11.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:11 smithi060 ceph-mon[35058]: pgmap v561: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T05:28:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:11 smithi082 ceph-mon[35195]: pgmap v561: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T05:28:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:11 smithi001 ceph-mon[30968]: pgmap v561: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 303 op/s 2024-09-19T05:28:12.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 737415 12.15 MB/sec execute 207 sec latency 12.542 ms 2024-09-19T05:28:13.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 740350 12.18 MB/sec execute 208 sec latency 18.575 ms 2024-09-19T05:28:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:13 smithi060 ceph-mon[35058]: pgmap v562: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.6 MiB/s wr, 349 op/s 2024-09-19T05:28:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:13 smithi082 ceph-mon[35195]: pgmap v562: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.6 MiB/s wr, 349 op/s 2024-09-19T05:28:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:13 smithi001 ceph-mon[30968]: pgmap v562: 129 pgs: 129 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.6 MiB/s wr, 349 op/s 2024-09-19T05:28:14.118 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:28:14.119 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T05:28:14.119 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:28:14.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 743553 12.21 MB/sec execute 209 sec latency 14.799 ms 2024-09-19T05:28:14.415 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:15.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 -- 172.21.15.1:0/3309268066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102ef0 msgr2=0x7fc2fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 --2- 172.21.15.1:0/3309268066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc10da40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009ca0 tx=0x7fc2f402a950 comp rx=0 tx=0).stop 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 -- 172.21.15.1:0/3309268066 shutdown_connections 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 --2- 172.21.15.1:0/3309268066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc10da40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 --2- 172.21.15.1:0/3309268066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102570 0x7fc2fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 --2- 172.21.15.1:0/3309268066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 -- 172.21.15.1:0/3309268066 >> 172.21.15.1:0/3309268066 conn(0x7fc2fc0fc7d0 msgr2=0x7fc2fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 -- 172.21.15.1:0/3309268066 shutdown_connections 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.982+0000 7fc302f21640 1 -- 172.21.15.1:0/3309268066 wait complete. 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 Processor -- start 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 -- start start 2024-09-19T05:28:15.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc10fe80 con 0x7fc2fc102570 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc10fd00 con 0x7fc2fc100e20 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.983+0000 7fc302f21640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc110000 con 0x7fc2fc102ef0 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33720/0 (socket says 172.21.15.1:33720) 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 -- 172.21.15.1:0/391977311 learned_addr learned my addr 172.21.15.1:0/391977311 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc3014be640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc300cbd640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 -- 172.21.15.1:0/391977311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102ef0 msgr2=0x7fc2fc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:15.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 -- 172.21.15.1:0/391977311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 msgr2=0x7fc2fc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 -- 172.21.15.1:0/391977311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc19f620 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc300cbd640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f3fff640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009860 tx=0x7fc2ec009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec004020 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2ec00ed90 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc19f910 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.984+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec003b70 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.985+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1a71f0 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.986+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc101200 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.987+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc2ec01b020 con 0x7fc2fc102570 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.988+0000 7fc2f1ffb640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 0x7fc2e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:15.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.988+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc2ec0cf580 con 0x7fc2fc102570 2024-09-19T05:28:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.988+0000 7fc300cbd640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 0x7fc2e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.989+0000 7fc300cbd640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 0x7fc2e40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009c20 tx=0x7fc2f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:15.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:14.992+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2ec09bef0 con 0x7fc2fc102570 2024-09-19T05:28:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.259+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2fc1a73c0 con 0x7fc2fc102570 2024-09-19T05:28:15.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.260+0000 7fc2f1ffb640 1 -- 172.21.15.1:0/391977311 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fc2ec09b7f0 con 0x7fc2fc102570 2024-09-19T05:28:15.262 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:28:15.262 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:28:15.262 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 msgr2=0x7fc2e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 0x7fc2e40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009c20 tx=0x7fc2f8005f90 comp rx=0 tx=0).stop 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 msgr2=0x7fc2fc19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009860 tx=0x7fc2ec009d20 comp rx=0 tx=0).stop 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 shutdown_connections 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc2e40a32c0 0x7fc2e40a5780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2fc102ef0 0x7fc2fc19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc2fc102570 0x7fc2fc19abb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 --2- 172.21.15.1:0/391977311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2fc100e20 0x7fc2fc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:15.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 >> 172.21.15.1:0/391977311 conn(0x7fc2fc0fc7d0 msgr2=0x7fc2fc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:15.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 shutdown_connections 2024-09-19T05:28:15.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:15.263+0000 7fc302f21640 1 -- 172.21.15.1:0/391977311 wait complete. 2024-09-19T05:28:15.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 746353 12.22 MB/sec execute 210 sec latency 78.494 ms 2024-09-19T05:28:15.457 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:15 smithi001 ceph-mon[30968]: pgmap v563: 129 pgs: 129 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-19T05:28:15.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:15 smithi060 ceph-mon[35058]: pgmap v563: 129 pgs: 129 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-19T05:28:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:15 smithi082 ceph-mon[35195]: pgmap v563: 129 pgs: 129 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-19T05:28:16.089 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T05:28:16.089 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T05:28:16.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:16 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/391977311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:16.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 749359 12.24 MB/sec execute 211 sec latency 119.232 ms 2024-09-19T05:28:16.424 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:16.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:16 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/391977311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:16.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:16 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/391977311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 -- 172.21.15.1:0/4197726293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101430 msgr2=0x7f771c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 --2- 172.21.15.1:0/4197726293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101430 0x7f771c10d960 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7714009cd0 tx=0x7f771402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 -- 172.21.15.1:0/4197726293 shutdown_connections 2024-09-19T05:28:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 --2- 172.21.15.1:0/4197726293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101430 0x7f771c10d960 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 --2- 172.21.15.1:0/4197726293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c100a90 0x7f771c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 --2- 172.21.15.1:0/4197726293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c106a90 0x7f771c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 -- 172.21.15.1:0/4197726293 >> 172.21.15.1:0/4197726293 conn(0x7f771c0fc7d0 msgr2=0x7f771c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 -- 172.21.15.1:0/4197726293 shutdown_connections 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.096+0000 7f7724513640 1 -- 172.21.15.1:0/4197726293 wait complete. 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 Processor -- start 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 -- start start 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 0x7f771c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c110e90 con 0x7f771c106a90 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f771c110d10 con 0x7f771c100a90 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f7724513640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111010 con 0x7f771c101430 2024-09-19T05:28:17.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.097+0000 7f77222af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7721aae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 0x7f771c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f77222af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40954/0 (socket says 172.21.15.1:40954) 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7721aae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 0x7f771c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:39670/0 (socket says 172.21.15.1:39670) 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f77222af640 1 -- 172.21.15.1:0/110135019 learned_addr learned my addr 172.21.15.1:0/110135019 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33740/0 (socket says 172.21.15.1:33740) 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 -- 172.21.15.1:0/110135019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 msgr2=0x7f771c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 0x7f771c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 -- 172.21.15.1:0/110135019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 msgr2=0x7f771c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 -- 172.21.15.1:0/110135019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c1a66e0 con 0x7f771c106a90 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f77222af640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:28:17.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f7722ab0640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7714005cc0 tx=0x7f7714003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.098+0000 7f77137fe640 1 -- 172.21.15.1:0/110135019 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714004240 con 0x7f771c106a90 2024-09-19T05:28:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.099+0000 7f77137fe640 1 -- 172.21.15.1:0/110135019 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7714003e10 con 0x7f771c106a90 2024-09-19T05:28:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.099+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1a6970 con 0x7f771c106a90 2024-09-19T05:28:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.099+0000 7f77137fe640 1 -- 172.21.15.1:0/110135019 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771403a420 con 0x7f771c106a90 2024-09-19T05:28:17.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.099+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a6eb0 con 0x7f771c106a90 2024-09-19T05:28:17.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.101+0000 7f77137fe640 1 -- 172.21.15.1:0/110135019 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f77140306a0 con 0x7f771c106a90 2024-09-19T05:28:17.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.101+0000 7f77268ec740 1 Processor -- start 2024-09-19T05:28:17.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 -- start start 2024-09-19T05:28:17.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x565286675c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x565286682e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5652865da160 con 0x565286680a30 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565286581720 con 0x565286676170 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77268ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5652865d6120 con 0x565286675850 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f7721aae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x565286675c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40958/0 (socket says 172.21.15.1:40958) 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 -- 172.21.15.1:0/2200844729 learned_addr learned my addr 172.21.15.1:0/2200844729 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f7721aae640 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x565286682e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77137fe640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 -- 172.21.15.1:0/2200844729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 msgr2=0x565286675c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x565286675c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 -- 172.21.15.1:0/2200844729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 msgr2=0x565286682e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.102+0000 7f77222af640 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x565286682e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f77222af640 1 -- 172.21.15.1:0/2200844729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528634bba0 con 0x565286676170 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f7722ab0640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f77137fe640 1 -- 172.21.15.1:0/110135019 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f77140f0b90 con 0x7f771c106a90 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f77222af640 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77180115c0 tx=0x7f7718011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8dfcc5e3648ddc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f7710ff9640 1 -- 172.21.15.1:0/2200844729 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771800f5e0 con 0x565286676170 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f7710ff9640 1 -- 172.21.15.1:0/2200844729 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f771800fc60 con 0x565286676170 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.103+0000 7f7710ff9640 1 -- 172.21.15.1:0/2200844729 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718019de0 con 0x565286676170 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- 172.21.15.1:0/2200844729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 msgr2=0x5652866804f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f7722ab0640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 0x7f77080a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77140b97d0 tx=0x7f771402dba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77180115c0 tx=0x7f7718011a80 comp rx=0 tx=0).stop 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- 172.21.15.1:0/2200844729 shutdown_connections 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x565286682e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286676170 0x5652866804f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 --2- 172.21.15.1:0/2200844729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x565286675c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- 172.21.15.1:0/2200844729 >> 172.21.15.1:0/2200844729 conn(0x565286671de0 msgr2=0x5652866721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- 172.21.15.1:0/2200844729 shutdown_connections 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- 172.21.15.1:0/2200844729 wait complete. 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 -- start start 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.104+0000 7f77268ec740 1 Processor -- start 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 0x56528667d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x56528667e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565286683650 con 0x565286680a30 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565286562900 con 0x565286675850 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5652866837d0 con 0x565286676170 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77268ec740 10 client.0 _ll_register_callbacks cb 0x565286560780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:17.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f7721aae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 0x56528667d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f7721aae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 0x56528667d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40962/0 (socket says 172.21.15.1:40962) 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:39692/0 (socket says 172.21.15.1:39692) 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f7721aae640 1 -- 172.21.15.1:0/4249464433 learned_addr learned my addr 172.21.15.1:0/4249464433 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f7721aae640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x56528667e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 -- 172.21.15.1:0/4249464433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 msgr2=0x56528667d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 0x56528667d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 -- 172.21.15.1:0/4249464433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 msgr2=0x56528667e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x56528667e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 -- 172.21.15.1:0/4249464433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652865a2c50 con 0x565286676170 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f77222af640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7718000c00 tx=0x7f7718019f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb5fa9affda3025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.105+0000 7f7705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718005c50 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f771800fc60 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f771800f5e0 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f771802f050 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f77268ec740 10 client.25138 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56528668f2b0 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f771800fc60 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.106+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f771802a030 con 0x565286676170 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 10 client.25138 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 10 client.25138 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 20 client.25138 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:17.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866906c0 0x565286692ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 4 client.25138 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:28:17.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652865e7890 con 0x5652866906c0 2024-09-19T05:28:17.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f7721aae640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866906c0 0x565286692ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f7705ffb640 10 client.25138 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:17.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.107+0000 7f7721aae640 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866906c0 0x565286692ab0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47480d5d79ac053e server_cookie=e311fea8d8879142 in_seq=0 out_seq=0 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f7705ffb640 1 -- 172.21.15.1:0/4249464433 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652865e7890 con 0x5652866906c0 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f7705ffb640 10 client.25138 handle_command_reply: tid=0 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 client.25138 shutdown 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 msgr2=0x56528667ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7718000c00 tx=0x7f7718019f90 comp rx=0 tx=0).stop 2024-09-19T05:28:17.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 shutdown_connections 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286680a30 0x56528667e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866906c0 0x565286692ab0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286676170 0x56528667ddd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 --2- 172.21.15.1:0/4249464433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286675850 0x56528667d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f7705ffb640 0 client.25138 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.108+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 >> 172.21.15.1:0/4249464433 conn(0x565286671de0 msgr2=0x565286677ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.109+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 shutdown_connections 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.109+0000 7f77268ec740 1 -- 172.21.15.1:0/4249464433 wait complete. 2024-09-19T05:28:17.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.109+0000 7f77268ec740 20 client.25138 trim_cache size 0 max 16384 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 Processor -- start 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 -- start start 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286698800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1aeee0 con 0x565286676170 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1b1760 con 0x565286680a30 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77268ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1af550 con 0x565286675850 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77222af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77222af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33770/0 (socket says 172.21.15.1:33770) 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f77222af640 1 -- 172.21.15.1:0/2213793442 learned_addr learned my addr 172.21.15.1:0/2213793442 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:17.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f7721aae640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.127+0000 7f7721aae640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286698800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 -- 172.21.15.1:0/2213793442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 msgr2=0x5652866782b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866782b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 -- 172.21.15.1:0/2213793442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 msgr2=0x565286698800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286698800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 -- 172.21.15.1:0/2213793442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56528666d3f0 con 0x565286676170 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f7721aae640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f77222af640 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7718009250 tx=0x7f7718005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0e137244064b9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f7707fff640 1 -- 172.21.15.1:0/2213793442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771800fc40 con 0x565286676170 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f7707fff640 1 -- 172.21.15.1:0/2213793442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7718005c50 con 0x565286676170 2024-09-19T05:28:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.128+0000 7f7707fff640 1 -- 172.21.15.1:0/2213793442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771800f9a0 con 0x565286676170 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- 172.21.15.1:0/2213793442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 msgr2=0x5652866982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7718009250 tx=0x7f7718005990 comp rx=0 tx=0).stop 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- 172.21.15.1:0/2213793442 shutdown_connections 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286698800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x5652866982c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 --2- 172.21.15.1:0/2213793442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- 172.21.15.1:0/2213793442 >> 172.21.15.1:0/2213793442 conn(0x565286671de0 msgr2=0x565286670ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- 172.21.15.1:0/2213793442 shutdown_connections 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- 172.21.15.1:0/2213793442 wait complete. 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 -- start start 2024-09-19T05:28:17.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.129+0000 7f77268ec740 1 Processor -- start 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x565286684f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286685450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1afc20 con 0x565286676170 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1b1090 con 0x565286680a30 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1b02f0 con 0x565286675850 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77268ec740 10 client.0 _ll_register_callbacks cb 0x7f770c00be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77222af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x565286684f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77222af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x565286684f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33772/0 (socket says 172.21.15.1:33772) 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f77222af640 1 -- 172.21.15.1:0/1511835062 learned_addr learned my addr 172.21.15.1:0/1511835062 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286685450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 -- 172.21.15.1:0/1511835062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 msgr2=0x565286685450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286685450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 -- 172.21.15.1:0/1511835062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 msgr2=0x565286684f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x565286684f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 -- 172.21.15.1:0/1511835062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652866fa4e0 con 0x565286675850 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7721aae640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866849d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x565286683810 tx=0x7f770c00b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5cd607125bb81ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.130+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c031060 con 0x565286675850 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7718005c50 con 0x565286675850 2024-09-19T05:28:17.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f770c004020 con 0x565286675850 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f770c012030 con 0x565286675850 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 10 client.25144 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5652866fb830 con 0x565286675850 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7718005c50 con 0x565286675850 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f770c02b070 con 0x565286675850 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 10 client.25144 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 10 client.25144 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 20 client.25144 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866fbf20 0x5652866fe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 4 client.25144 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5652865e1be0 con 0x5652866fbf20 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.131+0000 7f77222af640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866fbf20 0x5652866fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.132+0000 7f77222af640 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866fbf20 0x5652866fe310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4678170bd284230 server_cookie=ea881ad3f115fffd in_seq=0 out_seq=0 2024-09-19T05:28:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.132+0000 7f7705ffb640 10 client.25144 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:17.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f7705ffb640 1 -- 172.21.15.1:0/1511835062 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5652865e1be0 con 0x5652866fbf20 2024-09-19T05:28:17.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f7705ffb640 10 client.25144 handle_command_reply: tid=0 2024-09-19T05:28:17.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 client.25144 shutdown 2024-09-19T05:28:17.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 msgr2=0x5652866849d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866849d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x565286683810 tx=0x7f770c00b410 comp rx=0 tx=0).stop 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 shutdown_connections 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565286680a30 0x565286685450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565286676170 0x565286684f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5652866fbf20 0x5652866fe310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 --2- 172.21.15.1:0/1511835062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565286675850 0x5652866849d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f7705ffb640 0 client.25144 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 >> 172.21.15.1:0/1511835062 conn(0x565286671de0 msgr2=0x56528668b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 shutdown_connections 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 1 -- 172.21.15.1:0/1511835062 wait complete. 2024-09-19T05:28:17.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.195+0000 7f77268ec740 20 client.25144 trim_cache size 0 max 16384 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 26, 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "ffa287e2": { 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 26, 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:17.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 145.8, 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:17.200 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 msgr2=0x7f77080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 0x7f77080a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77140b97d0 tx=0x7f771402dba0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 msgr2=0x7f771c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:17.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7714005cc0 tx=0x7f7714003c20 comp rx=0 tx=0).stop 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 shutdown_connections 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c106a90 0x7f771c0fd700 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f771c101430 0x7f771c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 --2- 172.21.15.1:0/110135019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f771c100a90 0x7f771c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 >> 172.21.15.1:0/110135019 conn(0x7f771c0fc7d0 msgr2=0x7f771c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 shutdown_connections 2024-09-19T05:28:17.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:17.196+0000 7f7724513640 1 -- 172.21.15.1:0/110135019 wait complete. 2024-09-19T05:28:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:17 smithi001 ceph-mon[30968]: pgmap v564: 129 pgs: 129 active+clean; 276 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-09-19T05:28:17.383 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 12.22 MB/sec execute 212 sec latency 183.804 ms 2024-09-19T05:28:17.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:17 smithi060 ceph-mon[35058]: pgmap v564: 129 pgs: 129 active+clean; 276 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-09-19T05:28:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:17 smithi082 ceph-mon[35195]: pgmap v564: 129 pgs: 129 active+clean; 276 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 284 op/s 2024-09-19T05:28:17.910 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ffa287e2', quiesce took 3.8 seconds. Will release after: 21.95 2024-09-19T05:28:18.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 12.16 MB/sec execute 213 sec latency 1183.911 ms 2024-09-19T05:28:19.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 12.10 MB/sec execute 214 sec latency 2183.987 ms 2024-09-19T05:28:19.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:19 smithi060 ceph-mon[35058]: pgmap v565: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 366 op/s 2024-09-19T05:28:19.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:19 smithi082 ceph-mon[35195]: pgmap v565: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 366 op/s 2024-09-19T05:28:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:19 smithi001 ceph-mon[30968]: pgmap v565: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.9 MiB/s wr, 366 op/s 2024-09-19T05:28:20.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 12.05 MB/sec execute 215 sec latency 3184.079 ms 2024-09-19T05:28:21.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.99 MB/sec execute 216 sec latency 4184.189 ms 2024-09-19T05:28:21.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:21 smithi060 ceph-mon[35058]: pgmap v566: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:28:21.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:21 smithi082 ceph-mon[35195]: pgmap v566: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:28:21.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:21 smithi001 ceph-mon[30968]: pgmap v566: 129 pgs: 129 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:28:22.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.94 MB/sec execute 217 sec latency 5184.318 ms 2024-09-19T05:28:23.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.88 MB/sec execute 218 sec latency 6184.422 ms 2024-09-19T05:28:23.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:23 smithi060 ceph-mon[35058]: pgmap v567: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 284 op/s 2024-09-19T05:28:23.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:23 smithi082 ceph-mon[35195]: pgmap v567: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 284 op/s 2024-09-19T05:28:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:23 smithi001 ceph-mon[30968]: pgmap v567: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 284 op/s 2024-09-19T05:28:24.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.83 MB/sec execute 219 sec latency 7184.547 ms 2024-09-19T05:28:25.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.77 MB/sec execute 220 sec latency 8184.673 ms 2024-09-19T05:28:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:25 smithi060 ceph-mon[35058]: pgmap v568: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 237 op/s 2024-09-19T05:28:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:25 smithi082 ceph-mon[35195]: pgmap v568: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 237 op/s 2024-09-19T05:28:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:25 smithi001 ceph-mon[30968]: pgmap v568: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 237 op/s 2024-09-19T05:28:26.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.72 MB/sec execute 221 sec latency 9184.770 ms 2024-09-19T05:28:27.384 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.67 MB/sec execute 222 sec latency 10184.838 ms 2024-09-19T05:28:27.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:27 smithi060 ceph-mon[35058]: pgmap v569: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 179 op/s 2024-09-19T05:28:27.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:27 smithi082 ceph-mon[35195]: pgmap v569: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 179 op/s 2024-09-19T05:28:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:27 smithi001 ceph-mon[30968]: pgmap v569: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 179 op/s 2024-09-19T05:28:28.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.62 MB/sec execute 223 sec latency 11184.908 ms 2024-09-19T05:28:29.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.56 MB/sec execute 224 sec latency 12184.983 ms 2024-09-19T05:28:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:29 smithi060 ceph-mon[35058]: pgmap v570: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-09-19T05:28:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:29 smithi082 ceph-mon[35195]: pgmap v570: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-09-19T05:28:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:29 smithi001 ceph-mon[30968]: pgmap v570: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 188 op/s 2024-09-19T05:28:30.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.51 MB/sec execute 225 sec latency 13185.075 ms 2024-09-19T05:28:31.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.46 MB/sec execute 226 sec latency 14185.187 ms 2024-09-19T05:28:31.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:31 smithi001 ceph-mon[30968]: pgmap v571: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:28:31.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:31 smithi060 ceph-mon[35058]: pgmap v571: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:28:31.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:31 smithi082 ceph-mon[35195]: pgmap v571: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 2.2 MiB/s wr, 88 op/s 2024-09-19T05:28:32.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.41 MB/sec execute 227 sec latency 15185.255 ms 2024-09-19T05:28:33.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.36 MB/sec execute 228 sec latency 16185.335 ms 2024-09-19T05:28:33.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:33 smithi060 ceph-mon[35058]: pgmap v572: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 3.0 MiB/s wr, 116 op/s 2024-09-19T05:28:33.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:33 smithi082 ceph-mon[35195]: pgmap v572: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 3.0 MiB/s wr, 116 op/s 2024-09-19T05:28:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:33 smithi001 ceph-mon[30968]: pgmap v572: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 3.0 MiB/s wr, 116 op/s 2024-09-19T05:28:34.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.31 MB/sec execute 229 sec latency 17185.414 ms 2024-09-19T05:28:35.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.26 MB/sec execute 230 sec latency 18185.557 ms 2024-09-19T05:28:35.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:35 smithi060 ceph-mon[35058]: pgmap v573: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:28:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:35 smithi082 ceph-mon[35195]: pgmap v573: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:28:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:35 smithi001 ceph-mon[30968]: pgmap v573: 129 pgs: 129 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:28:36.388 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.21 MB/sec execute 231 sec latency 19185.608 ms 2024-09-19T05:28:37.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.17 MB/sec execute 232 sec latency 20185.715 ms 2024-09-19T05:28:37.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:37 smithi060 ceph-mon[35058]: pgmap v574: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.6 MiB/s wr, 92 op/s 2024-09-19T05:28:37.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:37 smithi082 ceph-mon[35195]: pgmap v574: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.6 MiB/s wr, 92 op/s 2024-09-19T05:28:37.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:37 smithi001 ceph-mon[30968]: pgmap v574: 129 pgs: 129 active+clean; 280 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 2.6 MiB/s wr, 92 op/s 2024-09-19T05:28:38.385 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.12 MB/sec execute 233 sec latency 21185.809 ms 2024-09-19T05:28:39.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.07 MB/sec execute 234 sec latency 22185.923 ms 2024-09-19T05:28:39.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:39 smithi060 ceph-mon[35058]: pgmap v575: 129 pgs: 129 active+clean; 277 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2024-09-19T05:28:39.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:39 smithi082 ceph-mon[35195]: pgmap v575: 129 pgs: 129 active+clean; 277 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2024-09-19T05:28:39.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:39 smithi001 ceph-mon[30968]: pgmap v575: 129 pgs: 129 active+clean; 277 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 2.7 MiB/s wr, 105 op/s 2024-09-19T05:28:39.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:28:40.138 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:40.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 11.02 MB/sec execute 235 sec latency 23186.028 ms 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 -- 172.21.15.1:0/1651124125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 msgr2=0x7f292810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 --2- 172.21.15.1:0/1651124125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292810ea90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2920009ca0 tx=0x7f292002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 -- 172.21.15.1:0/1651124125 shutdown_connections 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 --2- 172.21.15.1:0/1651124125 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292810ea90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 --2- 172.21.15.1:0/1651124125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928102790 0x7f29281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 --2- 172.21.15.1:0/1651124125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928101de0 0x7f29281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 -- 172.21.15.1:0/1651124125 >> 172.21.15.1:0/1651124125 conn(0x7f29280fd8c0 msgr2=0x7f29280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 -- 172.21.15.1:0/1651124125 shutdown_connections 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.768+0000 7f292e375640 1 -- 172.21.15.1:0/1651124125 wait complete. 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.769+0000 7f292e375640 1 Processor -- start 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.769+0000 7f292e375640 1 -- start start 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.769+0000 7f292e375640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928101de0 0x7f292819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.769+0000 7f292e375640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 0x7f292819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292e375640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292e375640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2928111fc0 con 0x7f2928106f10 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292e375640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2928111e40 con 0x7f2928101de0 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292e375640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2928112140 con 0x7f2928102790 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:40.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49892/0 (socket says 172.21.15.1:49892) 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 -- 172.21.15.1:0/2086204157 learned_addr learned my addr 172.21.15.1:0/2086204157 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f2927fff640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928101de0 0x7f292819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f29277fe640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 0x7f292819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 -- 172.21.15.1:0/2086204157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 msgr2=0x7f292819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 0x7f292819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 -- 172.21.15.1:0/2086204157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928101de0 msgr2=0x7f292819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928101de0 0x7f292819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 -- 172.21.15.1:0/2086204157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292819f530 con 0x7f2928106f10 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f29277fe640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 0x7f292819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292c912640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2920003f40 tx=0x7f2920003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920031800 con 0x7f2928106f10 2024-09-19T05:28:40.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29200319a0 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292819f7c0 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.770+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292002fd00 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.771+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29281a7100 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.772+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29281021c0 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.773+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2920004040 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.773+0000 7f29257fa640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 0x7f29100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.774+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f29200f1300 con 0x7f2928106f10 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.774+0000 7f2927fff640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 0x7f29100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.774+0000 7f2927fff640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 0x7f29100a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f291800abe0 tx=0x7f291800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:40.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:40.778+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29200bdc70 con 0x7f2928106f10 2024-09-19T05:28:41.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.041+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29281a72d0 con 0x7f2928106f10 2024-09-19T05:28:41.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.041+0000 7f29257fa640 1 -- 172.21.15.1:0/2086204157 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f29200dd030 con 0x7f2928106f10 2024-09-19T05:28:41.045 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:28:41.045 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:28:41.045 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:28:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.043+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 msgr2=0x7f29100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.043+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 0x7f29100a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f291800abe0 tx=0x7f291800a2d0 comp rx=0 tx=0).stop 2024-09-19T05:28:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.043+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 msgr2=0x7f292819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.043+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2920003f40 tx=0x7f2920003f70 comp rx=0 tx=0).stop 2024-09-19T05:28:41.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 shutdown_connections 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f29100a32c0 0x7f29100a5780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2928106f10 0x7f292819ee50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2928102790 0x7f292819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 --2- 172.21.15.1:0/2086204157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2928101de0 0x7f292819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 >> 172.21.15.1:0/2086204157 conn(0x7f29280fd8c0 msgr2=0x7f292810d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 shutdown_connections 2024-09-19T05:28:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:41.044+0000 7f292e375640 1 -- 172.21.15.1:0/2086204157 wait complete. 2024-09-19T05:28:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:41 smithi001 ceph-mon[30968]: pgmap v576: 129 pgs: 129 active+clean; 276 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:41.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:41 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2086204157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:41.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 10.98 MB/sec execute 236 sec latency 24186.123 ms 2024-09-19T05:28:41.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:41 smithi060 ceph-mon[35058]: pgmap v576: 129 pgs: 129 active+clean; 276 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:41.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:41 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2086204157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:41.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:41 smithi082 ceph-mon[35195]: pgmap v576: 129 pgs: 129 active+clean; 276 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:41.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:41 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2086204157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:41.767 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id ffa287e2 --release --await' 2024-09-19T05:28:41.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id ffa287e2 --release --await 2024-09-19T05:28:42.031 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:42.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 751065 10.93 MB/sec execute 237 sec latency 25186.201 ms 2024-09-19T05:28:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 -- 172.21.15.1:0/431208731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 msgr2=0x7f6aac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 --2- 172.21.15.1:0/431208731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac1067e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009900 tx=0x7f6aa002a3f0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 -- 172.21.15.1:0/431208731 shutdown_connections 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 --2- 172.21.15.1:0/431208731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 --2- 172.21.15.1:0/431208731 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac1067e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 --2- 172.21.15.1:0/431208731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 0x7f6aac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 -- 172.21.15.1:0/431208731 >> 172.21.15.1:0/431208731 conn(0x7f6aac0fd8c0 msgr2=0x7f6aac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 -- 172.21.15.1:0/431208731 shutdown_connections 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.514+0000 7f6ab206a640 1 -- 172.21.15.1:0/431208731 wait complete. 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 Processor -- start 2024-09-19T05:28:42.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 -- start start 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 0x7f6aac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac111f70 con 0x7f6aac102790 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac111df0 con 0x7f6aac106f10 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.515+0000 7f6ab206a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1120f0 con 0x7f6aac101de0 2024-09-19T05:28:42.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49912/0 (socket says 172.21.15.1:49912) 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 -- 172.21.15.1:0/357070248 learned_addr learned my addr 172.21.15.1:0/357070248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aabfff640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 0x7f6aac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 -- 172.21.15.1:0/357070248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 msgr2=0x7f6aac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 0x7f6aac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 -- 172.21.15.1:0/357070248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 msgr2=0x7f6aac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 -- 172.21.15.1:0/357070248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac1a68b0 con 0x7f6aac102790 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aabfff640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006010 tx=0x7f6aa00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aa8ff9640 1 -- 172.21.15.1:0/357070248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa003f030 con 0x7f6aac102790 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aa8ff9640 1 -- 172.21.15.1:0/357070248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa0003ce0 con 0x7f6aac102790 2024-09-19T05:28:42.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac1a6b40 con 0x7f6aac102790 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6aa8ff9640 1 -- 172.21.15.1:0/357070248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0035070 con 0x7f6aac102790 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.516+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac1a7020 con 0x7f6aac102790 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aa8ff9640 1 -- 172.21.15.1:0/357070248 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f6aa0042030 con 0x7f6aac102790 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 Processor -- start 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 -- start start 2024-09-19T05:28:42.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b76440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b80d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5611a0adb620 con 0x5611a0b81240 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5611a0a82e50 con 0x5611a0b76980 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6ab4443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611a0ad75e0 con 0x5611a0b76060 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aa8ff9640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 0x7f6a940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49926/0 (socket says 172.21.15.1:49926) 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aaaffd640 1 -- 172.21.15.1:0/3621979770 learned_addr learned my addr 172.21.15.1:0/3621979770 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.519+0000 7f6aabfff640 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b76440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aabfff640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 0x7f6a940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b80d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aa8ff9640 1 -- 172.21.15.1:0/357070248 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6aa00f0280 con 0x7f6aac102790 2024-09-19T05:28:42.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 -- 172.21.15.1:0/3621979770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 msgr2=0x5611a0b76440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b76440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 -- 172.21.15.1:0/3621979770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 msgr2=0x5611a0b80d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b80d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 -- 172.21.15.1:0/3621979770 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a0a73d40 con 0x5611a0b81240 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aabfff640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 0x7f6a940a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007310 tx=0x7f6aa40072a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0042000 tx=0x7f6aa002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753ad9ba006ede42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6a91ffb640 1 -- 172.21.15.1:0/3621979770 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0049070 con 0x5611a0b81240 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6a91ffb640 1 -- 172.21.15.1:0/3621979770 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa003b580 con 0x5611a0b81240 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.520+0000 7f6a91ffb640 1 -- 172.21.15.1:0/3621979770 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00bc5b0 con 0x5611a0b81240 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- 172.21.15.1:0/3621979770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 msgr2=0x5611a0b83630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0042000 tx=0x7f6aa002a3f0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- 172.21.15.1:0/3621979770 shutdown_connections 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0b83630 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b80d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3621979770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b76440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- 172.21.15.1:0/3621979770 >> 172.21.15.1:0/3621979770 conn(0x5611a0b725f0 msgr2=0x5611a0b729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- 172.21.15.1:0/3621979770 shutdown_connections 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- 172.21.15.1:0/3621979770 wait complete. 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.521+0000 7f6ab4443740 1 -- start start 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 Processor -- start 2024-09-19T05:28:42.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b7e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b81240 0x5611a0b7eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5611a0b83bd0 con 0x5611a0b76060 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5611a0a63f10 con 0x5611a0b76980 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611a0b83d50 con 0x5611a0b81240 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6ab4443740 10 client.0 _ll_register_callbacks cb 0x5611a0a87db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49940/0 (socket says 172.21.15.1:49940) 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 -- 172.21.15.1:0/3352459088 learned_addr learned my addr 172.21.15.1:0/3352459088 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:42.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b7e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aabfff640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b81240 0x5611a0b7eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 -- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b81240 msgr2=0x5611a0b7eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b81240 0x5611a0b7eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 -- 172.21.15.1:0/3352459088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 msgr2=0x5611a0b7e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b7e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 -- 172.21.15.1:0/3352459088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a07ea580 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00da40 tx=0x7f6a9c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c9254df03e16b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.522+0000 7f6a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c003ea0 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6a9c01b640 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611a0ae8b90 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6a9c01b840 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 10 client.15531 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611a08b4960 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5611a0ae8b90 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6a9c019020 con 0x5611a0b76060 2024-09-19T05:28:42.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 10 client.15531 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 10 client.15531 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 20 client.15531 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0b90af0 0x5611a0b92f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 4 client.15531 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.523+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611a0ae30a0 con 0x5611a0b90af0 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.524+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0b90af0 0x5611a0b92f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.524+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0b90af0 0x5611a0b92f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=457ac704e95622aa server_cookie=321a03cb4b76f204 in_seq=0 out_seq=0 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.524+0000 7f6a8affd640 10 client.15531 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6a8affd640 1 -- 172.21.15.1:0/3352459088 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611a0ae30a0 con 0x5611a0b90af0 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6a8affd640 10 client.15531 handle_command_reply: tid=0 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 client.15531 shutdown 2024-09-19T05:28:42.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 msgr2=0x5611a0b7e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00da40 tx=0x7f6a9c00de40 comp rx=0 tx=0).stop 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 shutdown_connections 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0b90af0 0x5611a0b92f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b81240 0x5611a0b7eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b7e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6a8affd640 0 client.15531 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 --2- 172.21.15.1:0/3352459088 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76060 0x5611a0b7e0e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 >> 172.21.15.1:0/3352459088 conn(0x5611a0b725f0 msgr2=0x5611a0b782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 shutdown_connections 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 1 -- 172.21.15.1:0/3352459088 wait complete. 2024-09-19T05:28:42.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.525+0000 7f6ab4443740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 Processor -- start 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 -- start start 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b81240 0x5611a0b98d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1aef10 con 0x5611a0b76980 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1b1790 con 0x5611a0b81240 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.542+0000 7f6ab4443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1af580 con 0x5611a0b76060 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49952/0 (socket says 172.21.15.1:49952) 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 -- 172.21.15.1:0/2195262392 learned_addr learned my addr 172.21.15.1:0/2195262392 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:42.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aabfff640 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b81240 0x5611a0b98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 -- 172.21.15.1:0/2195262392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 msgr2=0x5611a0b781c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b781c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 -- 172.21.15.1:0/2195262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b81240 msgr2=0x5611a0b98d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b81240 0x5611a0b98d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 -- 172.21.15.1:0/2195262392 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a0b72420 con 0x5611a0b76980 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00eda20 tx=0x7f6aa00bc4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c49a1ffbb333cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6a917fa640 1 -- 172.21.15.1:0/2195262392 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0049040 con 0x5611a0b76980 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6a917fa640 1 -- 172.21.15.1:0/2195262392 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa00c0960 con 0x5611a0b76980 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.543+0000 7f6a917fa640 1 -- 172.21.15.1:0/2195262392 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00ba8b0 con 0x5611a0b76980 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- 172.21.15.1:0/2195262392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 msgr2=0x5611a0b98810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6aa00eda20 tx=0x7f6aa00bc4b0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- 172.21.15.1:0/2195262392 shutdown_connections 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b81240 0x5611a0b98d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b76980 0x5611a0b98810 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 --2- 172.21.15.1:0/2195262392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b781c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- 172.21.15.1:0/2195262392 >> 172.21.15.1:0/2195262392 conn(0x5611a0b725f0 msgr2=0x5611a0b77ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- 172.21.15.1:0/2195262392 shutdown_connections 2024-09-19T05:28:42.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- 172.21.15.1:0/2195262392 wait complete. 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 -- start start 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.544+0000 7f6ab4443740 1 Processor -- start 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b85500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b85a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1afc50 con 0x5611a0b81240 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1b10c0 con 0x5611a0b76980 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac1b0320 con 0x5611a0b76060 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6ab4443740 10 client.0 _ll_register_callbacks cb 0x7f6a9c004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:42.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49960/0 (socket says 172.21.15.1:49960) 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 -- 172.21.15.1:0/1499245941 learned_addr learned my addr 172.21.15.1:0/1499245941 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aaaffd640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b85a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b85500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 -- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 msgr2=0x5611a0b85500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b85500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 -- 172.21.15.1:0/1499245941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 msgr2=0x5611a0b85a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b85a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 -- 172.21.15.1:0/1499245941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a0bf4ed0 con 0x5611a0b81240 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6aabfff640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e720 tx=0x7f6aa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa7ace241f2ada0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.545+0000 7f6a8affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa402d060 con 0x5611a0b81240 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6aa401f630 con 0x5611a0b81240 2024-09-19T05:28:42.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa00c0960 con 0x5611a0b81240 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6aa4034050 con 0x5611a0b81240 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 10 client.15537 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611a0bfc2a0 con 0x5611a0b81240 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa00c0960 con 0x5611a0b81240 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6aa4027070 con 0x5611a0b81240 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 10 client.15537 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:42.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 10 client.15537 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 20 client.15537 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0bfca20 0x5611a0bfee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 4 client.15537 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ffa287e2", "release": true, "await": true}] 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ffa287e2", "release": true, "await": true}) -- 0x5611a0a5f5a0 con 0x5611a0bfca20 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.546+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0bfca20 0x5611a0bfee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.547+0000 7f6aab7fe640 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0bfca20 0x5611a0bfee40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f169868b485e1097 server_cookie=3fa586099970a17a in_seq=0 out_seq=0 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.547+0000 7f6a8affd640 10 client.15537 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:42.639 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6a8affd640 1 -- 172.21.15.1:0/1499245941 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5611a0a5f5a0 con 0x5611a0bfca20 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6a8affd640 10 client.15537 handle_command_reply: tid=0 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 client.15537 shutdown 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 msgr2=0x5611a0bf4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400e720 tx=0x7f6aa4004a40 comp rx=0 tx=0).stop 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 shutdown_connections 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5611a0b81240 0x5611a0bf4890 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5611a0b76980 0x5611a0b85a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5611a0bfca20 0x5611a0bfee40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 --2- 172.21.15.1:0/1499245941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611a0b76060 0x5611a0b85500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 >> 172.21.15.1:0/1499245941 conn(0x5611a0b725f0 msgr2=0x5611a0b71750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6a8affd640 0 client.15537 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 shutdown_connections 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 1 -- 172.21.15.1:0/1499245941 wait complete. 2024-09-19T05:28:42.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.556+0000 7f6ab4443740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T05:28:42.642 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:28:42.642 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:28:42.642 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 28, 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "ffa287e2": { 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 28, 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:42.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 145.8, 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:28:42.644 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:42.645 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 msgr2=0x7f6a940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 0x7f6a940a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007310 tx=0x7f6aa40072a0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 msgr2=0x7f6aac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006010 tx=0x7f6aa00042f0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 shutdown_connections 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6a940a3240 0x7f6a940a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6aac106f10 0x7f6aac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102790 0x7f6aac074a30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 --2- 172.21.15.1:0/357070248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6aac101de0 0x7f6aac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:42.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 >> 172.21.15.1:0/357070248 conn(0x7f6aac0fd8c0 msgr2=0x7f6aac0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:42.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 shutdown_connections 2024-09-19T05:28:42.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:42.557+0000 7f6ab206a640 1 -- 172.21.15.1:0/357070248 wait complete. 2024-09-19T05:28:43.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:43 smithi001 ceph-mon[30968]: pgmap v577: 129 pgs: 129 active+clean; 275 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.9 MiB/s wr, 107 op/s 2024-09-19T05:28:43.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 753205 10.94 MB/sec execute 238 sec latency 25354.063 ms 2024-09-19T05:28:43.388 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ffa287e2', total seconds elapsed: 29.3 2024-09-19T05:28:43.388 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T05:28:43.388 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:28:43.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:43 smithi060 ceph-mon[35058]: pgmap v577: 129 pgs: 129 active+clean; 275 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.9 MiB/s wr, 107 op/s 2024-09-19T05:28:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:43 smithi082 ceph-mon[35195]: pgmap v577: 129 pgs: 129 active+clean; 275 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.9 MiB/s wr, 107 op/s 2024-09-19T05:28:43.656 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:44.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 -- 172.21.15.1:0/1730035395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 msgr2=0x7fc9e410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/1730035395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e410da40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009900 tx=0x7fc9dc02a480 comp rx=0 tx=0).stop 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 -- 172.21.15.1:0/1730035395 shutdown_connections 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/1730035395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e410da40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/1730035395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/1730035395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 -- 172.21.15.1:0/1730035395 >> 172.21.15.1:0/1730035395 conn(0x7fc9e40fc7d0 msgr2=0x7fc9e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 -- 172.21.15.1:0/1730035395 shutdown_connections 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.176+0000 7fc9ec26c640 1 -- 172.21.15.1:0/1730035395 wait complete. 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 Processor -- start 2024-09-19T05:28:44.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 -- start start 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4110f80 con 0x7fc9e4102ef0 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4110e00 con 0x7fc9e4100e20 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.177+0000 7fc9ec26c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4111100 con 0x7fc9e4102570 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea008640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9e9807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea008640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:34400/0 (socket says 172.21.15.1:34400) 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea008640 1 -- 172.21.15.1:0/3299771688 learned_addr learned my addr 172.21.15.1:0/3299771688 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 -- 172.21.15.1:0/3299771688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 msgr2=0x7fc9e4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:44.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 -- 172.21.15.1:0/3299771688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 msgr2=0x7fc9e4198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 -- 172.21.15.1:0/3299771688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e419d4e0 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea008640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9e9807640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ea809640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e419ce00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009230 tx=0x7fc9dc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc03f070 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e419d770 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9dc031c20 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.178+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc035030 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.179+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e41a50b0 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.180+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e41021b0 con 0x7fc9e4102ef0 2024-09-19T05:28:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.181+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc9dc042070 con 0x7fc9e4102ef0 2024-09-19T05:28:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.182+0000 7fc9e37fe640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 0x7fc9cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.182+0000 7fc9ea008640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 0x7fc9cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.182+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc9dc0f0270 con 0x7fc9e4102ef0 2024-09-19T05:28:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.182+0000 7fc9ea008640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 0x7fc9cc0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400f7d0 tx=0x7fc9d4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.186+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9dc031dd0 con 0x7fc9e4102ef0 2024-09-19T05:28:44.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 756458 10.97 MB/sec execute 239 sec latency 28.686 ms 2024-09-19T05:28:44.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.407+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9e410a0a0 con 0x7fc9e4102ef0 2024-09-19T05:28:44.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.407+0000 7fc9e37fe640 1 -- 172.21.15.1:0/3299771688 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fc9dc0bc590 con 0x7fc9e4102ef0 2024-09-19T05:28:44.410 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:28:44.410 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:28:44.411 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:28:44.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.409+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 msgr2=0x7fc9cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:44.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.409+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 0x7fc9cc0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400f7d0 tx=0x7fc9d4009500 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.409+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 msgr2=0x7fc9e419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.409+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e419ce00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009230 tx=0x7fc9dc003b90 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 shutdown_connections 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc9cc0a3240 0x7fc9cc0a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9e4102ef0 0x7fc9e419ce00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9e4102570 0x7fc9e4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 --2- 172.21.15.1:0/3299771688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9e4100e20 0x7fc9e4198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 >> 172.21.15.1:0/3299771688 conn(0x7fc9e40fc7d0 msgr2=0x7fc9e406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 shutdown_connections 2024-09-19T05:28:44.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:44.410+0000 7fc9ec26c640 1 -- 172.21.15.1:0/3299771688 wait complete. 2024-09-19T05:28:45.230 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T05:28:45.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T05:28:45.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 759680 10.99 MB/sec execute 240 sec latency 16.877 ms 2024-09-19T05:28:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:45 smithi060 ceph-mon[35058]: pgmap v578: 129 pgs: 129 active+clean; 274 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:45.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:45 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3299771688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:45.505 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:28:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:45 smithi082 ceph-mon[35195]: pgmap v578: 129 pgs: 129 active+clean; 274 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:45 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3299771688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:45 smithi001 ceph-mon[30968]: pgmap v578: 129 pgs: 129 active+clean; 274 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-09-19T05:28:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:45 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3299771688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:28:46.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.077+0000 7fad07ecf640 1 -- 172.21.15.1:0/1597803324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0011b140 msgr2=0x7fad0011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.077+0000 7fad07ecf640 1 --2- 172.21.15.1:0/1597803324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0011b140 0x7fad0011d530 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7facf801acb0 tx=0x7facf803b920 comp rx=0 tx=0).stop 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 -- 172.21.15.1:0/1597803324 shutdown_connections 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 --2- 172.21.15.1:0/1597803324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0011b140 0x7fad0011d530 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 --2- 172.21.15.1:0/1597803324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad00109830 0x7fad00109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 --2- 172.21.15.1:0/1597803324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109450 0x7fad00110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 -- 172.21.15.1:0/1597803324 >> 172.21.15.1:0/1597803324 conn(0x7fad0006e140 msgr2=0x7fad0006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.078+0000 7fad07ecf640 1 -- 172.21.15.1:0/1597803324 shutdown_connections 2024-09-19T05:28:46.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.080+0000 7fad07ecf640 1 -- 172.21.15.1:0/1597803324 wait complete. 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.081+0000 7fad07ecf640 1 Processor -- start 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.082+0000 7fad07ecf640 1 -- start start 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109830 0x7fad00116900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0011b140 0x7fad00116e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad001133c0 con 0x7fad00109450 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad00113240 con 0x7fad00109830 2024-09-19T05:28:46.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad07ecf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad00113540 con 0x7fad0011b140 2024-09-19T05:28:46.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50542/0 (socket says 172.21.15.1:50542) 2024-09-19T05:28:46.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.083+0000 7fad05c6b640 1 -- 172.21.15.1:0/2413034018 learned_addr learned my addr 172.21.15.1:0/2413034018 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:46.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.084+0000 7fad0546a640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109830 0x7fad00116900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.085+0000 7fad05c6b640 1 -- 172.21.15.1:0/2413034018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0011b140 msgr2=0x7fad00116e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.085+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0011b140 0x7fad00116e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.085+0000 7fad05c6b640 1 -- 172.21.15.1:0/2413034018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109830 msgr2=0x7fad00116900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.085+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109830 0x7fad00116900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.085+0000 7fad05c6b640 1 -- 172.21.15.1:0/2413034018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad00117540 con 0x7fad00109450 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.086+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7facfc00b4a0 tx=0x7facfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.086+0000 7facf6ffd640 1 -- 172.21.15.1:0/2413034018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc014070 con 0x7fad00109450 2024-09-19T05:28:46.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.086+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad001ab170 con 0x7fad00109450 2024-09-19T05:28:46.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.086+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad001ab5c0 con 0x7fad00109450 2024-09-19T05:28:46.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.087+0000 7facf6ffd640 1 -- 172.21.15.1:0/2413034018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc010af0 con 0x7fad00109450 2024-09-19T05:28:46.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.091+0000 7facf6ffd640 1 -- 172.21.15.1:0/2413034018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc01e060 con 0x7fad00109450 2024-09-19T05:28:46.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.091+0000 7fad0a2a8740 1 Processor -- start 2024-09-19T05:28:46.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.095+0000 7fad0a2a8740 1 -- start start 2024-09-19T05:28:46.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.095+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.095+0000 7facf6ffd640 1 -- 172.21.15.1:0/2413034018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7facfc017070 con 0x7fad00109450 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.095+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242dba30 0x5590242dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559024235160 con 0x5590242d0850 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5590241dc720 con 0x5590242dba30 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559024231120 con 0x5590242d1170 2024-09-19T05:28:46.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:51670/0 (socket says 172.21.15.1:51670) 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.096+0000 7fad05c6b640 1 -- 172.21.15.1:0/2281882796 learned_addr learned my addr 172.21.15.1:0/2281882796 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 -- 172.21.15.1:0/2281882796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242dba30 msgr2=0x5590242dde20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242dba30 0x5590242dde20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 -- 172.21.15.1:0/2281882796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 msgr2=0x5590242d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 -- 172.21.15.1:0/2281882796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559023fa6ba0 con 0x5590242d1170 2024-09-19T05:28:46.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.097+0000 7fad05c6b640 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facfc0d2f10 tx=0x7facfc0d7830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d2eb1fbb4cd68f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.098+0000 7facf6ffd640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 0x7facec0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.098+0000 7facf6ffd640 1 -- 172.21.15.1:0/2413034018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7facfc0cee60 con 0x7fad00109450 2024-09-19T05:28:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.098+0000 7facebfff640 1 -- 172.21.15.1:0/2281882796 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0e4070 con 0x5590242d1170 2024-09-19T05:28:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.098+0000 7fad0646c640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 0x7facec0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.098+0000 7facebfff640 1 -- 172.21.15.1:0/2281882796 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc0d5d90 con 0x5590242d1170 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.099+0000 7facebfff640 1 -- 172.21.15.1:0/2281882796 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0d33c0 con 0x5590242d1170 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.099+0000 7fad0a2a8740 1 -- 172.21.15.1:0/2281882796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 msgr2=0x5590242db4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.099+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7facfc0d2f10 tx=0x7facfc0d7830 comp rx=0 tx=0).stop 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0646c640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 0x7facec0a57c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7facf803be90 tx=0x7facf8040fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0a2a8740 1 -- 172.21.15.1:0/2281882796 shutdown_connections 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242dba30 0x5590242dde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242db4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/2281882796 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.100+0000 7fad0a2a8740 1 -- 172.21.15.1:0/2281882796 >> 172.21.15.1:0/2281882796 conn(0x5590242ccde0 msgr2=0x5590242cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.108+0000 7fad0a2a8740 1 -- 172.21.15.1:0/2281882796 shutdown_connections 2024-09-19T05:28:46.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.109+0000 7fad0a2a8740 1 -- 172.21.15.1:0/2281882796 wait complete. 2024-09-19T05:28:46.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.110+0000 7fad0a2a8740 1 -- start start 2024-09-19T05:28:46.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.110+0000 7fad0a2a8740 1 Processor -- start 2024-09-19T05:28:46.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.111+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d0850 0x5590242d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.111+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d1170 0x5590242d8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.111+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5590242de650 con 0x5590242d9470 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5590241bd900 con 0x5590242d1170 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5590242de7d0 con 0x5590242d0850 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d0850 0x5590242d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0646c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0646c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50552/0 (socket says 172.21.15.1:50552) 2024-09-19T05:28:46.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0646c640 1 -- 172.21.15.1:0/3705770605 learned_addr learned my addr 172.21.15.1:0/3705770605 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.112+0000 7fad0a2a8740 10 client.0 _ll_register_callbacks cb 0x5590241bb780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.113+0000 7fad0646c640 1 -- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d0850 msgr2=0x5590242d89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.113+0000 7fad0646c640 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d0850 0x5590242d89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.113+0000 7fad0646c640 1 -- 172.21.15.1:0/3705770605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d1170 msgr2=0x5590242d8f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:28:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.113+0000 7fad0646c640 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d1170 0x5590242d8f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.113+0000 7fad0646c640 1 -- 172.21.15.1:0/3705770605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590241fdc50 con 0x5590242d9470 2024-09-19T05:28:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.114+0000 7fad0646c640 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7facf80406a0 tx=0x7facf803be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4e58fc4431af80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.114+0000 7face97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:28:46.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.118+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf805c070 con 0x5590242d9470 2024-09-19T05:28:46.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.118+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc0d5d90 con 0x5590242d9470 2024-09-19T05:28:46.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.118+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7facf8042c50 con 0x5590242d9470 2024-09-19T05:28:46.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.119+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7facf8068050 con 0x5590242d9470 2024-09-19T05:28:46.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.120+0000 7fad0a2a8740 10 client.15552 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:46.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.120+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5590242ea890 con 0x5590242d9470 2024-09-19T05:28:46.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.121+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc0d5d90 con 0x5590242d9470 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.121+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7facf80586b0 con 0x5590242d9470 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 10 client.15552 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 10 client.15552 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 20 client.15552 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590242ec190 0x5590242ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 4 client.15552 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559024242890 con 0x5590242ec190 2024-09-19T05:28:46.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.122+0000 7fad05c6b640 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590242ec190 0x5590242ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.126+0000 7fad05c6b640 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590242ec190 0x5590242ee630 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93525739b872476d server_cookie=cb527c6cfb871f8e in_seq=0 out_seq=0 2024-09-19T05:28:46.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.127+0000 7face97fa640 10 client.15552 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.129+0000 7face97fa640 1 -- 172.21.15.1:0/3705770605 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559024242890 con 0x5590242ec190 2024-09-19T05:28:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.129+0000 7face97fa640 10 client.15552 handle_command_reply: tid=0 2024-09-19T05:28:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.129+0000 7fad0a2a8740 1 client.15552 shutdown 2024-09-19T05:28:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 msgr2=0x5590242e7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7facf80406a0 tx=0x7facf803be20 comp rx=0 tx=0).stop 2024-09-19T05:28:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 shutdown_connections 2024-09-19T05:28:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d9470 0x5590242e7ba0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d1170 0x5590242d8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590242ec190 0x5590242ee630 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3705770605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d0850 0x5590242d89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.130+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 >> 172.21.15.1:0/3705770605 conn(0x5590242ccde0 msgr2=0x5590242d2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.131+0000 7face97fa640 0 client.15552 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.131+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 shutdown_connections 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.131+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3705770605 wait complete. 2024-09-19T05:28:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.131+0000 7fad0a2a8740 20 client.15552 trim_cache size 0 max 16384 2024-09-19T05:28:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.150+0000 7fad0a2a8740 1 Processor -- start 2024-09-19T05:28:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.150+0000 7fad0a2a8740 1 -- start start 2024-09-19T05:28:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.150+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d9470 0x5590242f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7face400dd50 con 0x5590242d0850 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7face40105d0 con 0x5590242d9470 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face400e3c0 con 0x5590242d1170 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:51688/0 (socket says 172.21.15.1:51688) 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 -- 172.21.15.1:0/3661657721 learned_addr learned my addr 172.21.15.1:0/3661657721 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad05c6b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50560/0 (socket says 172.21.15.1:50560) 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0646c640 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d9470 0x5590242f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 -- 172.21.15.1:0/3661657721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d9470 msgr2=0x5590242f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d9470 0x5590242f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 -- 172.21.15.1:0/3661657721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 msgr2=0x5590242d72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 -- 172.21.15.1:0/3661657721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590242d42f0 con 0x5590242d1170 2024-09-19T05:28:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.151+0000 7fad0546a640 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad00118150 tx=0x7facf0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f590edbb258f3714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7faceb7fe640 1 -- 172.21.15.1:0/3661657721 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0017070 con 0x5590242d1170 2024-09-19T05:28:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7faceb7fe640 1 -- 172.21.15.1:0/3661657721 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf000edf0 con 0x5590242d1170 2024-09-19T05:28:46.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7faceb7fe640 1 -- 172.21.15.1:0/3661657721 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf00123d0 con 0x5590242d1170 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3661657721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 msgr2=0x5590242e7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fad00118150 tx=0x7facf0009c60 comp rx=0 tx=0).stop 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3661657721 shutdown_connections 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d9470 0x5590242f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d1170 0x5590242e7990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/3661657721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d0850 0x5590242d72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3661657721 >> 172.21.15.1:0/3661657721 conn(0x5590242ccde0 msgr2=0x5590242cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.152+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3661657721 shutdown_connections 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 -- 172.21.15.1:0/3661657721 wait complete. 2024-09-19T05:28:46.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 -- start start 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 Processor -- start 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d0850 0x5590242e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d9470 0x5590242d5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7face400ea90 con 0x5590242d1170 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7face400ff00 con 0x5590242d0850 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7face400f160 con 0x5590242d9470 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0a2a8740 10 client.0 _ll_register_callbacks cb 0x7fad00110870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.153+0000 7fad0546a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50570/0 (socket says 172.21.15.1:50570) 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 -- 172.21.15.1:0/1451192447 learned_addr learned my addr 172.21.15.1:0/1451192447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0646c640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d9470 0x5590242d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad05c6b640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d0850 0x5590242e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 -- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d9470 msgr2=0x5590242d5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d9470 0x5590242d5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 -- 172.21.15.1:0/1451192447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d0850 msgr2=0x5590242e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d0850 0x5590242e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 -- 172.21.15.1:0/1451192447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590242d79a0 con 0x5590242d1170 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0546a640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7facf0000c00 tx=0x7facf0013df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0ef1b0cc003218 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7face97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0029060 con 0x5590242d1170 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7facf000eb20 con 0x5590242d1170 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf000edf0 con 0x5590242d1170 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7facf0030050 con 0x5590242d1170 2024-09-19T05:28:46.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0a2a8740 10 client.15558 fetch_fsmap learned FSMap version 21 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.154+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559024356bb0 con 0x5590242d1170 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf000edf0 con 0x5590242d1170 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7facf001cc00 con 0x5590242d1170 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 10 client.15558 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 10 client.15558 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 20 client.15558 populate_metadata read hostname 'smithi001' 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590243572e0 0x559024359700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 4 client.15558 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x55902423cbe0 con 0x5590243572e0 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7fad05c6b640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590243572e0 0x559024359700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.155+0000 7face97fa640 10 client.15558 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:46.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.156+0000 7fad05c6b640 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590243572e0 0x559024359700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c904d6e71561b275 server_cookie=93a7b4717fd2a04f in_seq=0 out_seq=0 2024-09-19T05:28:46.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7face97fa640 1 -- 172.21.15.1:0/1451192447 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55902423cbe0 con 0x5590243572e0 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7face97fa640 10 client.15558 handle_command_reply: tid=0 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 client.15558 shutdown 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 msgr2=0x5590242d55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7facf0000c00 tx=0x7facf0013df0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 shutdown_connections 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5590243572e0 0x559024359700 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590242d9470 0x5590242d5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5590242d1170 0x5590242d55b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7face97fa640 0 client.15558 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 --2- 172.21.15.1:0/1451192447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590242d0850 0x5590242e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.300+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 >> 172.21.15.1:0/1451192447 conn(0x5590242ccde0 msgr2=0x5590242cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 shutdown_connections 2024-09-19T05:28:46.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad0a2a8740 1 -- 172.21.15.1:0/1451192447 wait complete. 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad0a2a8740 20 client.15558 trim_cache size 0 max 16384 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 30, 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "cb5f94fe": { 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 30, 2024-09-19T05:28:46.305 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 145.8, 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:28:46.306 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:28:46.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 msgr2=0x7facec0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 0x7facec0a57c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7facf803be90 tx=0x7facf8040fa0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 msgr2=0x7fad0011a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7facfc00b4a0 tx=0x7facfc00b960 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 shutdown_connections 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facec0a3300 0x7facec0a57c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad0011b140 0x7fad00116e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad00109830 0x7fad00116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 --2- 172.21.15.1:0/2413034018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad00109450 0x7fad0011a860 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.301+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 >> 172.21.15.1:0/2413034018 conn(0x7fad0006e140 msgr2=0x7fad00070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.302+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 shutdown_connections 2024-09-19T05:28:46.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:28:46.302+0000 7fad07ecf640 1 -- 172.21.15.1:0/2413034018 wait complete. 2024-09-19T05:28:46.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.97 MB/sec execute 241 sec latency 133.657 ms 2024-09-19T05:28:47.013 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cb5f94fe', quiesce took 3.6 seconds. Will release after: 22.15 2024-09-19T05:28:47.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.93 MB/sec execute 242 sec latency 1116.359 ms 2024-09-19T05:28:47.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:47 smithi060 ceph-mon[35058]: pgmap v579: 129 pgs: 129 active+clean; 271 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.5 MiB/s wr, 117 op/s 2024-09-19T05:28:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:47 smithi082 ceph-mon[35195]: pgmap v579: 129 pgs: 129 active+clean; 271 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.5 MiB/s wr, 117 op/s 2024-09-19T05:28:47.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:47 smithi001 ceph-mon[30968]: pgmap v579: 129 pgs: 129 active+clean; 271 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.5 MiB/s wr, 117 op/s 2024-09-19T05:28:48.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.88 MB/sec execute 243 sec latency 2116.477 ms 2024-09-19T05:28:49.386 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.84 MB/sec execute 244 sec latency 3116.600 ms 2024-09-19T05:28:49.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:49 smithi060 ceph-mon[35058]: pgmap v580: 129 pgs: 129 active+clean; 258 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 2.8 MiB/s wr, 146 op/s 2024-09-19T05:28:49.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:49 smithi082 ceph-mon[35195]: pgmap v580: 129 pgs: 129 active+clean; 258 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 2.8 MiB/s wr, 146 op/s 2024-09-19T05:28:49.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:49 smithi001 ceph-mon[30968]: pgmap v580: 129 pgs: 129 active+clean; 258 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 2.8 MiB/s wr, 146 op/s 2024-09-19T05:28:50.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.79 MB/sec execute 245 sec latency 4116.693 ms 2024-09-19T05:28:51.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.75 MB/sec execute 246 sec latency 5116.821 ms 2024-09-19T05:28:51.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:51 smithi060 ceph-mon[35058]: pgmap v581: 129 pgs: 129 active+clean; 253 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-19T05:28:51.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:51 smithi082 ceph-mon[35195]: pgmap v581: 129 pgs: 129 active+clean; 253 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-19T05:28:51.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:51 smithi001 ceph-mon[30968]: pgmap v581: 129 pgs: 129 active+clean; 253 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.3 MiB/s wr, 125 op/s 2024-09-19T05:28:52.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.71 MB/sec execute 247 sec latency 6116.926 ms 2024-09-19T05:28:53.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.66 MB/sec execute 248 sec latency 7117.048 ms 2024-09-19T05:28:53.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:53 smithi060 ceph-mon[35058]: pgmap v582: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-19T05:28:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:53 smithi082 ceph-mon[35195]: pgmap v582: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-19T05:28:53.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:53 smithi001 ceph-mon[30968]: pgmap v582: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 169 op/s 2024-09-19T05:28:54.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.62 MB/sec execute 249 sec latency 8117.174 ms 2024-09-19T05:28:55.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.58 MB/sec execute 250 sec latency 9117.292 ms 2024-09-19T05:28:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:55 smithi060 ceph-mon[35058]: pgmap v583: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-19T05:28:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:55 smithi082 ceph-mon[35195]: pgmap v583: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-19T05:28:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:55 smithi001 ceph-mon[30968]: pgmap v583: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 142 op/s 2024-09-19T05:28:56.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.53 MB/sec execute 251 sec latency 10117.403 ms 2024-09-19T05:28:57.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.49 MB/sec execute 252 sec latency 11117.525 ms 2024-09-19T05:28:57.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:57 smithi060 ceph-mon[35058]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 138 op/s 2024-09-19T05:28:57.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:57 smithi082 ceph-mon[35195]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 138 op/s 2024-09-19T05:28:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:57 smithi001 ceph-mon[30968]: pgmap v584: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 138 op/s 2024-09-19T05:28:58.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.45 MB/sec execute 253 sec latency 12117.575 ms 2024-09-19T05:28:59.387 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.41 MB/sec execute 254 sec latency 13117.691 ms 2024-09-19T05:28:59.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:28:59 smithi060 ceph-mon[35058]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.6 MiB/s wr, 99 op/s 2024-09-19T05:28:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:28:59 smithi082 ceph-mon[35195]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.6 MiB/s wr, 99 op/s 2024-09-19T05:28:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:28:59 smithi001 ceph-mon[30968]: pgmap v585: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.6 MiB/s wr, 99 op/s 2024-09-19T05:29:00.388 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.37 MB/sec execute 255 sec latency 14117.821 ms 2024-09-19T05:29:01.388 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.33 MB/sec execute 256 sec latency 15117.932 ms 2024-09-19T05:29:01.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:01 smithi060 ceph-mon[35058]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 993 KiB/s wr, 58 op/s 2024-09-19T05:29:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:01 smithi082 ceph-mon[35195]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 993 KiB/s wr, 58 op/s 2024-09-19T05:29:01.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:01 smithi001 ceph-mon[30968]: pgmap v586: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 993 KiB/s wr, 58 op/s 2024-09-19T05:29:02.388 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.29 MB/sec execute 257 sec latency 16117.986 ms 2024-09-19T05:29:03.388 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.25 MB/sec execute 258 sec latency 17118.089 ms 2024-09-19T05:29:03.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:03 smithi060 ceph-mon[35058]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 890 KiB/s wr, 53 op/s 2024-09-19T05:29:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:03 smithi082 ceph-mon[35195]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 890 KiB/s wr, 53 op/s 2024-09-19T05:29:03.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:03 smithi001 ceph-mon[30968]: pgmap v587: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 890 KiB/s wr, 53 op/s 2024-09-19T05:29:04.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.21 MB/sec execute 259 sec latency 18118.649 ms 2024-09-19T05:29:05.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.17 MB/sec execute 260 sec latency 19118.746 ms 2024-09-19T05:29:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:05 smithi060 ceph-mon[35058]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-09-19T05:29:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:05 smithi082 ceph-mon[35195]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-09-19T05:29:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:05 smithi001 ceph-mon[30968]: pgmap v588: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-09-19T05:29:06.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.13 MB/sec execute 261 sec latency 20118.869 ms 2024-09-19T05:29:07.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.09 MB/sec execute 262 sec latency 21119.001 ms 2024-09-19T05:29:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:07 smithi060 ceph-mon[35058]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-09-19T05:29:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:07 smithi082 ceph-mon[35195]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-09-19T05:29:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:07 smithi001 ceph-mon[30968]: pgmap v589: 129 pgs: 129 active+clean; 245 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-09-19T05:29:08.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.05 MB/sec execute 263 sec latency 22119.097 ms 2024-09-19T05:29:09.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:29:09.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 10.02 MB/sec execute 264 sec latency 23119.166 ms 2024-09-19T05:29:09.434 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:09 smithi060 ceph-mon[35058]: pgmap v590: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 148 KiB/s wr, 9 op/s 2024-09-19T05:29:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:09 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:09 smithi082 ceph-mon[35195]: pgmap v590: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 148 KiB/s wr, 9 op/s 2024-09-19T05:29:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:09 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:09.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:09 smithi001 ceph-mon[30968]: pgmap v590: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 148 KiB/s wr, 9 op/s 2024-09-19T05:29:09.557 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:09 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 -- 172.21.15.1:0/3567402375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 msgr2=0x7f922410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 --2- 172.21.15.1:0/3567402375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f922410d950 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f921c009cd0 tx=0x7f921c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 -- 172.21.15.1:0/3567402375 shutdown_connections 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 --2- 172.21.15.1:0/3567402375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f922410d950 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 --2- 172.21.15.1:0/3567402375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 0x7f9224100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 --2- 172.21.15.1:0/3567402375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f9224106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 -- 172.21.15.1:0/3567402375 >> 172.21.15.1:0/3567402375 conn(0x7f92240fc7a0 msgr2=0x7f92240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 -- 172.21.15.1:0/3567402375 shutdown_connections 2024-09-19T05:29:09.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.919+0000 7f922ac35640 1 -- 172.21.15.1:0/3567402375 wait complete. 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 Processor -- start 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 -- start start 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 0x7f92241992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f92241a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9224110e80 con 0x7f9224101420 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9224110d00 con 0x7f9224106a80 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f922ac35640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111000 con 0x7f9224100a80 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f9223fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:09.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f9223fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44600/0 (socket says 172.21.15.1:44600) 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.920+0000 7f9223fff640 1 -- 172.21.15.1:0/1346734060 learned_addr learned my addr 172.21.15.1:0/1346734060 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f92289d1640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 0x7f92241992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f92291d2640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f92241a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 -- 172.21.15.1:0/1346734060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 msgr2=0x7f92241992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 0x7f92241992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 -- 172.21.15.1:0/1346734060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 msgr2=0x7f92241a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f92241a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 -- 172.21.15.1:0/1346734060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241a4870 con 0x7f9224101420 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f92291d2640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f92241a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:29:09.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9223fff640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f920c00d950 tx=0x7f920c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c017030 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92241a4a40 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f920c004020 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c0047a0 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.921+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a4f30 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.922+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224100ee0 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.924+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f920c0041d0 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.924+0000 7f9221ffb640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 0x7f92100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.925+0000 7f92289d1640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 0x7f92100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.925+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f920c0cf6a0 con 0x7f9224101420 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.925+0000 7f92289d1640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 0x7f92100a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9214005d00 tx=0x7f921400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:09.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:09.929+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f920c09c010 con 0x7f9224101420 2024-09-19T05:29:10.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.145+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9224108ff0 con 0x7f9224101420 2024-09-19T05:29:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.146+0000 7f9221ffb640 1 -- 172.21.15.1:0/1346734060 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f920c0860e0 con 0x7f9224101420 2024-09-19T05:29:10.148 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:29:10.148 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:29:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:29:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 msgr2=0x7f92100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 0x7f92100a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9214005d00 tx=0x7f921400b410 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 msgr2=0x7f92241997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f920c00d950 tx=0x7f920c00de10 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 shutdown_connections 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f92100a3240 0x7f92100a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9224106a80 0x7f92241a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9224101420 0x7f92241997f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 --2- 172.21.15.1:0/1346734060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9224100a80 0x7f92241992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.148+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 >> 172.21.15.1:0/1346734060 conn(0x7f92240fc7a0 msgr2=0x7f92240fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.149+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 shutdown_connections 2024-09-19T05:29:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:10.149+0000 7f922ac35640 1 -- 172.21.15.1:0/1346734060 wait complete. 2024-09-19T05:29:10.389 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 9.98 MB/sec execute 265 sec latency 24119.227 ms 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:29:10.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:10 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1346734060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:29:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:10.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:10.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:29:10.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:10 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1346734060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:10.578 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:29:10.579 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:10 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1346734060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:29:10.814 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id cb5f94fe --release --await' 2024-09-19T05:29:10.814 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id cb5f94fe --release --await 2024-09-19T05:29:11.078 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:11.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 760916 9.94 MB/sec execute 266 sec latency 25134.209 ms 2024-09-19T05:29:11.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- 172.21.15.1:0/940267958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64102dd0 msgr2=0x7efc641031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/940267958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64102dd0 0x7efc641031b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efc60009930 tx=0x7efc6002a440 comp rx=0 tx=0).stop 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- 172.21.15.1:0/940267958 shutdown_connections 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/940267958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64108300 0x7efc6410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/940267958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/940267958 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64102dd0 0x7efc641031b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- 172.21.15.1:0/940267958 >> 172.21.15.1:0/940267958 conn(0x7efc640fc7d0 msgr2=0x7efc640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- 172.21.15.1:0/940267958 shutdown_connections 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- 172.21.15.1:0/940267958 wait complete. 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 Processor -- start 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.577+0000 7efc6b5c0640 1 -- start start 2024-09-19T05:29:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 0x7efc64198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc64112170 con 0x7efc64108300 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc64111ff0 con 0x7efc64102dd0 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6b5c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc641122f0 con 0x7efc64103780 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44618/0 (socket says 172.21.15.1:44618) 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 -- 172.21.15.1:0/2889024962 learned_addr learned my addr 172.21.15.1:0/2889024962 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6935c640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 0x7efc64198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 -- 172.21.15.1:0/2889024962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 msgr2=0x7efc64198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 -- 172.21.15.1:0/2889024962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 msgr2=0x7efc64198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 0x7efc64198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 -- 172.21.15.1:0/2889024962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6419d6e0 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc6935c640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 0x7efc64198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc69b5d640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b970 tx=0x7efc5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.578+0000 7efc5a7fc640 1 -- 172.21.15.1:0/2889024962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c019070 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.579+0000 7efc5a7fc640 1 -- 172.21.15.1:0/2889024962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc5c00cb40 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.579+0000 7efc5a7fc640 1 -- 172.21.15.1:0/2889024962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c007650 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.579+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6419d9d0 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.579+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc641a52b0 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.581+0000 7efc5a7fc640 1 -- 172.21.15.1:0/2889024962 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7efc5c01c070 con 0x7efc64108300 2024-09-19T05:29:11.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.581+0000 7efc6d999740 1 Processor -- start 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.581+0000 7efc6d999740 1 -- start start 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d7b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 0x5598a5d8a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598a5ce0620 con 0x5598a5d8a650 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5598a5c87e50 con 0x5598a5d7af40 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6d999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5598a5cdc5e0 con 0x5598a5d7b860 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc5a7fc640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 0x7efc500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44622/0 (socket says 172.21.15.1:44622) 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 -- 172.21.15.1:0/3957839779 learned_addr learned my addr 172.21.15.1:0/3957839779 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6935c640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 0x5598a5d8a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc69b5d640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 0x7efc500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc5a7fc640 1 -- 172.21.15.1:0/2889024962 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7efc5c0cf350 con 0x7efc64108300 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d7b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 -- 172.21.15.1:0/3957839779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 msgr2=0x5598a5d8a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 0x5598a5d8a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 -- 172.21.15.1:0/3957839779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 msgr2=0x5598a5d7b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d7b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc68b5b640 1 -- 172.21.15.1:0/3957839779 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a5c78d40 con 0x5598a5d8a650 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.582+0000 7efc6935c640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 0x5598a5d8a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc69b5d640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 0x7efc500a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc5c09b4f0 tx=0x7efc5c065fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc68b5b640 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efc5400ae10 tx=0x7efc5400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1caf0183d8b865 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc4f7fe640 1 -- 172.21.15.1:0/3957839779 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5401c070 con 0x5598a5d8a650 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc4f7fe640 1 -- 172.21.15.1:0/3957839779 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc5400fd70 con 0x5598a5d8a650 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc4f7fe640 1 -- 172.21.15.1:0/3957839779 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc540147b0 con 0x5598a5d8a650 2024-09-19T05:29:11.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc6d999740 1 -- 172.21.15.1:0/3957839779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 msgr2=0x5598a5d8ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.583+0000 7efc6d999740 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7efc5400ae10 tx=0x7efc5400a4d0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 -- 172.21.15.1:0/3957839779 shutdown_connections 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d8ca40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7b860 0x5598a5d8a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 --2- 172.21.15.1:0/3957839779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d7b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 -- 172.21.15.1:0/3957839779 >> 172.21.15.1:0/3957839779 conn(0x5598a5d775f0 msgr2=0x5598a5d779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 -- 172.21.15.1:0/3957839779 shutdown_connections 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 -- 172.21.15.1:0/3957839779 wait complete. 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 -- start start 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.584+0000 7efc6d999740 1 Processor -- start 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7af40 0x5598a5d875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d87b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5598a5d8d220 con 0x5598a5d8a650 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5598a5c68f10 con 0x5598a5d7b860 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5598a5d8d3a0 con 0x5598a5d7af40 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 10 client.0 _ll_register_callbacks cb 0x5598a5c8cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44626/0 (socket says 172.21.15.1:44626) 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 -- 172.21.15.1:0/963038396 learned_addr learned my addr 172.21.15.1:0/963038396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6935c640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d87b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7af40 0x5598a5d875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 -- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7af40 msgr2=0x5598a5d875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7af40 0x5598a5d875e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 -- 172.21.15.1:0/963038396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 msgr2=0x5598a5d87b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d87b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 -- 172.21.15.1:0/963038396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a59ef580 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc68b5b640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efc54001eb0 tx=0x7efc540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ce7eff24adeb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54029060 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc5400fd70 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.585+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7efc54014ba0 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efc5401c070 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 10 client.15576 fetch_fsmap learned FSMap version 21 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5598a5ab9960 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc5400fd70 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efc54015040 con 0x5598a5d8a650 2024-09-19T05:29:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 10 client.15576 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 10 client.15576 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 20 client.15576 populate_metadata read hostname 'smithi001' 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5d9a190 0x5598a5d9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 4 client.15576 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598a5cedb90 con 0x5598a5d9a190 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.586+0000 7efc6935c640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5d9a190 0x5598a5d9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.587+0000 7efc6935c640 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5d9a190 0x5598a5d9c580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3be8509d35b8b3 server_cookie=ca38b824faa3899d in_seq=0 out_seq=0 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.587+0000 7efc4cff9640 10 client.15576 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc4cff9640 1 -- 172.21.15.1:0/963038396 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598a5cedb90 con 0x5598a5d9a190 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc4cff9640 10 client.15576 handle_command_reply: tid=0 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 client.15576 shutdown 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 msgr2=0x5598a5d88060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efc54001eb0 tx=0x7efc540046c0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 shutdown_connections 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d8a650 0x5598a5d88060 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d87b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5d9a190 0x5598a5d9c580 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 --2- 172.21.15.1:0/963038396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d7af40 0x5598a5d875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc4cff9640 0 client.15576 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 >> 172.21.15.1:0/963038396 conn(0x5598a5d775f0 msgr2=0x5598a5d7d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 shutdown_connections 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 1 -- 172.21.15.1:0/963038396 wait complete. 2024-09-19T05:29:11.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.588+0000 7efc6d999740 20 client.15576 trim_cache size 0 max 16384 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.605+0000 7efc6d999740 1 Processor -- start 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.605+0000 7efc6d999740 1 -- start start 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d95d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d84d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc641aac90 con 0x5598a5d7b860 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc641ad510 con 0x5598a5d7af40 2024-09-19T05:29:11.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6d999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc641ab300 con 0x5598a5d8a650 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44628/0 (socket says 172.21.15.1:44628) 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 -- 172.21.15.1:0/491670758 learned_addr learned my addr 172.21.15.1:0/491670758 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc68b5b640 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 -- 172.21.15.1:0/491670758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 msgr2=0x5598a5d84d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc68b5b640 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d84d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d84d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 -- 172.21.15.1:0/491670758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 msgr2=0x5598a5d95d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d95d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 -- 172.21.15.1:0/491670758 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598a5d72930 con 0x5598a5d7b860 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc6935c640 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efc60005c40 tx=0x7efc60031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baef4112777813c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc4effd640 1 -- 172.21.15.1:0/491670758 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60035040 con 0x5598a5d7b860 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc4effd640 1 -- 172.21.15.1:0/491670758 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc60005500 con 0x5598a5d7b860 2024-09-19T05:29:11.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.606+0000 7efc4effd640 1 -- 172.21.15.1:0/491670758 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600035f0 con 0x5598a5d7b860 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- 172.21.15.1:0/491670758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 msgr2=0x5598a5d84840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efc60005c40 tx=0x7efc60031b60 comp rx=0 tx=0).stop 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- 172.21.15.1:0/491670758 shutdown_connections 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d84d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7b860 0x5598a5d84840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 --2- 172.21.15.1:0/491670758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7af40 0x5598a5d95d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- 172.21.15.1:0/491670758 >> 172.21.15.1:0/491670758 conn(0x5598a5d775f0 msgr2=0x5598a5d95630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- 172.21.15.1:0/491670758 shutdown_connections 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- 172.21.15.1:0/491670758 wait complete. 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 -- start start 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.607+0000 7efc6d999740 1 Processor -- start 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d9d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d9def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc641ab9d0 con 0x5598a5d7af40 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc641ace40 con 0x5598a5d7b860 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc641ac0a0 con 0x5598a5d8a650 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6d999740 10 client.0 _ll_register_callbacks cb 0x7efc5400ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44632/0 (socket says 172.21.15.1:44632) 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 -- 172.21.15.1:0/2005731904 learned_addr learned my addr 172.21.15.1:0/2005731904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc6935c640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d9d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d9def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 -- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 msgr2=0x5598a5d9def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d9def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 -- 172.21.15.1:0/2005731904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 msgr2=0x5598a5d9d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d9d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.608+0000 7efc68b5b640 1 -- 172.21.15.1:0/2005731904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598a5d7b690 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc68b5b640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efc54004810 tx=0x7efc54014490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9986b6d450f4e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54029040 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7efc5400a450 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc60005500 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efc54024c20 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 10 client.15582 fetch_fsmap learned FSMap version 21 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5598a5e04d20 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc60005500 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efc540179c0 con 0x5598a5d7af40 2024-09-19T05:29:11.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 10 client.15582 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 10 client.15582 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 20 client.15582 populate_metadata read hostname 'smithi001' 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5e052e0 0x5598a5e07700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 4 client.15582 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cb5f94fe", "release": true, "await": true}] 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.609+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cb5f94fe", "release": true, "await": true}) -- 0x5598a5ce80a0 con 0x5598a5e052e0 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.610+0000 7efc6935c640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5e052e0 0x5598a5e07700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.610+0000 7efc6935c640 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5e052e0 0x5598a5e07700 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78de795e486c350b server_cookie=c4a30bdec637a401 in_seq=0 out_seq=0 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.610+0000 7efc4cff9640 10 client.15582 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc4cff9640 1 -- 172.21.15.1:0/2005731904 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5598a5ce80a0 con 0x5598a5e052e0 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc4cff9640 10 client.15582 handle_command_reply: tid=0 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 client.15582 shutdown 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 msgr2=0x5598a5d9d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efc54004810 tx=0x7efc54014490 comp rx=0 tx=0).stop 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 shutdown_connections 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5598a5e052e0 0x5598a5e07700 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5598a5d8a650 0x5598a5d9def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598a5d7b860 0x5598a5d9d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 --2- 172.21.15.1:0/2005731904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5598a5d7af40 0x5598a5d9d470 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 >> 172.21.15.1:0/2005731904 conn(0x5598a5d775f0 msgr2=0x5598a5d76750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc4cff9640 0 client.15582 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 shutdown_connections 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 1 -- 172.21.15.1:0/2005731904 wait complete. 2024-09-19T05:29:11.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.618+0000 7efc6d999740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 32, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "cb5f94fe": { 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 32, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:29:11.627 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 145.8, 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:29:11.628 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 msgr2=0x7efc500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 0x7efc500a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc5c09b4f0 tx=0x7efc5c065fa0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 msgr2=0x7efc6419d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00b970 tx=0x7efc5c00be30 comp rx=0 tx=0).stop 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 shutdown_connections 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7efc500a32c0 0x7efc500a5780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc64108300 0x7efc6419d000 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc64103780 0x7efc64198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 --2- 172.21.15.1:0/2889024962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc64102dd0 0x7efc64198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:11.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 >> 172.21.15.1:0/2889024962 conn(0x7efc640fc7d0 msgr2=0x7efc64105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:11.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 shutdown_connections 2024-09-19T05:29:11.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:29:11.619+0000 7efc6b5c0640 1 -- 172.21.15.1:0/2889024962 wait complete. 2024-09-19T05:29:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:11 smithi001 ceph-mon[30968]: pgmap v591: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 217 KiB/s wr, 6 op/s 2024-09-19T05:29:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:11 smithi060 ceph-mon[35058]: pgmap v591: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 217 KiB/s wr, 6 op/s 2024-09-19T05:29:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:11 smithi082 ceph-mon[35195]: pgmap v591: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 217 KiB/s wr, 6 op/s 2024-09-19T05:29:12.338 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cb5f94fe', total seconds elapsed: 29.0 2024-09-19T05:29:12.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 763644 9.97 MB/sec execute 267 sec latency 25345.412 ms 2024-09-19T05:29:13.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 766772 9.98 MB/sec execute 268 sec latency 18.030 ms 2024-09-19T05:29:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:13 smithi001 ceph-mon[30968]: pgmap v592: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 807 KiB/s wr, 25 op/s 2024-09-19T05:29:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:13 smithi060 ceph-mon[35058]: pgmap v592: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 807 KiB/s wr, 25 op/s 2024-09-19T05:29:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:13 smithi082 ceph-mon[35195]: pgmap v592: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 807 KiB/s wr, 25 op/s 2024-09-19T05:29:14.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 769853 10.01 MB/sec execute 269 sec latency 28.131 ms 2024-09-19T05:29:15.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 772640 10.02 MB/sec execute 270 sec latency 18.943 ms 2024-09-19T05:29:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:15 smithi001 ceph-mon[30968]: pgmap v593: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 896 KiB/s wr, 43 op/s 2024-09-19T05:29:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:15 smithi060 ceph-mon[35058]: pgmap v593: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 896 KiB/s wr, 43 op/s 2024-09-19T05:29:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:15 smithi082 ceph-mon[35195]: pgmap v593: 129 pgs: 129 active+clean; 244 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 896 KiB/s wr, 43 op/s 2024-09-19T05:29:16.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 775697 10.05 MB/sec execute 271 sec latency 20.299 ms 2024-09-19T05:29:17.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 778694 10.07 MB/sec execute 272 sec latency 13.109 ms 2024-09-19T05:29:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:17 smithi001 ceph-mon[30968]: pgmap v594: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-19T05:29:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:17 smithi060 ceph-mon[35058]: pgmap v594: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-19T05:29:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:17 smithi082 ceph-mon[35195]: pgmap v594: 129 pgs: 129 active+clean; 246 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-09-19T05:29:18.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 781941 10.10 MB/sec execute 273 sec latency 28.070 ms 2024-09-19T05:29:19.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 785342 10.13 MB/sec execute 274 sec latency 18.192 ms 2024-09-19T05:29:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:19 smithi001 ceph-mon[30968]: pgmap v595: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 120 op/s 2024-09-19T05:29:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:19 smithi060 ceph-mon[35058]: pgmap v595: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 120 op/s 2024-09-19T05:29:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:19 smithi082 ceph-mon[35195]: pgmap v595: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 120 op/s 2024-09-19T05:29:20.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 788645 10.16 MB/sec execute 275 sec latency 21.122 ms 2024-09-19T05:29:21.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 792008 10.20 MB/sec execute 276 sec latency 20.581 ms 2024-09-19T05:29:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:21 smithi001 ceph-mon[30968]: pgmap v596: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2024-09-19T05:29:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:21 smithi060 ceph-mon[35058]: pgmap v596: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2024-09-19T05:29:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:21 smithi082 ceph-mon[35195]: pgmap v596: 129 pgs: 129 active+clean; 250 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.4 MiB/s wr, 117 op/s 2024-09-19T05:29:22.404 INFO:tasks.workunit.client.0.smithi001.stdout: 1 795298 10.22 MB/sec execute 277 sec latency 27.890 ms 2024-09-19T05:29:23.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 798235 10.24 MB/sec execute 278 sec latency 25.809 ms 2024-09-19T05:29:23.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:23 smithi082 ceph-mon[35195]: pgmap v597: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-09-19T05:29:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:23 smithi001 ceph-mon[30968]: pgmap v597: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-09-19T05:29:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:23 smithi060 ceph-mon[35058]: pgmap v597: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-09-19T05:29:24.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 801002 10.24 MB/sec execute 279 sec latency 25.241 ms 2024-09-19T05:29:25.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 803846 10.27 MB/sec execute 280 sec latency 12.538 ms 2024-09-19T05:29:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:25 smithi001 ceph-mon[30968]: pgmap v598: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.5 MiB/s wr, 199 op/s 2024-09-19T05:29:26.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:25 smithi060 ceph-mon[35058]: pgmap v598: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.5 MiB/s wr, 199 op/s 2024-09-19T05:29:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:25 smithi082 ceph-mon[35195]: pgmap v598: 129 pgs: 129 active+clean; 257 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.5 MiB/s wr, 199 op/s 2024-09-19T05:29:26.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 806933 10.29 MB/sec execute 281 sec latency 13.789 ms 2024-09-19T05:29:27.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 810246 10.32 MB/sec execute 282 sec latency 19.007 ms 2024-09-19T05:29:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:27 smithi001 ceph-mon[30968]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T05:29:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:27 smithi060 ceph-mon[35058]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T05:29:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:27 smithi082 ceph-mon[35195]: pgmap v599: 129 pgs: 129 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 192 op/s 2024-09-19T05:29:28.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 813664 10.35 MB/sec execute 283 sec latency 25.362 ms 2024-09-19T05:29:29.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 816985 10.38 MB/sec execute 284 sec latency 11.702 ms 2024-09-19T05:29:29.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:29 smithi001 ceph-mon[30968]: pgmap v600: 129 pgs: 129 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-19T05:29:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:29 smithi060 ceph-mon[35058]: pgmap v600: 129 pgs: 129 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-19T05:29:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:29 smithi082 ceph-mon[35195]: pgmap v600: 129 pgs: 129 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.8 MiB/s wr, 242 op/s 2024-09-19T05:29:30.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 820505 10.41 MB/sec execute 285 sec latency 18.632 ms 2024-09-19T05:29:31.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 823984 10.44 MB/sec execute 286 sec latency 16.104 ms 2024-09-19T05:29:31.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:31 smithi001 ceph-mon[30968]: pgmap v601: 129 pgs: 129 active+clean; 264 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 182 op/s 2024-09-19T05:29:32.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:31 smithi060 ceph-mon[35058]: pgmap v601: 129 pgs: 129 active+clean; 264 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 182 op/s 2024-09-19T05:29:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:31 smithi082 ceph-mon[35195]: pgmap v601: 129 pgs: 129 active+clean; 264 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 182 op/s 2024-09-19T05:29:32.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 827438 10.47 MB/sec execute 287 sec latency 27.018 ms 2024-09-19T05:29:33.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 830754 10.50 MB/sec execute 288 sec latency 28.497 ms 2024-09-19T05:29:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:33 smithi001 ceph-mon[30968]: pgmap v602: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2024-09-19T05:29:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:33 smithi060 ceph-mon[35058]: pgmap v602: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2024-09-19T05:29:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:33 smithi082 ceph-mon[35195]: pgmap v602: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2024-09-19T05:29:34.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 833963 10.51 MB/sec execute 289 sec latency 21.962 ms 2024-09-19T05:29:35.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 837258 10.54 MB/sec execute 290 sec latency 19.378 ms 2024-09-19T05:29:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:35 smithi001 ceph-mon[30968]: pgmap v603: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 181 op/s 2024-09-19T05:29:36.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:35 smithi060 ceph-mon[35058]: pgmap v603: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 181 op/s 2024-09-19T05:29:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:35 smithi082 ceph-mon[35195]: pgmap v603: 129 pgs: 129 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 181 op/s 2024-09-19T05:29:36.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 840349 10.55 MB/sec execute 291 sec latency 34.399 ms 2024-09-19T05:29:37.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 843340 10.57 MB/sec execute 292 sec latency 19.359 ms 2024-09-19T05:29:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:37 smithi001 ceph-mon[30968]: pgmap v604: 129 pgs: 129 active+clean; 275 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 248 op/s 2024-09-19T05:29:38.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:37 smithi060 ceph-mon[35058]: pgmap v604: 129 pgs: 129 active+clean; 275 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 248 op/s 2024-09-19T05:29:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:37 smithi082 ceph-mon[35195]: pgmap v604: 129 pgs: 129 active+clean; 275 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.0 MiB/s wr, 248 op/s 2024-09-19T05:29:38.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 846430 10.60 MB/sec execute 293 sec latency 22.518 ms 2024-09-19T05:29:39.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 849478 10.62 MB/sec execute 294 sec latency 11.841 ms 2024-09-19T05:29:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:39 smithi001 ceph-mon[30968]: pgmap v605: 129 pgs: 129 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T05:29:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:39 smithi060 ceph-mon[35058]: pgmap v605: 129 pgs: 129 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T05:29:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:39 smithi082 ceph-mon[35195]: pgmap v605: 129 pgs: 129 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.2 MiB/s wr, 294 op/s 2024-09-19T05:29:40.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 852809 10.64 MB/sec execute 295 sec latency 18.136 ms 2024-09-19T05:29:41.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 856073 10.67 MB/sec execute 296 sec latency 27.741 ms 2024-09-19T05:29:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:41 smithi001 ceph-mon[30968]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-19T05:29:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:41 smithi060 ceph-mon[35058]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-19T05:29:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:41 smithi082 ceph-mon[35195]: pgmap v606: 129 pgs: 129 active+clean; 263 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 233 op/s 2024-09-19T05:29:42.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 859331 10.69 MB/sec execute 297 sec latency 19.478 ms 2024-09-19T05:29:43.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 862183 10.71 MB/sec execute 298 sec latency 41.626 ms 2024-09-19T05:29:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:43 smithi001 ceph-mon[30968]: pgmap v607: 129 pgs: 129 active+clean; 260 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 297 op/s 2024-09-19T05:29:44.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:43 smithi060 ceph-mon[35058]: pgmap v607: 129 pgs: 129 active+clean; 260 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 297 op/s 2024-09-19T05:29:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:43 smithi082 ceph-mon[35195]: pgmap v607: 129 pgs: 129 active+clean; 260 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.3 MiB/s wr, 297 op/s 2024-09-19T05:29:44.405 INFO:tasks.workunit.client.0.smithi001.stdout: 1 865212 10.72 MB/sec execute 299 sec latency 29.294 ms 2024-09-19T05:29:45.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 868139 10.74 MB/sec execute 300 sec latency 20.171 ms 2024-09-19T05:29:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:45 smithi001 ceph-mon[30968]: pgmap v608: 129 pgs: 129 active+clean; 261 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-19T05:29:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:45 smithi060 ceph-mon[35058]: pgmap v608: 129 pgs: 129 active+clean; 261 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-19T05:29:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:45 smithi082 ceph-mon[35195]: pgmap v608: 129 pgs: 129 active+clean; 261 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.6 MiB/s wr, 214 op/s 2024-09-19T05:29:46.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 870990 10.75 MB/sec execute 301 sec latency 15.086 ms 2024-09-19T05:29:47.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 874068 10.78 MB/sec execute 302 sec latency 28.374 ms 2024-09-19T05:29:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:47 smithi001 ceph-mon[30968]: pgmap v609: 129 pgs: 129 active+clean; 266 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-19T05:29:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:47 smithi060 ceph-mon[35058]: pgmap v609: 129 pgs: 129 active+clean; 266 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-19T05:29:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:47 smithi082 ceph-mon[35195]: pgmap v609: 129 pgs: 129 active+clean; 266 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-19T05:29:48.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 876920 10.80 MB/sec execute 303 sec latency 89.678 ms 2024-09-19T05:29:49.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 879805 10.80 MB/sec execute 304 sec latency 24.040 ms 2024-09-19T05:29:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:49 smithi001 ceph-mon[30968]: pgmap v610: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 240 op/s 2024-09-19T05:29:50.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:49 smithi060 ceph-mon[35058]: pgmap v610: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 240 op/s 2024-09-19T05:29:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:49 smithi082 ceph-mon[35195]: pgmap v610: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 240 op/s 2024-09-19T05:29:50.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 882894 10.82 MB/sec execute 305 sec latency 24.243 ms 2024-09-19T05:29:51.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 885452 10.84 MB/sec execute 306 sec latency 23.648 ms 2024-09-19T05:29:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:51 smithi001 ceph-mon[30968]: pgmap v611: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 193 op/s 2024-09-19T05:29:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:51 smithi060 ceph-mon[35058]: pgmap v611: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 193 op/s 2024-09-19T05:29:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:51 smithi082 ceph-mon[35195]: pgmap v611: 129 pgs: 129 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 193 op/s 2024-09-19T05:29:52.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 888730 10.86 MB/sec execute 307 sec latency 32.950 ms 2024-09-19T05:29:53.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 891472 10.88 MB/sec execute 308 sec latency 60.190 ms 2024-09-19T05:29:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:53 smithi001 ceph-mon[30968]: pgmap v612: 129 pgs: 129 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-09-19T05:29:54.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:53 smithi060 ceph-mon[35058]: pgmap v612: 129 pgs: 129 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-09-19T05:29:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:53 smithi082 ceph-mon[35195]: pgmap v612: 129 pgs: 129 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-09-19T05:29:54.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 894792 10.90 MB/sec execute 309 sec latency 24.775 ms 2024-09-19T05:29:55.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 897831 10.91 MB/sec execute 310 sec latency 18.217 ms 2024-09-19T05:29:55.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:55 smithi001 ceph-mon[30968]: pgmap v613: 129 pgs: 129 active+clean; 273 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-19T05:29:56.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:55 smithi060 ceph-mon[35058]: pgmap v613: 129 pgs: 129 active+clean; 273 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-19T05:29:56.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:55 smithi082 ceph-mon[35195]: pgmap v613: 129 pgs: 129 active+clean; 273 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 248 op/s 2024-09-19T05:29:56.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 900770 10.92 MB/sec execute 311 sec latency 18.361 ms 2024-09-19T05:29:57.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 903453 10.94 MB/sec execute 312 sec latency 24.802 ms 2024-09-19T05:29:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:57 smithi001 ceph-mon[30968]: pgmap v614: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 348 op/s 2024-09-19T05:29:58.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:57 smithi060 ceph-mon[35058]: pgmap v614: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 348 op/s 2024-09-19T05:29:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:57 smithi082 ceph-mon[35195]: pgmap v614: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 348 op/s 2024-09-19T05:29:58.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 905831 10.95 MB/sec execute 313 sec latency 90.737 ms 2024-09-19T05:29:59.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 909064 10.97 MB/sec execute 314 sec latency 58.272 ms 2024-09-19T05:29:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:29:59 smithi001 ceph-mon[30968]: pgmap v615: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:00.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:29:59 smithi060 ceph-mon[35058]: pgmap v615: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:29:59 smithi082 ceph-mon[35195]: pgmap v615: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:00.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 912374 10.99 MB/sec execute 315 sec latency 73.384 ms 2024-09-19T05:30:01.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:00 smithi060 ceph-mon[35058]: overall HEALTH_OK 2024-09-19T05:30:01.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:00 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:30:01.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:00 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:30:01.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 915403 11.00 MB/sec execute 316 sec latency 25.459 ms 2024-09-19T05:30:01.992 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:01 smithi001 ceph-mon[30968]: pgmap v616: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:01 smithi060 ceph-mon[35058]: pgmap v616: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:01 smithi082 ceph-mon[35195]: pgmap v616: 129 pgs: 129 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 297 op/s 2024-09-19T05:30:02.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 917588 11.06 MB/sec execute 317 sec latency 37.347 ms 2024-09-19T05:30:03.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 920532 11.08 MB/sec execute 318 sec latency 51.216 ms 2024-09-19T05:30:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:03 smithi060 ceph-mon[35058]: pgmap v617: 129 pgs: 129 active+clean; 282 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 364 op/s 2024-09-19T05:30:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:03 smithi082 ceph-mon[35195]: pgmap v617: 129 pgs: 129 active+clean; 282 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 364 op/s 2024-09-19T05:30:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:03 smithi001 ceph-mon[30968]: pgmap v617: 129 pgs: 129 active+clean; 282 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 364 op/s 2024-09-19T05:30:04.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 923897 11.10 MB/sec execute 319 sec latency 57.772 ms 2024-09-19T05:30:05.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 927092 11.12 MB/sec execute 320 sec latency 147.504 ms 2024-09-19T05:30:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:05 smithi060 ceph-mon[35058]: pgmap v618: 129 pgs: 129 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 261 op/s 2024-09-19T05:30:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:05 smithi082 ceph-mon[35195]: pgmap v618: 129 pgs: 129 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 261 op/s 2024-09-19T05:30:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:05 smithi001 ceph-mon[30968]: pgmap v618: 129 pgs: 129 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 261 op/s 2024-09-19T05:30:06.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 930322 11.14 MB/sec execute 321 sec latency 22.945 ms 2024-09-19T05:30:07.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 933849 11.16 MB/sec execute 322 sec latency 15.514 ms 2024-09-19T05:30:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:07 smithi060 ceph-mon[35058]: pgmap v619: 129 pgs: 129 active+clean; 276 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 342 op/s 2024-09-19T05:30:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:07 smithi082 ceph-mon[35195]: pgmap v619: 129 pgs: 129 active+clean; 276 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 342 op/s 2024-09-19T05:30:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:07 smithi001 ceph-mon[30968]: pgmap v619: 129 pgs: 129 active+clean; 276 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 342 op/s 2024-09-19T05:30:08.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 935614 11.15 MB/sec execute 323 sec latency 87.146 ms 2024-09-19T05:30:09.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 938689 11.17 MB/sec execute 324 sec latency 23.017 ms 2024-09-19T05:30:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:09 smithi060 ceph-mon[35058]: pgmap v620: 129 pgs: 129 active+clean; 266 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 308 op/s 2024-09-19T05:30:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:09 smithi082 ceph-mon[35195]: pgmap v620: 129 pgs: 129 active+clean; 266 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 308 op/s 2024-09-19T05:30:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:09 smithi001 ceph-mon[30968]: pgmap v620: 129 pgs: 129 active+clean; 266 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 308 op/s 2024-09-19T05:30:10.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 941888 11.19 MB/sec execute 325 sec latency 7.286 ms 2024-09-19T05:30:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:30:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:30:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:30:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:30:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:30:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:30:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:30:11.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:30:11.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:30:11.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:30:11.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:30:11.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:30:11.406 INFO:tasks.workunit.client.0.smithi001.stdout: 1 945047 11.21 MB/sec execute 326 sec latency 21.426 ms 2024-09-19T05:30:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:11 smithi060 ceph-mon[35058]: pgmap v621: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 288 op/s 2024-09-19T05:30:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:11 smithi082 ceph-mon[35195]: pgmap v621: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 288 op/s 2024-09-19T05:30:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:11 smithi001 ceph-mon[30968]: pgmap v621: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 288 op/s 2024-09-19T05:30:12.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 947686 11.21 MB/sec execute 327 sec latency 37.705 ms 2024-09-19T05:30:13.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 949596 11.21 MB/sec execute 328 sec latency 115.719 ms 2024-09-19T05:30:14.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:13 smithi060 ceph-mon[35058]: pgmap v622: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-19T05:30:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:13 smithi082 ceph-mon[35195]: pgmap v622: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-19T05:30:14.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:13 smithi001 ceph-mon[30968]: pgmap v622: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 363 op/s 2024-09-19T05:30:14.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 952884 11.23 MB/sec execute 329 sec latency 17.926 ms 2024-09-19T05:30:15.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 956246 11.26 MB/sec execute 330 sec latency 8.621 ms 2024-09-19T05:30:16.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:15 smithi060 ceph-mon[35058]: pgmap v623: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2024-09-19T05:30:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:15 smithi082 ceph-mon[35195]: pgmap v623: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2024-09-19T05:30:16.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:15 smithi001 ceph-mon[30968]: pgmap v623: 129 pgs: 129 active+clean; 250 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 298 op/s 2024-09-19T05:30:16.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 959427 11.28 MB/sec execute 331 sec latency 28.158 ms 2024-09-19T05:30:17.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 962674 11.29 MB/sec execute 332 sec latency 17.000 ms 2024-09-19T05:30:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:17 smithi060 ceph-mon[35058]: pgmap v624: 129 pgs: 129 active+clean; 247 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-19T05:30:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:17 smithi082 ceph-mon[35195]: pgmap v624: 129 pgs: 129 active+clean; 247 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-19T05:30:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:17 smithi001 ceph-mon[30968]: pgmap v624: 129 pgs: 129 active+clean; 247 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-19T05:30:18.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 965276 11.29 MB/sec execute 333 sec latency 62.541 ms 2024-09-19T05:30:19.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 968154 11.31 MB/sec execute 334 sec latency 70.994 ms 2024-09-19T05:30:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:19 smithi060 ceph-mon[35058]: pgmap v625: 129 pgs: 129 active+clean; 251 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-09-19T05:30:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:19 smithi082 ceph-mon[35195]: pgmap v625: 129 pgs: 129 active+clean; 251 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-09-19T05:30:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:19 smithi001 ceph-mon[30968]: pgmap v625: 129 pgs: 129 active+clean; 251 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-09-19T05:30:20.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 971562 11.33 MB/sec execute 335 sec latency 17.720 ms 2024-09-19T05:30:21.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 974604 11.35 MB/sec execute 336 sec latency 27.614 ms 2024-09-19T05:30:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:21 smithi060 ceph-mon[35058]: pgmap v626: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-09-19T05:30:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:21 smithi082 ceph-mon[35195]: pgmap v626: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-09-19T05:30:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:21 smithi001 ceph-mon[30968]: pgmap v626: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-09-19T05:30:22.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 977817 11.37 MB/sec execute 337 sec latency 22.146 ms 2024-09-19T05:30:23.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 981025 11.39 MB/sec execute 338 sec latency 95.004 ms 2024-09-19T05:30:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:23 smithi060 ceph-mon[35058]: pgmap v627: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 334 op/s 2024-09-19T05:30:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:23 smithi082 ceph-mon[35195]: pgmap v627: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 334 op/s 2024-09-19T05:30:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:23 smithi001 ceph-mon[30968]: pgmap v627: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.7 MiB/s wr, 334 op/s 2024-09-19T05:30:24.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 984385 11.41 MB/sec execute 339 sec latency 43.227 ms 2024-09-19T05:30:25.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 987616 11.43 MB/sec execute 340 sec latency 19.370 ms 2024-09-19T05:30:26.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:25 smithi060 ceph-mon[35058]: pgmap v628: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-09-19T05:30:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:25 smithi082 ceph-mon[35195]: pgmap v628: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-09-19T05:30:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:25 smithi001 ceph-mon[30968]: pgmap v628: 129 pgs: 129 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 3.8 MiB/s wr, 253 op/s 2024-09-19T05:30:26.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 990674 11.44 MB/sec execute 341 sec latency 28.398 ms 2024-09-19T05:30:27.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 994148 11.46 MB/sec execute 342 sec latency 22.147 ms 2024-09-19T05:30:28.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:27 smithi060 ceph-mon[35058]: pgmap v629: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-09-19T05:30:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:27 smithi082 ceph-mon[35195]: pgmap v629: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-09-19T05:30:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:27 smithi001 ceph-mon[30968]: pgmap v629: 129 pgs: 129 active+clean; 254 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 4.4 MiB/s wr, 302 op/s 2024-09-19T05:30:28.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 997336 11.47 MB/sec execute 343 sec latency 12.450 ms 2024-09-19T05:30:29.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 999544 11.47 MB/sec execute 344 sec latency 73.144 ms 2024-09-19T05:30:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:29 smithi060 ceph-mon[35058]: pgmap v630: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-09-19T05:30:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:29 smithi082 ceph-mon[35195]: pgmap v630: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-09-19T05:30:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:29 smithi001 ceph-mon[30968]: pgmap v630: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 346 op/s 2024-09-19T05:30:30.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1002645 11.49 MB/sec execute 345 sec latency 28.776 ms 2024-09-19T05:30:31.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1006074 11.51 MB/sec execute 346 sec latency 18.569 ms 2024-09-19T05:30:31.894 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:31 smithi001 ceph-mon[30968]: pgmap v631: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 4.1 MiB/s wr, 270 op/s 2024-09-19T05:30:32.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:31 smithi060 ceph-mon[35058]: pgmap v631: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 4.1 MiB/s wr, 270 op/s 2024-09-19T05:30:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:31 smithi082 ceph-mon[35195]: pgmap v631: 129 pgs: 129 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 4.1 MiB/s wr, 270 op/s 2024-09-19T05:30:32.407 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1009397 11.53 MB/sec execute 347 sec latency 41.676 ms 2024-09-19T05:30:33.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1012824 11.55 MB/sec execute 348 sec latency 19.995 ms 2024-09-19T05:30:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:33 smithi060 ceph-mon[35058]: pgmap v632: 129 pgs: 129 active+clean; 262 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-09-19T05:30:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:33 smithi082 ceph-mon[35195]: pgmap v632: 129 pgs: 129 active+clean; 262 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-09-19T05:30:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:33 smithi001 ceph-mon[30968]: pgmap v632: 129 pgs: 129 active+clean; 262 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 4.3 MiB/s wr, 285 op/s 2024-09-19T05:30:34.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1014940 11.54 MB/sec execute 349 sec latency 65.971 ms 2024-09-19T05:30:35.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1016963 11.55 MB/sec execute 350 sec latency 67.293 ms 2024-09-19T05:30:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:35 smithi060 ceph-mon[35058]: pgmap v633: 129 pgs: 129 active+clean; 258 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-19T05:30:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:35 smithi082 ceph-mon[35195]: pgmap v633: 129 pgs: 129 active+clean; 258 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-19T05:30:36.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:35 smithi001 ceph-mon[30968]: pgmap v633: 129 pgs: 129 active+clean; 258 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-19T05:30:36.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1020274 11.57 MB/sec execute 351 sec latency 22.411 ms 2024-09-19T05:30:37.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1023566 11.59 MB/sec execute 352 sec latency 8.522 ms 2024-09-19T05:30:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:37 smithi060 ceph-mon[35058]: pgmap v634: 129 pgs: 129 active+clean; 253 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:30:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:37 smithi082 ceph-mon[35195]: pgmap v634: 129 pgs: 129 active+clean; 253 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:30:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:37 smithi001 ceph-mon[30968]: pgmap v634: 129 pgs: 129 active+clean; 253 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:30:38.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1026668 11.60 MB/sec execute 353 sec latency 39.380 ms 2024-09-19T05:30:39.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1029123 11.60 MB/sec execute 354 sec latency 61.012 ms 2024-09-19T05:30:40.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:39 smithi060 ceph-mon[35058]: pgmap v635: 129 pgs: 129 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:30:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:39 smithi082 ceph-mon[35195]: pgmap v635: 129 pgs: 129 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:30:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:39 smithi001 ceph-mon[30968]: pgmap v635: 129 pgs: 129 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:30:40.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1031464 11.60 MB/sec execute 355 sec latency 37.381 ms 2024-09-19T05:30:41.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1034529 11.62 MB/sec execute 356 sec latency 23.834 ms 2024-09-19T05:30:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:41 smithi060 ceph-mon[35058]: pgmap v636: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-09-19T05:30:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:41 smithi082 ceph-mon[35195]: pgmap v636: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-09-19T05:30:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:41 smithi001 ceph-mon[30968]: pgmap v636: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.6 MiB/s wr, 314 op/s 2024-09-19T05:30:42.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1037895 11.64 MB/sec execute 357 sec latency 16.091 ms 2024-09-19T05:30:43.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1041236 11.66 MB/sec execute 358 sec latency 13.322 ms 2024-09-19T05:30:44.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:43 smithi060 ceph-mon[35058]: pgmap v637: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2024-09-19T05:30:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:43 smithi082 ceph-mon[35195]: pgmap v637: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2024-09-19T05:30:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:43 smithi001 ceph-mon[30968]: pgmap v637: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 324 op/s 2024-09-19T05:30:44.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1044167 11.67 MB/sec execute 359 sec latency 84.601 ms 2024-09-19T05:30:45.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1046805 11.67 MB/sec execute 360 sec latency 37.426 ms 2024-09-19T05:30:46.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:45 smithi060 ceph-mon[35058]: pgmap v638: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2024-09-19T05:30:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:45 smithi082 ceph-mon[35195]: pgmap v638: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2024-09-19T05:30:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:45 smithi001 ceph-mon[30968]: pgmap v638: 129 pgs: 129 active+clean; 266 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 264 op/s 2024-09-19T05:30:46.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1049573 11.68 MB/sec execute 361 sec latency 24.173 ms 2024-09-19T05:30:47.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1052616 11.69 MB/sec execute 362 sec latency 26.048 ms 2024-09-19T05:30:47.982 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:30:47.982 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T05:30:47.983 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:30:48.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:47 smithi060 ceph-mon[35058]: pgmap v639: 129 pgs: 129 active+clean; 269 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 321 op/s 2024-09-19T05:30:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:47 smithi082 ceph-mon[35195]: pgmap v639: 129 pgs: 129 active+clean; 269 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 321 op/s 2024-09-19T05:30:48.008 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:47 smithi001 ceph-mon[30968]: pgmap v639: 129 pgs: 129 active+clean; 269 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.9 MiB/s wr, 321 op/s 2024-09-19T05:30:48.266 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:30:48.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1055611 11.71 MB/sec execute 363 sec latency 30.993 ms 2024-09-19T05:30:48.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.932+0000 7fb56aa22640 1 -- 172.21.15.1:0/2295252249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 msgr2=0x7fb564100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.932+0000 7fb56aa22640 1 --2- 172.21.15.1:0/2295252249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb564100860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb554009900 tx=0x7fb55402a440 comp rx=0 tx=0).stop 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 -- 172.21.15.1:0/2295252249 shutdown_connections 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 --2- 172.21.15.1:0/2295252249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5641055b0 0x7fb56410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 --2- 172.21.15.1:0/2295252249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb564100e30 0x7fb564104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 --2- 172.21.15.1:0/2295252249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb564100860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:48.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 -- 172.21.15.1:0/2295252249 >> 172.21.15.1:0/2295252249 conn(0x7fb564077210 msgr2=0x7fb5640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:48.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 -- 172.21.15.1:0/2295252249 shutdown_connections 2024-09-19T05:30:48.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.933+0000 7fb56aa22640 1 -- 172.21.15.1:0/2295252249 wait complete. 2024-09-19T05:30:48.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.934+0000 7fb56aa22640 1 Processor -- start 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.934+0000 7fb56aa22640 1 -- start start 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb56411a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5641055b0 0x7fb56410c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f780 con 0x7fb564100e30 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f600 con 0x7fb564100480 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb56aa22640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f900 con 0x7fb5641055b0 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb5637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb5637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59326/0 (socket says 172.21.15.1:59326) 2024-09-19T05:30:48.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.935+0000 7fb5637fe640 1 -- 172.21.15.1:0/1220772331 learned_addr learned my addr 172.21.15.1:0/1220772331 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb563fff640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb56411a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb5637fe640 1 -- 172.21.15.1:0/1220772331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5641055b0 msgr2=0x7fb56410c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb5637fe640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5641055b0 0x7fb56410c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb5637fe640 1 -- 172.21.15.1:0/1220772331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 msgr2=0x7fb56411a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb5637fe640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb56411a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb5637fe640 1 -- 172.21.15.1:0/1220772331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56410ce00 con 0x7fb564100e30 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.936+0000 7fb563fff640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb56411a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.937+0000 7fb5637fe640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb55800b450 tx=0x7fb55800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.937+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558015020 con 0x7fb564100e30 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.938+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb558011d70 con 0x7fb564100e30 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.938+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55800f340 con 0x7fb564100e30 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.938+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56410d0f0 con 0x7fb564100e30 2024-09-19T05:30:48.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.938+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb564116050 con 0x7fb564100e30 2024-09-19T05:30:48.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.942+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb564101960 con 0x7fb564100e30 2024-09-19T05:30:48.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.942+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb558018020 con 0x7fb564100e30 2024-09-19T05:30:48.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.943+0000 7fb5617fa640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 0x7fb54c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:48.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.944+0000 7fb563fff640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 0x7fb54c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:48.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.944+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fb5580cf560 con 0x7fb564100e30 2024-09-19T05:30:48.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.951+0000 7fb563fff640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 0x7fb54c0a5920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb554006010 tx=0x7fb554000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:48.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:48.953+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb55801f030 con 0x7fb564100e30 2024-09-19T05:30:49.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.217+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb564116310 con 0x7fb564100e30 2024-09-19T05:30:49.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.218+0000 7fb5617fa640 1 -- 172.21.15.1:0/1220772331 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fb55800d040 con 0x7fb564100e30 2024-09-19T05:30:49.221 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:30:49.221 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:30:49.221 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 msgr2=0x7fb54c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 0x7fb54c0a5920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb554006010 tx=0x7fb554000bc0 comp rx=0 tx=0).stop 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 msgr2=0x7fb56411a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb55800b450 tx=0x7fb55800b910 comp rx=0 tx=0).stop 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 shutdown_connections 2024-09-19T05:30:49.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb54c0a3460 0x7fb54c0a5920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5641055b0 0x7fb56410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb564100e30 0x7fb56411a9e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 --2- 172.21.15.1:0/1220772331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb564100480 0x7fb56411a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.220+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 >> 172.21.15.1:0/1220772331 conn(0x7fb564077210 msgr2=0x7fb564110dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.221+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 shutdown_connections 2024-09-19T05:30:49.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:49.221+0000 7fb56aa22640 1 -- 172.21.15.1:0/1220772331 wait complete. 2024-09-19T05:30:49.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1058263 11.71 MB/sec execute 364 sec latency 69.501 ms 2024-09-19T05:30:50.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:49 smithi060 ceph-mon[35058]: pgmap v640: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 311 op/s 2024-09-19T05:30:50.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:49 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1220772331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:30:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:49 smithi082 ceph-mon[35195]: pgmap v640: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 311 op/s 2024-09-19T05:30:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:49 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1220772331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:30:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:49 smithi001 ceph-mon[30968]: pgmap v640: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 311 op/s 2024-09-19T05:30:50.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:49 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1220772331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:30:50.155 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T05:30:50.155 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T05:30:50.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1060514 11.71 MB/sec execute 365 sec latency 20.649 ms 2024-09-19T05:30:50.506 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 -- 172.21.15.1:0/3670646971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c102d30 msgr2=0x7fba4c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 --2- 172.21.15.1:0/3670646971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c102d30 0x7fba4c103110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba4802a410 comp rx=0 tx=0).stop 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 -- 172.21.15.1:0/3670646971 shutdown_connections 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 --2- 172.21.15.1:0/3670646971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c1082a0 0x7fba4c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 --2- 172.21.15.1:0/3670646971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1036e0 0x7fba4c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 --2- 172.21.15.1:0/3670646971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c102d30 0x7fba4c103110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 -- 172.21.15.1:0/3670646971 >> 172.21.15.1:0/3670646971 conn(0x7fba4c0fc7d0 msgr2=0x7fba4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 -- 172.21.15.1:0/3670646971 shutdown_connections 2024-09-19T05:30:51.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.035+0000 7fba537a9640 1 -- 172.21.15.1:0/3670646971 wait complete. 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 Processor -- start 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 -- start start 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c1036e0 0x7fba4c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1082a0 0x7fba4c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1120a0 con 0x7fba4c102d30 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c111f20 con 0x7fba4c1082a0 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba537a9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c112220 con 0x7fba4c1036e0 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba51545640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba51545640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59352/0 (socket says 172.21.15.1:59352) 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba50d44640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c1036e0 0x7fba4c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba51545640 1 -- 172.21.15.1:0/3557768634 learned_addr learned my addr 172.21.15.1:0/3557768634 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:51.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.036+0000 7fba51d46640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1082a0 0x7fba4c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 -- 172.21.15.1:0/3557768634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c1036e0 msgr2=0x7fba4c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c1036e0 0x7fba4c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 -- 172.21.15.1:0/3557768634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1082a0 msgr2=0x7fba4c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1082a0 0x7fba4c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 -- 172.21.15.1:0/3557768634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c1a6a90 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba51545640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fba48006010 tx=0x7fba48003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba427fc640 1 -- 172.21.15.1:0/3557768634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4803f070 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1a6d20 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba427fc640 1 -- 172.21.15.1:0/3557768634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba48031c30 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba427fc640 1 -- 172.21.15.1:0/3557768634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48035030 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.037+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1a71a0 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.039+0000 7fba427fc640 1 -- 172.21.15.1:0/3557768634 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fba48042070 con 0x7fba4c102d30 2024-09-19T05:30:51.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 Processor -- start 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 -- start start 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca5678400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca567ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558ca55d32a0 con 0x558ca566e080 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558ca557ab10 con 0x558ca566d760 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba55b82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ca55cf260 con 0x558ca5678940 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba51545640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca5678400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba427fc640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 0x7fba380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba51d46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba51d46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:51466/0 (socket says 172.21.15.1:51466) 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba50d44640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca567ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba51545640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca5678400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59356/0 (socket says 172.21.15.1:59356) 2024-09-19T05:30:51.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.040+0000 7fba51d46640 1 -- 172.21.15.1:0/3193301530 learned_addr learned my addr 172.21.15.1:0/3193301530 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 0x7fba380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 -- 172.21.15.1:0/3193301530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 msgr2=0x558ca567ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca567ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba427fc640 1 -- 172.21.15.1:0/3557768634 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fba480f0260 con 0x7fba4c102d30 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 -- 172.21.15.1:0/3193301530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 msgr2=0x558ca5678400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca5678400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 -- 172.21.15.1:0/3193301530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca5344b90 con 0x558ca566d760 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba50d44640 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca567ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba440049d0 tx=0x7fba44013f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d69e3cdb02ea35f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba51d46640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 0x7fba380a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba4401d000 tx=0x7fba4401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba377fe640 1 -- 172.21.15.1:0/3193301530 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440132b0 con 0x558ca566d760 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba377fe640 1 -- 172.21.15.1:0/3193301530 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba44022030 con 0x558ca566d760 2024-09-19T05:30:51.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.041+0000 7fba377fe640 1 -- 172.21.15.1:0/3193301530 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44010870 con 0x558ca566d760 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 -- 172.21.15.1:0/3193301530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 msgr2=0x558ca566db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba440049d0 tx=0x7fba44013f70 comp rx=0 tx=0).stop 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 -- 172.21.15.1:0/3193301530 shutdown_connections 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca567ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca5678400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 --2- 172.21.15.1:0/3193301530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca566db40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 -- 172.21.15.1:0/3193301530 >> 172.21.15.1:0/3193301530 conn(0x558ca5669cf0 msgr2=0x558ca566a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 -- 172.21.15.1:0/3193301530 shutdown_connections 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.042+0000 7fba55b82740 1 -- 172.21.15.1:0/3193301530 wait complete. 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 -- start start 2024-09-19T05:30:51.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 Processor -- start 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5675860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 0x558ca5675da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558ca567b510 con 0x558ca5678940 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558ca555b6e0 con 0x558ca566e080 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ca567b690 con 0x558ca566d760 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba55b82740 10 client.0 _ll_register_callbacks cb 0x558ca557fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51d46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51d46640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59370/0 (socket says 172.21.15.1:59370) 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51d46640 1 -- 172.21.15.1:0/3224905408 learned_addr learned my addr 172.21.15.1:0/3224905408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba50d44640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 0x558ca5675da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51545640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5675860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51d46640 1 -- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 msgr2=0x558ca5675860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.043+0000 7fba51d46640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5675860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba51d46640 1 -- 172.21.15.1:0/3224905408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 msgr2=0x558ca5675da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba51d46640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 0x558ca5675da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba51d46640 1 -- 172.21.15.1:0/3224905408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ca5684a30 con 0x558ca5678940 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba50d44640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 0x558ca5675da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba51545640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5675860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba51d46640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba44006010 tx=0x7fba44005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ff8f614a40c031 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44035060 con 0x558ca5678940 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44022030 con 0x558ca5678940 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fba44012820 con 0x558ca5678940 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fba4403c050 con 0x558ca5678940 2024-09-19T05:30:51.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba55b82740 10 client.15600 fetch_fsmap learned FSMap version 21 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558ca5687410 con 0x558ca5678940 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba44022030 con 0x558ca5678940 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.044+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fba44010cc0 con 0x558ca5678940 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 10 client.15600 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 10 client.15600 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 20 client.15600 populate_metadata read hostname 'smithi001' 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56887c0 0x558ca568abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 4 client.15600 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ca55e09d0 con 0x558ca56887c0 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba51545640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56887c0 0x558ca568abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba34ff9640 10 client.15600 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.045+0000 7fba51545640 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56887c0 0x558ca568abb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d4223908d523d0d server_cookie=5e66e163ef14ba56 in_seq=0 out_seq=0 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba34ff9640 1 -- 172.21.15.1:0/3224905408 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ca55e09d0 con 0x558ca56887c0 2024-09-19T05:30:51.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba34ff9640 10 client.15600 handle_command_reply: tid=0 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 client.15600 shutdown 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 msgr2=0x558ca56762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fba44006010 tx=0x7fba44005a10 comp rx=0 tx=0).stop 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 shutdown_connections 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca5678940 0x558ca56762e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566e080 0x558ca5675da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56887c0 0x558ca568abb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 --2- 172.21.15.1:0/3224905408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5675860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba34ff9640 0 client.15600 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 >> 172.21.15.1:0/3224905408 conn(0x558ca5669cf0 msgr2=0x558ca566fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 shutdown_connections 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 1 -- 172.21.15.1:0/3224905408 wait complete. 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.047+0000 7fba55b82740 20 client.15600 trim_cache size 0 max 16384 2024-09-19T05:30:51.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 Processor -- start 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 -- start start 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca5690390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1aefb0 con 0x558ca566e080 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1b1830 con 0x558ca566d760 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba55b82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1af620 con 0x558ca5678940 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba50d44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba51545640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba51545640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:51478/0 (socket says 172.21.15.1:51478) 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba51545640 1 -- 172.21.15.1:0/3373928383 learned_addr learned my addr 172.21.15.1:0/3373928383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.065+0000 7fba51d46640 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca5690390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 -- 172.21.15.1:0/3373928383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 msgr2=0x558ca5690390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca5690390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 -- 172.21.15.1:0/3373928383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 msgr2=0x558ca56701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 -- 172.21.15.1:0/3373928383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ca5665260 con 0x558ca566d760 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba50d44640 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba51545640 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba480b8ea0 tx=0x7fba480b8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cbdda15d5a0d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba36ffd640 1 -- 172.21.15.1:0/3373928383 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba48049040 con 0x558ca566d760 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba36ffd640 1 -- 172.21.15.1:0/3373928383 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba4803b460 con 0x558ca566d760 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba36ffd640 1 -- 172.21.15.1:0/3373928383 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba480c0880 con 0x558ca566d760 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.066+0000 7fba55b82740 1 -- 172.21.15.1:0/3373928383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 msgr2=0x558ca56747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba480b8ea0 tx=0x7fba480b8040 comp rx=0 tx=0).stop 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- 172.21.15.1:0/3373928383 shutdown_connections 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca5678940 0x558ca5690390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- 172.21.15.1:0/3373928383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca566d760 0x558ca56747a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- 172.21.15.1:0/3373928383 >> 172.21.15.1:0/3373928383 conn(0x558ca5669cf0 msgr2=0x558ca56778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- 172.21.15.1:0/3373928383 shutdown_connections 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- 172.21.15.1:0/3373928383 wait complete. 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- start start 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 Processor -- start 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5680ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 0x558ca5672a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1afcf0 con 0x558ca566e080 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1b1160 con 0x558ca5678940 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c1b03c0 con 0x558ca566d760 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.067+0000 7fba55b82740 10 client.0 _ll_register_callbacks cb 0x7fba440138e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:30:51.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba51545640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5680ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59400/0 (socket says 172.21.15.1:59400) 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 -- 172.21.15.1:0/3410255421 learned_addr learned my addr 172.21.15.1:0/3410255421 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba51d46640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 0x558ca5672a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 -- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 msgr2=0x558ca5680ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5680ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 -- 172.21.15.1:0/3410255421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 msgr2=0x558ca5672a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 0x558ca5672a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 -- 172.21.15.1:0/3410255421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ca566a980 con 0x558ca566e080 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba51545640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5680ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba51d46640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 0x558ca5672a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba50d44640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba4c06a370 tx=0x7fba3c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eec98d122c3297 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:30:51.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c023060 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fba3c004030 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ca55dad20 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fba3c02a050 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba55b82740 10 client.15606 fetch_fsmap learned FSMap version 21 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.068+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558ca56f3110 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558ca55dad20 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fba3c010430 con 0x558ca566e080 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 10 client.15606 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 10 client.15606 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 20 client.15606 populate_metadata read hostname 'smithi001' 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56f3900 0x558ca56f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 4 client.15606 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x558ca5556ec0 con 0x558ca56f3900 2024-09-19T05:30:51.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba51545640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56f3900 0x558ca56f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba34ff9640 10 client.15606 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.069+0000 7fba51545640 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56f3900 0x558ca56f5d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55910779f2f43f6 server_cookie=be437133826f257 in_seq=0 out_seq=0 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba34ff9640 1 -- 172.21.15.1:0/3410255421 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558ca5556ec0 con 0x558ca56f3900 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba34ff9640 10 client.15606 handle_command_reply: tid=0 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 client.15606 shutdown 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 msgr2=0x558ca56724d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba4c06a370 tx=0x7fba3c00f790 comp rx=0 tx=0).stop 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 shutdown_connections 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558ca5678940 0x558ca5672a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558ca566e080 0x558ca56724d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558ca56f3900 0x558ca56f5d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 --2- 172.21.15.1:0/3410255421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ca566d760 0x558ca5680ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba34ff9640 0 client.15606 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.161+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 >> 172.21.15.1:0/3410255421 conn(0x558ca5669cf0 msgr2=0x558ca5668650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 shutdown_connections 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba55b82740 1 -- 172.21.15.1:0/3410255421 wait complete. 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba55b82740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 34, 2024-09-19T05:30:51.328 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "a3196fd0": { 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 34, 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 150.0, 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:30:51.329 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:30:51.330 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 msgr2=0x7fba380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 0x7fba380a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba4401d000 tx=0x7fba4401f000 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 msgr2=0x7fba4c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fba48006010 tx=0x7fba48003c10 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 shutdown_connections 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fba380a3240 0x7fba380a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba4c1082a0 0x7fba4c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba4c1036e0 0x7fba4c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 --2- 172.21.15.1:0/3557768634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba4c102d30 0x7fba4c100990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 >> 172.21.15.1:0/3557768634 conn(0x7fba4c0fc7d0 msgr2=0x7fba4c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 shutdown_connections 2024-09-19T05:30:51.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:30:51.162+0000 7fba537a9640 1 -- 172.21.15.1:0/3557768634 wait complete. 2024-09-19T05:30:51.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.72 MB/sec execute 366 sec latency 248.650 ms 2024-09-19T05:30:51.898 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:51 smithi001 ceph-mon[30968]: pgmap v641: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 252 op/s 2024-09-19T05:30:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:51 smithi060 ceph-mon[35058]: pgmap v641: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 252 op/s 2024-09-19T05:30:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:51 smithi082 ceph-mon[35195]: pgmap v641: 129 pgs: 129 active+clean; 272 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 252 op/s 2024-09-19T05:30:52.332 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a3196fd0', quiesce took 4.3 seconds. Will release after: 25.7 2024-09-19T05:30:52.408 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.69 MB/sec execute 367 sec latency 1248.713 ms 2024-09-19T05:30:53.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.65 MB/sec execute 368 sec latency 2248.819 ms 2024-09-19T05:30:53.909 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:53 smithi082 ceph-mon[35195]: pgmap v642: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 298 op/s 2024-09-19T05:30:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:53 smithi060 ceph-mon[35058]: pgmap v642: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 298 op/s 2024-09-19T05:30:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:53 smithi001 ceph-mon[30968]: pgmap v642: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.4 MiB/s wr, 298 op/s 2024-09-19T05:30:54.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.62 MB/sec execute 369 sec latency 3248.902 ms 2024-09-19T05:30:55.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.59 MB/sec execute 370 sec latency 4249.006 ms 2024-09-19T05:30:56.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:55 smithi060 ceph-mon[35058]: pgmap v643: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:30:56.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:55 smithi082 ceph-mon[35195]: pgmap v643: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:30:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:55 smithi001 ceph-mon[30968]: pgmap v643: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:30:56.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.56 MB/sec execute 371 sec latency 5249.090 ms 2024-09-19T05:30:57.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.53 MB/sec execute 372 sec latency 6249.198 ms 2024-09-19T05:30:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:57 smithi060 ceph-mon[35058]: pgmap v644: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 284 op/s 2024-09-19T05:30:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:57 smithi082 ceph-mon[35195]: pgmap v644: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 284 op/s 2024-09-19T05:30:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:57 smithi001 ceph-mon[30968]: pgmap v644: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 284 op/s 2024-09-19T05:30:58.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.50 MB/sec execute 373 sec latency 7249.312 ms 2024-09-19T05:30:59.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.47 MB/sec execute 374 sec latency 8249.450 ms 2024-09-19T05:31:00.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:30:59 smithi060 ceph-mon[35058]: pgmap v645: 129 pgs: 129 active+clean; 288 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-09-19T05:31:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:30:59 smithi082 ceph-mon[35195]: pgmap v645: 129 pgs: 129 active+clean; 288 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-09-19T05:31:00.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:30:59 smithi001 ceph-mon[30968]: pgmap v645: 129 pgs: 129 active+clean; 288 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 229 op/s 2024-09-19T05:31:00.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.44 MB/sec execute 375 sec latency 9249.505 ms 2024-09-19T05:31:01.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.41 MB/sec execute 376 sec latency 10249.609 ms 2024-09-19T05:31:01.913 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:01 smithi001 ceph-mon[30968]: pgmap v646: 129 pgs: 129 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 158 op/s 2024-09-19T05:31:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:01 smithi060 ceph-mon[35058]: pgmap v646: 129 pgs: 129 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 158 op/s 2024-09-19T05:31:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:01 smithi082 ceph-mon[35195]: pgmap v646: 129 pgs: 129 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 158 op/s 2024-09-19T05:31:02.409 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.38 MB/sec execute 377 sec latency 11249.687 ms 2024-09-19T05:31:03.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.35 MB/sec execute 378 sec latency 12249.791 ms 2024-09-19T05:31:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:03 smithi060 ceph-mon[35058]: pgmap v647: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-09-19T05:31:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:03 smithi082 ceph-mon[35195]: pgmap v647: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-09-19T05:31:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:03 smithi001 ceph-mon[30968]: pgmap v647: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 3.2 MiB/s wr, 164 op/s 2024-09-19T05:31:04.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.32 MB/sec execute 379 sec latency 13249.858 ms 2024-09-19T05:31:05.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.29 MB/sec execute 380 sec latency 14249.953 ms 2024-09-19T05:31:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:05 smithi060 ceph-mon[35058]: pgmap v648: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 2.3 MiB/s wr, 85 op/s 2024-09-19T05:31:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:05 smithi082 ceph-mon[35195]: pgmap v648: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 2.3 MiB/s wr, 85 op/s 2024-09-19T05:31:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:05 smithi001 ceph-mon[30968]: pgmap v648: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 2.3 MiB/s wr, 85 op/s 2024-09-19T05:31:06.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.26 MB/sec execute 381 sec latency 15250.061 ms 2024-09-19T05:31:07.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.23 MB/sec execute 382 sec latency 16250.176 ms 2024-09-19T05:31:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:07 smithi060 ceph-mon[35058]: pgmap v649: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.8 MiB/s wr, 100 op/s 2024-09-19T05:31:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:07 smithi082 ceph-mon[35195]: pgmap v649: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.8 MiB/s wr, 100 op/s 2024-09-19T05:31:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:07 smithi001 ceph-mon[30968]: pgmap v649: 129 pgs: 129 active+clean; 287 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.8 MiB/s wr, 100 op/s 2024-09-19T05:31:08.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.20 MB/sec execute 383 sec latency 17250.284 ms 2024-09-19T05:31:09.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.17 MB/sec execute 384 sec latency 18250.346 ms 2024-09-19T05:31:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:09 smithi060 ceph-mon[35058]: pgmap v650: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.6 MiB/s wr, 91 op/s 2024-09-19T05:31:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:09 smithi082 ceph-mon[35195]: pgmap v650: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.6 MiB/s wr, 91 op/s 2024-09-19T05:31:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:09 smithi001 ceph-mon[30968]: pgmap v650: 129 pgs: 129 active+clean; 283 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.6 MiB/s wr, 91 op/s 2024-09-19T05:31:10.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.14 MB/sec execute 385 sec latency 19250.392 ms 2024-09-19T05:31:10.971 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:31:11.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:31:11.007 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:31:11.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.11 MB/sec execute 386 sec latency 20250.422 ms 2024-09-19T05:31:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:11 smithi060 ceph-mon[35058]: pgmap v651: 129 pgs: 129 active+clean; 285 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-19T05:31:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:11 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:12.011 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:11 smithi082 ceph-mon[35195]: pgmap v651: 129 pgs: 129 active+clean; 285 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-19T05:31:12.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:12.012 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:11 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:12.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:11 smithi001 ceph-mon[30968]: pgmap v651: 129 pgs: 129 active+clean; 285 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-19T05:31:12.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:12.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:11 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:12.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.08 MB/sec execute 387 sec latency 21250.473 ms 2024-09-19T05:31:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:31:13.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:31:13.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:12 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:31:13.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:31:13.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:12 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:31:13.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:12 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:31:13.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.05 MB/sec execute 388 sec latency 22250.556 ms 2024-09-19T05:31:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:13 smithi060 ceph-mon[35058]: pgmap v652: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.7 MiB/s wr, 102 op/s 2024-09-19T05:31:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:13 smithi082 ceph-mon[35195]: pgmap v652: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.7 MiB/s wr, 102 op/s 2024-09-19T05:31:14.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:13 smithi001 ceph-mon[30968]: pgmap v652: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.7 MiB/s wr, 102 op/s 2024-09-19T05:31:14.410 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.03 MB/sec execute 389 sec latency 23250.679 ms 2024-09-19T05:31:15.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 11.00 MB/sec execute 390 sec latency 24250.799 ms 2024-09-19T05:31:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:15 smithi060 ceph-mon[35058]: pgmap v653: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:15 smithi082 ceph-mon[35195]: pgmap v653: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:16.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:15 smithi001 ceph-mon[30968]: pgmap v653: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:16.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 10.97 MB/sec execute 391 sec latency 25250.925 ms 2024-09-19T05:31:17.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 10.94 MB/sec execute 392 sec latency 26251.052 ms 2024-09-19T05:31:18.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:17 smithi060 ceph-mon[35058]: pgmap v654: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.7 MiB/s wr, 101 op/s 2024-09-19T05:31:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:17 smithi082 ceph-mon[35195]: pgmap v654: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.7 MiB/s wr, 101 op/s 2024-09-19T05:31:18.033 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:31:18.062 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:17 smithi001 ceph-mon[30968]: pgmap v654: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.7 MiB/s wr, 101 op/s 2024-09-19T05:31:18.304 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:18.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 10.91 MB/sec execute 393 sec latency 27251.151 ms 2024-09-19T05:31:18.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 -- 172.21.15.1:0/3651896557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 msgr2=0x7fc85c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:18.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 --2- 172.21.15.1:0/3651896557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c101200 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc858009900 tx=0x7fc85802a480 comp rx=0 tx=0).stop 2024-09-19T05:31:18.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 -- 172.21.15.1:0/3651896557 shutdown_connections 2024-09-19T05:31:18.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 --2- 172.21.15.1:0/3651896557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102ef0 0x7fc85c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 --2- 172.21.15.1:0/3651896557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102570 0x7fc85c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 --2- 172.21.15.1:0/3651896557 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c101200 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 -- 172.21.15.1:0/3651896557 >> 172.21.15.1:0/3651896557 conn(0x7fc85c0fc7d0 msgr2=0x7fc85c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 -- 172.21.15.1:0/3651896557 shutdown_connections 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.842+0000 7fc863926640 1 -- 172.21.15.1:0/3651896557 wait complete. 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.843+0000 7fc863926640 1 Processor -- start 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.843+0000 7fc863926640 1 -- start start 2024-09-19T05:31:18.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102570 0x7fc85c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102ef0 0x7fc85c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c110f80 con 0x7fc85c100e20 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c110e00 con 0x7fc85c102ef0 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc863926640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c111100 con 0x7fc85c102570 2024-09-19T05:31:18.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:18.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53510/0 (socket says 172.21.15.1:53510) 2024-09-19T05:31:18.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 -- 172.21.15.1:0/2664678658 learned_addr learned my addr 172.21.15.1:0/2664678658 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:18.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc860ec1640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102570 0x7fc85c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:18.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc861ec3640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102ef0 0x7fc85c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:18.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 -- 172.21.15.1:0/2664678658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102570 msgr2=0x7fc85c197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102570 0x7fc85c197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 -- 172.21.15.1:0/2664678658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102ef0 msgr2=0x7fc85c19bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102ef0 0x7fc85c19bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 -- 172.21.15.1:0/2664678658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c19c390 con 0x7fc85c100e20 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.844+0000 7fc8616c2640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc858006010 tx=0x7fc858003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:18.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.845+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85803f070 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.845+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c19c620 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.845+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc858031c30 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.845+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858035030 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.845+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1a3f60 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.846+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c1021b0 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.847+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc858042070 con 0x7fc85c100e20 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.848+0000 7fc8527fc640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 0x7fc8480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:18.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.848+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc8580f0470 con 0x7fc85c100e20 2024-09-19T05:31:18.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.848+0000 7fc860ec1640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 0x7fc8480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:18.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.848+0000 7fc860ec1640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 0x7fc8480a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ffda0 tx=0x7fc84c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:18.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:18.852+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc858031de0 con 0x7fc85c100e20 2024-09-19T05:31:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.086+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc85c198740 con 0x7fc85c100e20 2024-09-19T05:31:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.087+0000 7fc8527fc640 1 -- 172.21.15.1:0/2664678658 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fc8580bc790 con 0x7fc85c100e20 2024-09-19T05:31:19.090 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:31:19.090 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:31:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:31:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.089+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 msgr2=0x7fc8480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.089+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 0x7fc8480a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0ffda0 tx=0x7fc84c00b390 comp rx=0 tx=0).stop 2024-09-19T05:31:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.089+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 msgr2=0x7fc85c1973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.089+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc858006010 tx=0x7fc858003c10 comp rx=0 tx=0).stop 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 shutdown_connections 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc8480a3240 0x7fc8480a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc85c102ef0 0x7fc85c19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc85c102570 0x7fc85c197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 --2- 172.21.15.1:0/2664678658 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc85c100e20 0x7fc85c1973e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 >> 172.21.15.1:0/2664678658 conn(0x7fc85c0fc7d0 msgr2=0x7fc85c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 shutdown_connections 2024-09-19T05:31:19.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:19.090+0000 7fc863926640 1 -- 172.21.15.1:0/2664678658 wait complete. 2024-09-19T05:31:19.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 10.89 MB/sec execute 394 sec latency 28251.214 ms 2024-09-19T05:31:19.937 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id a3196fd0 --release --await' 2024-09-19T05:31:19.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id a3196fd0 --release --await 2024-09-19T05:31:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:19 smithi060 ceph-mon[35058]: pgmap v655: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:31:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:19 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2664678658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:20.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:19 smithi001 ceph-mon[30968]: pgmap v655: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:31:20.002 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:19 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2664678658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:19 smithi082 ceph-mon[35195]: pgmap v655: 129 pgs: 129 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.5 MiB/s wr, 94 op/s 2024-09-19T05:31:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:19 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2664678658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:20.248 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:20.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1062541 10.86 MB/sec execute 395 sec latency 29251.317 ms 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 -- 172.21.15.1:0/723277570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 msgr2=0x7fa5141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 --2- 172.21.15.1:0/723277570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa5141021c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa504009900 tx=0x7fa50402a410 comp rx=0 tx=0).stop 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 -- 172.21.15.1:0/723277570 shutdown_connections 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 --2- 172.21.15.1:0/723277570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 0x7fa51410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 --2- 172.21.15.1:0/723277570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 0x7fa5141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 --2- 172.21.15.1:0/723277570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa5141021c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 -- 172.21.15.1:0/723277570 >> 172.21.15.1:0/723277570 conn(0x7fa5140fd8c0 msgr2=0x7fa5140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 -- 172.21.15.1:0/723277570 shutdown_connections 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.769+0000 7fa518ea7640 1 -- 172.21.15.1:0/723277570 wait complete. 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 Processor -- start 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 -- start start 2024-09-19T05:31:20.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 0x7fa514198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 0x7fa51419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa514111f90 con 0x7fa514101de0 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa514111e10 con 0x7fa514102790 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa518ea7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa514112110 con 0x7fa514106f10 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa51259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa51259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53534/0 (socket says 172.21.15.1:53534) 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa51259c640 1 -- 172.21.15.1:0/1728896261 learned_addr learned my addr 172.21.15.1:0/1728896261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.770+0000 7fa50bfff640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 0x7fa514198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 0x7fa51419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 -- 172.21.15.1:0/1728896261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 msgr2=0x7fa51419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 0x7fa51419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 -- 172.21.15.1:0/1728896261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 msgr2=0x7fa514198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 0x7fa514198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 -- 172.21.15.1:0/1728896261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51419d4e0 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa51259c640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa504006010 tx=0x7fa5040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa50b7fe640 1 -- 172.21.15.1:0/1728896261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50403f030 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa50b7fe640 1 -- 172.21.15.1:0/1728896261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa504003ce0 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51419d770 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa50b7fe640 1 -- 172.21.15.1:0/1728896261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504035070 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.771+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5141a50b0 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa50b7fe640 1 -- 172.21.15.1:0/1728896261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa504042030 con 0x7fa514101de0 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 Processor -- start 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 -- start start 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349965440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b349972630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b3498ca620 con 0x55b349965980 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b349871e50 con 0x55b349970240 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.774+0000 7fa51b280740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b3498c65e0 con 0x55b349965060 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53540/0 (socket says 172.21.15.1:53540) 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349965440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 -- 172.21.15.1:0/2468884294 learned_addr learned my addr 172.21.15.1:0/2468884294 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa50b7fe640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 0x7fa5000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa50bfff640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b349972630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 -- 172.21.15.1:0/2468884294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 msgr2=0x55b349965440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349965440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 -- 172.21.15.1:0/2468884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 msgr2=0x55b349972630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b349972630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa50b7fe640 1 -- 172.21.15.1:0/1728896261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa5040f0240 con 0x7fa514101de0 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 -- 172.21.15.1:0/2468884294 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b349862d40 con 0x55b349965980 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa512d9d640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349965440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa50bfff640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b349972630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 0x7fa5000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa51259c640 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ed990 tx=0x7fa50402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbd8269e887b59d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa508ff9640 1 -- 172.21.15.1:0/2468884294 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040bc3f0 con 0x55b349965980 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa508ff9640 1 -- 172.21.15.1:0/2468884294 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5040f3e50 con 0x55b349965980 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.775+0000 7fa508ff9640 1 -- 172.21.15.1:0/2468884294 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50403bcb0 con 0x55b349965980 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 -- 172.21.15.1:0/2468884294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 msgr2=0x55b34996fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 0x7fa5000a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00a640 tx=0x7fa50c004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ed990 tx=0x7fa50402a410 comp rx=0 tx=0).stop 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 -- 172.21.15.1:0/2468884294 shutdown_connections 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b349972630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996fd00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 --2- 172.21.15.1:0/2468884294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349965440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 -- 172.21.15.1:0/2468884294 >> 172.21.15.1:0/2468884294 conn(0x55b3499615f0 msgr2=0x55b3499619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 -- 172.21.15.1:0/2468884294 shutdown_connections 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.776+0000 7fa51b280740 1 -- 172.21.15.1:0/2468884294 wait complete. 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 -- start start 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 Processor -- start 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b34996d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b34996db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b349972bd0 con 0x55b349965980 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b349852f10 con 0x55b349970240 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b349972d50 con 0x55b349965060 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51b280740 10 client.0 _ll_register_callbacks cb 0x55b349876db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53542/0 (socket says 172.21.15.1:53542) 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa50bfff640 1 -- 172.21.15.1:0/2890367975 learned_addr learned my addr 172.21.15.1:0/2890367975 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.777+0000 7fa51259c640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b34996d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa512d9d640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b34996db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 -- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 msgr2=0x55b34996d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b34996d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 -- 172.21.15.1:0/2890367975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 msgr2=0x55b34996db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b34996db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 -- 172.21.15.1:0/2890367975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3495d9580 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa50bfff640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00baa0 tx=0x7fa4fc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3165bed9d8136efc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc01b640 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa4fc011440 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5040f3e50 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa4fc003e70 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa51b280740 10 client.15624 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b3496a3960 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5040f3e50 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.778+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa4fc019020 con 0x55b349965980 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 10 client.15624 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 10 client.15624 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:20.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 20 client.15624 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b349981fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 4 client.15624 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3498d7b90 con 0x55b34997fb60 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51259c640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b349981fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa51259c640 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b349981fa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993fc2afed130e8 server_cookie=e160832489054f5e in_seq=0 out_seq=0 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.779+0000 7fa4f9ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/2890367975 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3498d7b90 con 0x55b34997fb60 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa4f9ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 client.15624 shutdown 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 msgr2=0x55b34996d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00baa0 tx=0x7fa4fc00bf60 comp rx=0 tx=0).stop 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 shutdown_connections 2024-09-19T05:31:20.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349970240 0x55b34996db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349965980 0x55b34996d630 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b349981fa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 --2- 172.21.15.1:0/2890367975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b34996d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa4f9ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.780+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 >> 172.21.15.1:0/2890367975 conn(0x55b3499615f0 msgr2=0x55b349960750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.781+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 shutdown_connections 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.781+0000 7fa51b280740 1 -- 172.21.15.1:0/2890367975 wait complete. 2024-09-19T05:31:20.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.781+0000 7fa51b280740 20 client.15624 trim_cache size 0 max 16384 2024-09-19T05:31:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 Processor -- start 2024-09-19T05:31:20.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 -- start start 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349967ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b34996c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.798+0000 7fa51b280740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141acdd0 con 0x55b349970240 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa51b280740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141af650 con 0x55b349965980 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa51b280740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141ad440 con 0x55b349965060 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53550/0 (socket says 172.21.15.1:53550) 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 -- 172.21.15.1:0/1552294578 learned_addr learned my addr 172.21.15.1:0/1552294578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa51259c640 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349967ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa50bfff640 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b34996c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 -- 172.21.15.1:0/1552294578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 msgr2=0x55b349967ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349967ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 -- 172.21.15.1:0/1552294578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 msgr2=0x55b34996c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b34996c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 -- 172.21.15.1:0/1552294578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3499685b0 con 0x55b349970240 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa512d9d640 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa50c007690 tx=0x7fa50c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28406e7c9b2a5213 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa4fbfff640 1 -- 172.21.15.1:0/1552294578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0177d0 con 0x55b349970240 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa4fbfff640 1 -- 172.21.15.1:0/1552294578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c01b040 con 0x55b349970240 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.799+0000 7fa4fbfff640 1 -- 172.21.15.1:0/1552294578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c022380 con 0x55b349970240 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- 172.21.15.1:0/1552294578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 msgr2=0x55b3499781c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa50c007690 tx=0x7fa50c015000 comp rx=0 tx=0).stop 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- 172.21.15.1:0/1552294578 shutdown_connections 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499781c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b34996c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 --2- 172.21.15.1:0/1552294578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b349967ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- 172.21.15.1:0/1552294578 >> 172.21.15.1:0/1552294578 conn(0x55b3499615f0 msgr2=0x55b34996f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- 172.21.15.1:0/1552294578 shutdown_connections 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- 172.21.15.1:0/1552294578 wait complete. 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 -- start start 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.800+0000 7fa51b280740 1 Processor -- start 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b3499e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b3499e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141adb10 con 0x55b349970240 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141aef80 con 0x55b349965980 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141ae1e0 con 0x55b349965060 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51b280740 10 client.0 _ll_register_callbacks cb 0x7fa4fc004360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53556/0 (socket says 172.21.15.1:53556) 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b3499e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 -- 172.21.15.1:0/992257463 learned_addr learned my addr 172.21.15.1:0/992257463 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa51259c640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b3499e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 -- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 msgr2=0x55b3499e29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b3499e29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 -- 172.21.15.1:0/992257463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 msgr2=0x55b3499e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b3499e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 -- 172.21.15.1:0/992257463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3499edf20 con 0x55b349970240 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa50bfff640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b3499e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa512d9d640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa50c008010 tx=0x7fa50c023650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a0ac5f70a71640 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.801+0000 7fa4f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c038060 con 0x55b349970240 2024-09-19T05:31:20.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa50c0179e0 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa50c01b040 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa50c03f050 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 10 client.15630 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b3499ef220 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa50c01b040 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa50c032030 con 0x55b349970240 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 10 client.15630 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 10 client.15630 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 20 client.15630 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b3499f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 4 client.15630 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a3196fd0", "release": true, "await": true}] 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.802+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a3196fd0", "release": true, "await": true}) -- 0x55b3498d20a0 con 0x55b34997fb60 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.803+0000 7fa51259c640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b3499f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:20.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.803+0000 7fa4f9ffb640 10 client.15630 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:20.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.803+0000 7fa51259c640 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b3499f18f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab1bcb91af370943 server_cookie=d04131478f133b46 in_seq=0 out_seq=0 2024-09-19T05:31:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa4f9ffb640 1 -- 172.21.15.1:0/992257463 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b3498d20a0 con 0x55b34997fb60 2024-09-19T05:31:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa4f9ffb640 10 client.15630 handle_command_reply: tid=0 2024-09-19T05:31:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 client.15630 shutdown 2024-09-19T05:31:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 msgr2=0x55b3499ed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa50c008010 tx=0x7fa50c023650 comp rx=0 tx=0).stop 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 shutdown_connections 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b349970240 0x55b3499ed880 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b349965980 0x55b3499e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55b34997fb60 0x55b3499f18f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 --2- 172.21.15.1:0/992257463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b349965060 0x55b3499e29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 >> 172.21.15.1:0/992257463 conn(0x55b3499615f0 msgr2=0x55b34996e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa4f9ffb640 0 client.15630 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 shutdown_connections 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 1 -- 172.21.15.1:0/992257463 wait complete. 2024-09-19T05:31:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.819+0000 7fa51b280740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 36, 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "a3196fd0": { 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 36, 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:20.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 150.0, 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:20.825 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 msgr2=0x7fa5000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 0x7fa5000a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00a640 tx=0x7fa50c004b50 comp rx=0 tx=0).stop 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 msgr2=0x7fa514198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa504006010 tx=0x7fa5040042f0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 shutdown_connections 2024-09-19T05:31:20.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa5000a3240 0x7fa5000a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa514106f10 0x7fa51419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102790 0x7fa514198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 --2- 172.21.15.1:0/1728896261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa514101de0 0x7fa514198530 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 >> 172.21.15.1:0/1728896261 conn(0x7fa5140fd8c0 msgr2=0x7fa5140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 shutdown_connections 2024-09-19T05:31:20.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:20.820+0000 7fa518ea7640 1 -- 172.21.15.1:0/1728896261 wait complete. 2024-09-19T05:31:21.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1063635 10.84 MB/sec execute 396 sec latency 29651.895 ms 2024-09-19T05:31:21.725 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a3196fd0', total seconds elapsed: 33.7 2024-09-19T05:31:21.725 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T05:31:21.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:31:21.792 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:21 smithi001 ceph-mon[30968]: pgmap v656: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2024-09-19T05:31:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:21 smithi060 ceph-mon[35058]: pgmap v656: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2024-09-19T05:31:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:21 smithi082 ceph-mon[35195]: pgmap v656: 129 pgs: 129 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.4 MiB/s wr, 86 op/s 2024-09-19T05:31:22.059 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:22.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1066192 10.85 MB/sec execute 397 sec latency 37.918 ms 2024-09-19T05:31:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 -- 172.21.15.1:0/52732162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc10e480 msgr2=0x7f82cc110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 --2- 172.21.15.1:0/52732162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc10e480 0x7f82cc110870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009ca0 tx=0x7f82c402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 -- 172.21.15.1:0/52732162 shutdown_connections 2024-09-19T05:31:22.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 --2- 172.21.15.1:0/52732162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc10e480 0x7f82cc110870 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 --2- 172.21.15.1:0/52732162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc101280 0x7f82cc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 --2- 172.21.15.1:0/52732162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc1008d0 0x7f82cc100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 -- 172.21.15.1:0/52732162 >> 172.21.15.1:0/52732162 conn(0x7f82cc0fc7a0 msgr2=0x7f82cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 -- 172.21.15.1:0/52732162 shutdown_connections 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 -- 172.21.15.1:0/52732162 wait complete. 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.602+0000 7f82d2c20640 1 Processor -- start 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 -- start start 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 0x7f82cc19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc10e480 0x7f82cc19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc114160 con 0x7f82cc1008d0 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc113fe0 con 0x7f82cc101280 2024-09-19T05:31:22.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d2c20640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc1142e0 con 0x7f82cc10e480 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53566/0 (socket says 172.21.15.1:53566) 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 -- 172.21.15.1:0/3082028810 learned_addr learned my addr 172.21.15.1:0/3082028810 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d11bd640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc10e480 0x7f82cc19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82cbfff640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 0x7f82cc19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 -- 172.21.15.1:0/3082028810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc10e480 msgr2=0x7f82cc19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc10e480 0x7f82cc19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 -- 172.21.15.1:0/3082028810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 msgr2=0x7f82cc19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 0x7f82cc19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82d09bc640 1 -- 172.21.15.1:0/3082028810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc19f630 con 0x7f82cc1008d0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.603+0000 7f82cbfff640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 0x7f82cc19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82d09bc640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82c000e9f0 tx=0x7f82c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c000cd80 con 0x7f82cc1008d0 2024-09-19T05:31:22.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82c0010910 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82cc19f920 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0018990 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.604+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82cc1a7200 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.605+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc100cb0 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.606+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f82c0010ac0 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.607+0000 7f82c9ffb640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 0x7f82bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.607+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f82c00d0080 con 0x7f82cc1008d0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.607+0000 7f82cbfff640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 0x7f82bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.608+0000 7f82cbfff640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 0x7f82bc0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f82cc1102c0 tx=0x7f82b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:22.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.613+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82c009c9f0 con 0x7f82cc1008d0 2024-09-19T05:31:22.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.865+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82cc19b9e0 con 0x7f82cc1008d0 2024-09-19T05:31:22.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.865+0000 7f82c9ffb640 1 -- 172.21.15.1:0/3082028810 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f82c009c2f0 con 0x7f82cc1008d0 2024-09-19T05:31:22.868 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:31:22.868 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:31:22.869 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.867+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 msgr2=0x7f82bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.867+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 0x7f82bc0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f82cc1102c0 tx=0x7f82b8005f90 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.867+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 msgr2=0x7f82cc19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.867+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82c000e9f0 tx=0x7f82c000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 shutdown_connections 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f82bc0a3240 0x7f82bc0a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82cc10e480 0x7f82cc19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82cc101280 0x7f82cc19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 --2- 172.21.15.1:0/3082028810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc1008d0 0x7f82cc19a680 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:22.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 >> 172.21.15.1:0/3082028810 conn(0x7f82cc0fc7a0 msgr2=0x7f82cc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:22.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 shutdown_connections 2024-09-19T05:31:22.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:22.868+0000 7f82d2c20640 1 -- 172.21.15.1:0/3082028810 wait complete. 2024-09-19T05:31:23.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1069439 10.87 MB/sec execute 398 sec latency 22.743 ms 2024-09-19T05:31:23.700 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T05:31:23.701 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T05:31:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:23 smithi060 ceph-mon[35058]: pgmap v657: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-19T05:31:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:23 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3082028810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:23 smithi082 ceph-mon[35195]: pgmap v657: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-19T05:31:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:23 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3082028810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:24.034 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:23 smithi001 ceph-mon[30968]: pgmap v657: 129 pgs: 129 active+clean; 276 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 2.6 MiB/s wr, 97 op/s 2024-09-19T05:31:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:23 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3082028810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:24.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072165 10.88 MB/sec execute 399 sec latency 27.858 ms 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.567+0000 7fcc2df55640 1 -- 172.21.15.1:0/3641328491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28100a70 msgr2=0x7fcc28100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.567+0000 7fcc2df55640 1 --2- 172.21.15.1:0/3641328491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28100a70 0x7fcc28100ed0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009930 tx=0x7fcc1c02a420 comp rx=0 tx=0).stop 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 -- 172.21.15.1:0/3641328491 shutdown_connections 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 --2- 172.21.15.1:0/3641328491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28101410 0x7fcc2810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 --2- 172.21.15.1:0/3641328491 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28100a70 0x7fcc28100ed0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 --2- 172.21.15.1:0/3641328491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc28106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 -- 172.21.15.1:0/3641328491 >> 172.21.15.1:0/3641328491 conn(0x7fcc280fc790 msgr2=0x7fcc280febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 -- 172.21.15.1:0/3641328491 shutdown_connections 2024-09-19T05:31:24.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 -- 172.21.15.1:0/3641328491 wait complete. 2024-09-19T05:31:24.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.568+0000 7fcc2df55640 1 Processor -- start 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 -- start start 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28100a70 0x7fcc2819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc2819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110e70 con 0x7fcc28101410 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110cf0 con 0x7fcc28100a70 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc2df55640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110ff0 con 0x7fcc28106a70 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51302/0 (socket says 172.21.15.1:51302) 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc26ffd640 1 -- 172.21.15.1:0/855031352 learned_addr learned my addr 172.21.15.1:0/855031352 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:24.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc277fe640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28100a70 0x7fcc2819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.569+0000 7fcc27fff640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc2819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 -- 172.21.15.1:0/855031352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 msgr2=0x7fcc2819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc2819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 -- 172.21.15.1:0/855031352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28100a70 msgr2=0x7fcc2819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28100a70 0x7fcc2819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 -- 172.21.15.1:0/855031352 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2819f620 con 0x7fcc28101410 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc27fff640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc2819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009230 tx=0x7fcc1c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc24ff9640 1 -- 172.21.15.1:0/855031352 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c03f030 con 0x7fcc28101410 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2819f8b0 con 0x7fcc28101410 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc24ff9640 1 -- 172.21.15.1:0/855031352 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c004440 con 0x7fcc28101410 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc24ff9640 1 -- 172.21.15.1:0/855031352 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c035070 con 0x7fcc28101410 2024-09-19T05:31:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.570+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc281a71f0 con 0x7fcc28101410 2024-09-19T05:31:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc24ff9640 1 -- 172.21.15.1:0/855031352 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fcc1c042030 con 0x7fcc28101410 2024-09-19T05:31:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 Processor -- start 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 -- start start 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 0x55671389eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138abd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5567138042a0 con 0x55671389e760 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5567137abb10 con 0x55671389f080 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc3032e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556713800260 con 0x5567138a9940 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 0x55671389eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.573+0000 7fcc27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 0x55671389eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51306/0 (socket says 172.21.15.1:51306) 2024-09-19T05:31:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc27fff640 1 -- 172.21.15.1:0/839287454 learned_addr learned my addr 172.21.15.1:0/839287454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc24ff9640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 0x7fcc100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc277fe640 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 -- 172.21.15.1:0/839287454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 msgr2=0x5567138a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc27fff640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 0x7fcc100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 -- 172.21.15.1:0/839287454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 msgr2=0x55671389eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 0x55671389eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 -- 172.21.15.1:0/839287454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556713575b90 con 0x5567138a9940 2024-09-19T05:31:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc24ff9640 1 -- 172.21.15.1:0/855031352 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcc1c0effe0 con 0x7fcc28101410 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138abd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0b8be0 tx=0x7fcc1c0b16f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ab1d8ce7991f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc0dffb640 1 -- 172.21.15.1:0/839287454 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c09ee50 con 0x5567138a9940 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc27fff640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 0x7fcc100a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc20013a30 tx=0x7fcc20004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc0dffb640 1 -- 172.21.15.1:0/839287454 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c0dae50 con 0x5567138a9940 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.574+0000 7fcc0dffb640 1 -- 172.21.15.1:0/839287454 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0bbd50 con 0x5567138a9940 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 -- 172.21.15.1:0/839287454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 msgr2=0x5567138abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138abd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c0b8be0 tx=0x7fcc1c0b16f0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 -- 172.21.15.1:0/839287454 shutdown_connections 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138abd30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 --2- 172.21.15.1:0/839287454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389e760 0x55671389eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 -- 172.21.15.1:0/839287454 >> 172.21.15.1:0/839287454 conn(0x55671389acf0 msgr2=0x55671389b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 -- 172.21.15.1:0/839287454 shutdown_connections 2024-09-19T05:31:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.575+0000 7fcc3032e740 1 -- 172.21.15.1:0/839287454 wait complete. 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 -- start start 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 Processor -- start 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5567138ac2d0 con 0x55671389f080 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55671378c6e0 con 0x55671389e760 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5567138ac450 con 0x5567138a9940 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc3032e740 10 client.0 _ll_register_callbacks cb 0x5567137b0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc27fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:46542/0 (socket says 172.21.15.1:46542) 2024-09-19T05:31:24.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.576+0000 7fcc277fe640 1 -- 172.21.15.1:0/2729558972 learned_addr learned my addr 172.21.15.1:0/2729558972 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 -- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 msgr2=0x5567138a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 -- 172.21.15.1:0/2729558972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 msgr2=0x5567138a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 -- 172.21.15.1:0/2729558972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567138bdec0 con 0x55671389e760 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc27fff640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc277fe640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc18011d40 tx=0x7fcc1800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d663481e469de0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc18004b20 con 0x55671389e760 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcc18004cc0 con 0x55671389e760 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc1c0dae50 con 0x55671389e760 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcc18003970 con 0x55671389e760 2024-09-19T05:31:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc3032e740 10 client.25262 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.577+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5567138c0900 con 0x55671389e760 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c0dae50 con 0x55671389e760 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcc18019070 con 0x55671389e760 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 10 client.25262 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 10 client.25262 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 20 client.25262 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5567138c1dc0 0x5567138c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 4 client.25262 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567138119d0 con 0x5567138c1dc0 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5567138c1dc0 0x5567138c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5567138c1dc0 0x5567138c41b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d459ad51491c60 server_cookie=df6d6b391382e0cb in_seq=0 out_seq=0 2024-09-19T05:31:24.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.578+0000 7fcc06ffd640 10 client.25262 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc06ffd640 1 -- 172.21.15.1:0/2729558972 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567138119d0 con 0x5567138c1dc0 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc06ffd640 10 client.25262 handle_command_reply: tid=0 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 client.25262 shutdown 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 msgr2=0x5567138a67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc18011d40 tx=0x7fcc1800f790 comp rx=0 tx=0).stop 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 shutdown_connections 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5567138c1dc0 0x5567138c41b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5567138a9940 0x5567138a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc06ffd640 0 client.25262 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:24.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2729558972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389e760 0x5567138a67b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 >> 172.21.15.1:0/2729558972 conn(0x55671389acf0 msgr2=0x5567138a0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 shutdown_connections 2024-09-19T05:31:24.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.579+0000 7fcc3032e740 1 -- 172.21.15.1:0/2729558972 wait complete. 2024-09-19T05:31:24.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.580+0000 7fcc3032e740 20 client.25262 trim_cache size 0 max 16384 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 Processor -- start 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 -- start start 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 0x5567138a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281aab00 con 0x55671389f080 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281ad360 con 0x5567138a9940 2024-09-19T05:31:24.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51320/0 (socket says 172.21.15.1:51320) 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc26ffd640 1 -- 172.21.15.1:0/2527040937 learned_addr learned my addr 172.21.15.1:0/2527040937 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281ab150 con 0x55671389e760 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.598+0000 7fcc27fff640 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 0x5567138a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 -- 172.21.15.1:0/2527040937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 msgr2=0x5567138c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 -- 172.21.15.1:0/2527040937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 msgr2=0x5567138c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 -- 172.21.15.1:0/2527040937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567138c4520 con 0x5567138a9940 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc27fff640 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 0x5567138a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000f790 tx=0x7fcc20009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682cd5b10e510b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc0d7fa640 1 -- 172.21.15.1:0/2527040937 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20022ba0 con 0x5567138a9940 2024-09-19T05:31:24.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc0d7fa640 1 -- 172.21.15.1:0/2527040937 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc20022d40 con 0x5567138a9940 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.599+0000 7fcc0d7fa640 1 -- 172.21.15.1:0/2527040937 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004e10 con 0x5567138a9940 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 msgr2=0x5567138a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 0x5567138a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000f790 tx=0x7fcc20009ca0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 shutdown_connections 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567138a9940 0x5567138a3a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55671389f080 0x5567138c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 --2- 172.21.15.1:0/2527040937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 >> 172.21.15.1:0/2527040937 conn(0x55671389acf0 msgr2=0x5567138a8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 shutdown_connections 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- 172.21.15.1:0/2527040937 wait complete. 2024-09-19T05:31:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.600+0000 7fcc3032e740 1 -- start start 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 Processor -- start 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138ba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281ab820 con 0x5567138a9940 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281acc90 con 0x55671389f080 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc281abef0 con 0x55671389e760 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc3032e740 10 client.0 _ll_register_callbacks cb 0x7fcc18011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51336/0 (socket says 172.21.15.1:51336) 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc27fff640 1 -- 172.21.15.1:0/503902434 learned_addr learned my addr 172.21.15.1:0/503902434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc277fe640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.601+0000 7fcc26ffd640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 -- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 msgr2=0x5567138ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 -- 172.21.15.1:0/503902434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 msgr2=0x5567138ba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138ba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 -- 172.21.15.1:0/503902434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567138b6c00 con 0x5567138a9940 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc27fff640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc2002c040 tx=0x7fcc20005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06322425733864 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20038030 con 0x5567138a9940 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc20022d40 con 0x5567138a9940 2024-09-19T05:31:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcc20010430 con 0x5567138a9940 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcc20042050 con 0x5567138a9940 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc3032e740 10 client.15654 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.602+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55671392d560 con 0x5567138a9940 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc20022d40 con 0x5567138a9940 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcc20031030 con 0x5567138a9940 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 10 client.15654 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 10 client.15654 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 20 client.15654 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55671392dd10 0x556713930130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 4 client.15654 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55671380bd20 con 0x55671392dd10 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc277fe640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55671392dd10 0x556713930130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc277fe640 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55671392dd10 0x556713930130 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178a442a0ed98bf0 server_cookie=2a4e128eae10f762 in_seq=0 out_seq=0 2024-09-19T05:31:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.603+0000 7fcc06ffd640 10 client.15654 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.683+0000 7fcc06ffd640 1 -- 172.21.15.1:0/503902434 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55671380bd20 con 0x55671392dd10 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.683+0000 7fcc06ffd640 10 client.15654 handle_command_reply: tid=0 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.683+0000 7fcc3032e740 1 client.15654 shutdown 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 msgr2=0x5567138b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc2002c040 tx=0x7fcc20005f60 comp rx=0 tx=0).stop 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 shutdown_connections 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5567138a9940 0x5567138b63d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55671389f080 0x5567138ba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55671392dd10 0x556713930130 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 --2- 172.21.15.1:0/503902434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55671389e760 0x5567138ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 >> 172.21.15.1:0/503902434 conn(0x55671389acf0 msgr2=0x5567138bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc06ffd640 0 client.15654 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 shutdown_connections 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 1 -- 172.21.15.1:0/503902434 wait complete. 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.684+0000 7fcc3032e740 20 client.15654 trim_cache size 0 max 16384 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:31:24.688 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 38, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "e4ce4709": { 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 38, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 150.0, 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:31:24.689 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:24.690 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 msgr2=0x7fcc100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 0x7fcc100a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcc20013a30 tx=0x7fcc20004730 comp rx=0 tx=0).stop 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 msgr2=0x7fcc2819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009230 tx=0x7fcc1c004040 comp rx=0 tx=0).stop 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 shutdown_connections 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcc100a3240 0x7fcc100a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc28106a70 0x7fcc2819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc28101410 0x7fcc2819abb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 --2- 172.21.15.1:0/855031352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28100a70 0x7fcc2819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 >> 172.21.15.1:0/855031352 conn(0x7fcc280fc790 msgr2=0x7fcc2806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 shutdown_connections 2024-09-19T05:31:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:24.685+0000 7fcc2df55640 1 -- 172.21.15.1:0/855031352 wait complete. 2024-09-19T05:31:25.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.86 MB/sec execute 400 sec latency 722.403 ms 2024-09-19T05:31:25.431 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e4ce4709', quiesce took 3.7 seconds. Will release after: 26.3 2024-09-19T05:31:26.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:25 smithi060 ceph-mon[35058]: pgmap v658: 129 pgs: 129 active+clean; 274 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:25 smithi082 ceph-mon[35195]: pgmap v658: 129 pgs: 129 active+clean; 274 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:25 smithi001 ceph-mon[30968]: pgmap v658: 129 pgs: 129 active+clean; 274 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 2.3 MiB/s wr, 86 op/s 2024-09-19T05:31:26.411 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.83 MB/sec execute 401 sec latency 1722.515 ms 2024-09-19T05:31:27.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.81 MB/sec execute 402 sec latency 2722.640 ms 2024-09-19T05:31:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:27 smithi060 ceph-mon[35058]: pgmap v659: 129 pgs: 129 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 156 op/s 2024-09-19T05:31:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:27 smithi082 ceph-mon[35195]: pgmap v659: 129 pgs: 129 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 156 op/s 2024-09-19T05:31:28.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:27 smithi001 ceph-mon[30968]: pgmap v659: 129 pgs: 129 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.7 MiB/s wr, 156 op/s 2024-09-19T05:31:28.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.78 MB/sec execute 403 sec latency 3722.787 ms 2024-09-19T05:31:29.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.75 MB/sec execute 404 sec latency 4722.890 ms 2024-09-19T05:31:29.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:29 smithi001 ceph-mon[30968]: pgmap v660: 129 pgs: 129 active+clean; 249 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 149 op/s 2024-09-19T05:31:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:29 smithi060 ceph-mon[35058]: pgmap v660: 129 pgs: 129 active+clean; 249 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 149 op/s 2024-09-19T05:31:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:29 smithi082 ceph-mon[35195]: pgmap v660: 129 pgs: 129 active+clean; 249 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 149 op/s 2024-09-19T05:31:30.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.73 MB/sec execute 405 sec latency 5723.004 ms 2024-09-19T05:31:31.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.70 MB/sec execute 406 sec latency 6723.123 ms 2024-09-19T05:31:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:31 smithi082 ceph-mon[35195]: pgmap v661: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-09-19T05:31:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:31 smithi001 ceph-mon[30968]: pgmap v661: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-09-19T05:31:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:31 smithi060 ceph-mon[35058]: pgmap v661: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-09-19T05:31:32.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.67 MB/sec execute 407 sec latency 7723.191 ms 2024-09-19T05:31:33.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.65 MB/sec execute 408 sec latency 8723.487 ms 2024-09-19T05:31:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:33 smithi082 ceph-mon[35195]: pgmap v662: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-09-19T05:31:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:33 smithi001 ceph-mon[30968]: pgmap v662: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-09-19T05:31:34.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:33 smithi060 ceph-mon[35058]: pgmap v662: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-09-19T05:31:34.412 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.62 MB/sec execute 409 sec latency 9723.574 ms 2024-09-19T05:31:35.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.60 MB/sec execute 410 sec latency 10723.672 ms 2024-09-19T05:31:36.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:35 smithi001 ceph-mon[30968]: pgmap v663: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 994 KiB/s wr, 106 op/s 2024-09-19T05:31:36.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:35 smithi060 ceph-mon[35058]: pgmap v663: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 994 KiB/s wr, 106 op/s 2024-09-19T05:31:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:35 smithi082 ceph-mon[35195]: pgmap v663: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 994 KiB/s wr, 106 op/s 2024-09-19T05:31:36.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.57 MB/sec execute 411 sec latency 11723.799 ms 2024-09-19T05:31:37.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.54 MB/sec execute 412 sec latency 12723.910 ms 2024-09-19T05:31:38.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:37 smithi001 ceph-mon[30968]: pgmap v664: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 837 KiB/s wr, 97 op/s 2024-09-19T05:31:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:37 smithi060 ceph-mon[35058]: pgmap v664: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 837 KiB/s wr, 97 op/s 2024-09-19T05:31:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:37 smithi082 ceph-mon[35195]: pgmap v664: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 837 KiB/s wr, 97 op/s 2024-09-19T05:31:38.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.52 MB/sec execute 413 sec latency 13724.022 ms 2024-09-19T05:31:39.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.49 MB/sec execute 414 sec latency 14724.128 ms 2024-09-19T05:31:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:39 smithi001 ceph-mon[30968]: pgmap v665: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 239 KiB/s wr, 22 op/s 2024-09-19T05:31:40.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:39 smithi060 ceph-mon[35058]: pgmap v665: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 239 KiB/s wr, 22 op/s 2024-09-19T05:31:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:39 smithi082 ceph-mon[35195]: pgmap v665: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 239 KiB/s wr, 22 op/s 2024-09-19T05:31:40.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.47 MB/sec execute 415 sec latency 15724.271 ms 2024-09-19T05:31:41.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.44 MB/sec execute 416 sec latency 16724.399 ms 2024-09-19T05:31:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:41 smithi001 ceph-mon[30968]: pgmap v666: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-09-19T05:31:42.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:41 smithi060 ceph-mon[35058]: pgmap v666: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-09-19T05:31:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:41 smithi082 ceph-mon[35195]: pgmap v666: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-09-19T05:31:42.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.42 MB/sec execute 417 sec latency 17724.525 ms 2024-09-19T05:31:43.413 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.39 MB/sec execute 418 sec latency 18724.572 ms 2024-09-19T05:31:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:43 smithi001 ceph-mon[30968]: pgmap v667: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-19T05:31:44.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:43 smithi060 ceph-mon[35058]: pgmap v667: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-19T05:31:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:43 smithi082 ceph-mon[35195]: pgmap v667: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-09-19T05:31:44.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.37 MB/sec execute 419 sec latency 19724.655 ms 2024-09-19T05:31:45.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.34 MB/sec execute 420 sec latency 20724.772 ms 2024-09-19T05:31:46.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:45 smithi001 ceph-mon[30968]: pgmap v668: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T05:31:46.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:45 smithi060 ceph-mon[35058]: pgmap v668: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T05:31:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:45 smithi082 ceph-mon[35195]: pgmap v668: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-19T05:31:46.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.32 MB/sec execute 421 sec latency 21724.917 ms 2024-09-19T05:31:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.29 MB/sec execute 422 sec latency 22725.032 ms 2024-09-19T05:31:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:47 smithi001 ceph-mon[30968]: pgmap v669: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 205 KiB/s wr, 5 op/s 2024-09-19T05:31:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:47 smithi060 ceph-mon[35058]: pgmap v669: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 205 KiB/s wr, 5 op/s 2024-09-19T05:31:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:47 smithi082 ceph-mon[35195]: pgmap v669: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 205 KiB/s wr, 5 op/s 2024-09-19T05:31:48.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.27 MB/sec execute 423 sec latency 23725.141 ms 2024-09-19T05:31:49.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.25 MB/sec execute 424 sec latency 24725.284 ms 2024-09-19T05:31:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:49 smithi001 ceph-mon[30968]: pgmap v670: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 500 KiB/s wr, 10 op/s 2024-09-19T05:31:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:49 smithi060 ceph-mon[35058]: pgmap v670: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 500 KiB/s wr, 10 op/s 2024-09-19T05:31:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:49 smithi082 ceph-mon[35195]: pgmap v670: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 500 KiB/s wr, 10 op/s 2024-09-19T05:31:50.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.22 MB/sec execute 425 sec latency 25725.390 ms 2024-09-19T05:31:51.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.20 MB/sec execute 426 sec latency 26725.497 ms 2024-09-19T05:31:51.733 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:31:52.007 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:51 smithi001 ceph-mon[30968]: pgmap v671: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 750 KiB/s wr, 19 op/s 2024-09-19T05:31:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:51 smithi060 ceph-mon[35058]: pgmap v671: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 750 KiB/s wr, 19 op/s 2024-09-19T05:31:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:51 smithi082 ceph-mon[35195]: pgmap v671: 129 pgs: 129 active+clean; 251 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 750 KiB/s wr, 19 op/s 2024-09-19T05:31:52.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.17 MB/sec execute 427 sec latency 27725.601 ms 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2573860495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138102570 msgr2=0x7ff1381029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2573860495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138102570 0x7ff1381029b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009900 tx=0x7ff12c02a480 comp rx=0 tx=0).stop 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2573860495 shutdown_connections 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2573860495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102ef0 0x7ff13810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2573860495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138102570 0x7ff1381029b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2573860495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138100e20 0x7ff138101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2573860495 >> 172.21.15.1:0/2573860495 conn(0x7ff1380fc7d0 msgr2=0x7ff1380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2573860495 shutdown_connections 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.538+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2573860495 wait complete. 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 Processor -- start 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 -- start start 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 0x7ff138198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 0x7ff13819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff138110f80 con 0x7ff138100e20 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff138110e00 con 0x7ff138102ef0 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff13e8d4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff138111100 con 0x7ff138102570 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff137fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:52.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff137fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50006/0 (socket says 172.21.15.1:50006) 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.539+0000 7ff137fff640 1 -- 172.21.15.1:0/2787185026 learned_addr learned my addr 172.21.15.1:0/2787185026 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff13ce71640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 0x7ff13819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff1377fe640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 0x7ff138198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 -- 172.21.15.1:0/2787185026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 msgr2=0x7ff138198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 0x7ff138198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 -- 172.21.15.1:0/2787185026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 msgr2=0x7ff13819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 0x7ff13819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 -- 172.21.15.1:0/2787185026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13819d3c0 con 0x7ff138100e20 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff13ce71640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 0x7ff13819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff1377fe640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 0x7ff138198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff137fff640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c920 tx=0x7ff12800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:52.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128007c70 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13819d6b0 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff128007e10 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128018890 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.540+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1381a4f90 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.541+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff138101200 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.542+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff128018a70 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.543+0000 7ff1357fa640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 0x7ff1200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.543+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff1280cfec0 con 0x7ff138100e20 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.543+0000 7ff1377fe640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 0x7ff1200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.543+0000 7ff1377fe640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 0x7ff1200a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:52.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.547+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff128014030 con 0x7ff138100e20 2024-09-19T05:31:52.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.757+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff138199770 con 0x7ff138100e20 2024-09-19T05:31:52.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.758+0000 7ff1357fa640 1 -- 172.21.15.1:0/2787185026 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7ff12800de20 con 0x7ff138100e20 2024-09-19T05:31:52.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:31:52.760 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:31:52.760 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:31:52.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 msgr2=0x7ff1200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:52.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 0x7ff1200a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff12c000c00 tx=0x7ff12c004100 comp rx=0 tx=0).stop 2024-09-19T05:31:52.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 msgr2=0x7ff138198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:52.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c920 tx=0x7ff12800cde0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 shutdown_connections 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff1200a3240 0x7ff1200a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff138102ef0 0x7ff13819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff138102570 0x7ff138198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 --2- 172.21.15.1:0/2787185026 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff138100e20 0x7ff138198410 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 >> 172.21.15.1:0/2787185026 conn(0x7ff1380fc7d0 msgr2=0x7ff13806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 shutdown_connections 2024-09-19T05:31:52.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:52.760+0000 7ff13e8d4640 1 -- 172.21.15.1:0/2787185026 wait complete. 2024-09-19T05:31:53.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:53 smithi001 ceph-mon[30968]: pgmap v672: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 25 op/s 2024-09-19T05:31:53.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:53 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2787185026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:53.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1072780 10.15 MB/sec execute 428 sec latency 28725.661 ms 2024-09-19T05:31:53.434 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e4ce4709 --release --await' 2024-09-19T05:31:53.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e4ce4709 --release --await 2024-09-19T05:31:53.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:53 smithi060 ceph-mon[35058]: pgmap v672: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 25 op/s 2024-09-19T05:31:53.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:53 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2787185026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:53 smithi082 ceph-mon[35195]: pgmap v672: 129 pgs: 129 active+clean; 248 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 25 op/s 2024-09-19T05:31:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:53 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2787185026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:31:53.697 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:31:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- 172.21.15.1:0/1149115982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a50102d30 msgr2=0x7f8a50103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 --2- 172.21.15.1:0/1149115982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a50102d30 0x7f8a50103110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009cd0 tx=0x7f8a4002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- 172.21.15.1:0/1149115982 shutdown_connections 2024-09-19T05:31:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 --2- 172.21.15.1:0/1149115982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501082a0 0x7f8a5010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 --2- 172.21.15.1:0/1149115982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a501036e0 0x7f8a50107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 --2- 172.21.15.1:0/1149115982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a50102d30 0x7f8a50103110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- 172.21.15.1:0/1149115982 >> 172.21.15.1:0/1149115982 conn(0x7f8a500fc7d0 msgr2=0x7f8a500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- 172.21.15.1:0/1149115982 shutdown_connections 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- 172.21.15.1:0/1149115982 wait complete. 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 Processor -- start 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.177+0000 7f8a55676640 1 -- start start 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a50102d30 0x7f8a50100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501036e0 0x7f8a50100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501120a0 con 0x7f8a501082a0 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a50111f20 con 0x7f8a50102d30 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a55676640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a50112220 con 0x7f8a501036e0 2024-09-19T05:31:54.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58456/0 (socket says 172.21.15.1:58456) 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 -- 172.21.15.1:0/2663089095 learned_addr learned my addr 172.21.15.1:0/2663089095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a50102d30 0x7f8a50100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501036e0 0x7f8a50100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 -- 172.21.15.1:0/2663089095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501036e0 msgr2=0x7f8a50100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501036e0 0x7f8a50100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 -- 172.21.15.1:0/2663089095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a50102d30 msgr2=0x7f8a50100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a50102d30 0x7f8a50100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 -- 172.21.15.1:0/2663089095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a501a6a60 con 0x7f8a501082a0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.178+0000 7f8a4f7fe640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800d750 tx=0x7f8a4800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.179+0000 7f8a37fff640 1 -- 172.21.15.1:0/2663089095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48017070 con 0x7f8a501082a0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.179+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a501a6d50 con 0x7f8a501082a0 2024-09-19T05:31:54.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.179+0000 7f8a37fff640 1 -- 172.21.15.1:0/2663089095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a48005500 con 0x7f8a501082a0 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.179+0000 7f8a37fff640 1 -- 172.21.15.1:0/2663089095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48004d90 con 0x7f8a501082a0 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.179+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a501a7290 con 0x7f8a501082a0 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.181+0000 7f8a37fff640 1 -- 172.21.15.1:0/2663089095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8a48004f30 con 0x7f8a501082a0 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.181+0000 7f8a57a4f740 1 Processor -- start 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.181+0000 7f8a57a4f740 1 -- start start 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf6cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556dabec7620 con 0x556dabf62060 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dabe6ee50 con 0x556dabf6d240 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556dabec35e0 con 0x556dabf62980 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58470/0 (socket says 172.21.15.1:58470) 2024-09-19T05:31:54.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/751682584 learned_addr learned my addr 172.21.15.1:0/751682584 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a37fff640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 0x7f8a380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4effd640 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf6cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/751682584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 msgr2=0x556dabf6cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf6cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/751682584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 msgr2=0x556dabf6f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4f7fe640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 0x7f8a380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/751682584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dabe5fd40 con 0x556dabf62060 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a37fff640 1 -- 172.21.15.1:0/2663089095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8a480cf570 con 0x7f8a501082a0 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.182+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8a440134e0 tx=0x7f8a4400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9beab05a2a501fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a357fa640 1 -- 172.21.15.1:0/751682584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44019030 con 0x556dabf62060 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a357fa640 1 -- 172.21.15.1:0/751682584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44005500 con 0x556dabf62060 2024-09-19T05:31:54.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a357fa640 1 -- 172.21.15.1:0/751682584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44004e10 con 0x556dabf62060 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a4f7fe640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 0x7f8a380a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8a48097c90 tx=0x7f8a48086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 -- 172.21.15.1:0/751682584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 msgr2=0x556dabf62440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8a440134e0 tx=0x7f8a4400a6e0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 -- 172.21.15.1:0/751682584 shutdown_connections 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf6cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/751682584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf62440 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 -- 172.21.15.1:0/751682584 >> 172.21.15.1:0/751682584 conn(0x556dabf5e5f0 msgr2=0x556dabf5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 -- 172.21.15.1:0/751682584 shutdown_connections 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.183+0000 7f8a57a4f740 1 -- 172.21.15.1:0/751682584 wait complete. 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 -- start start 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 Processor -- start 2024-09-19T05:31:54.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62060 0x556dabf6a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556dabf6fe10 con 0x556dabf62980 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dabe4ff10 con 0x556dabf6d240 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556dabf6ff90 con 0x556dabf62060 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a57a4f740 10 client.0 _ll_register_callbacks cb 0x556dabe73db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58474/0 (socket says 172.21.15.1:58474) 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a4effd640 1 -- 172.21.15.1:0/2922399813 learned_addr learned my addr 172.21.15.1:0/2922399813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62060 0x556dabf6a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.184+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 -- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62060 msgr2=0x556dabf6a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62060 0x556dabf6a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 -- 172.21.15.1:0/2922399813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 msgr2=0x556dabf6ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 -- 172.21.15.1:0/2922399813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dabbd6580 con 0x556dabf62980 2024-09-19T05:31:54.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8a40035000 tx=0x7f8a40031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcff77cbdc91b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40049060 con 0x556dabf62980 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8a40003b80 con 0x556dabf62980 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a44005500 con 0x556dabf62980 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8a40003d80 con 0x556dabf62980 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a57a4f740 10 client.15672 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556dabca0960 con 0x556dabf62980 2024-09-19T05:31:54.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.185+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44005500 con 0x556dabf62980 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8a40043070 con 0x556dabf62980 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 10 client.15672 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 10 client.15672 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 20 client.15672 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabf7ce10 0x556dabf7f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 4 client.15672 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dabed4b90 con 0x556dabf7ce10 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabf7ce10 0x556dabf7f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a32ff5640 10 client.15672 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.186+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabf7ce10 0x556dabf7f230 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a40d3873afb8215a server_cookie=531e84e0a4d5787 in_seq=0 out_seq=0 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2922399813 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556dabed4b90 con 0x556dabf7ce10 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a32ff5640 10 client.15672 handle_command_reply: tid=0 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 client.15672 shutdown 2024-09-19T05:31:54.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 msgr2=0x556dabf6a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8a40035000 tx=0x7f8a40031c30 comp rx=0 tx=0).stop 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 shutdown_connections 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf6d240 0x556dabf6ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62980 0x556dabf6a650 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabf7ce10 0x556dabf7f230 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2922399813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62060 0x556dabf6a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a32ff5640 0 client.15672 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 >> 172.21.15.1:0/2922399813 conn(0x556dabf5e5f0 msgr2=0x556dabf642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 shutdown_connections 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2922399813 wait complete. 2024-09-19T05:31:54.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.187+0000 7f8a57a4f740 20 client.15672 trim_cache size 0 max 16384 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 Processor -- start 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 -- start start 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62980 0x556dabf84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf6d240 0x556dabf85040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501aeff0 con 0x556dabf62060 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501b1870 con 0x556dabf62980 2024-09-19T05:31:54.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501af660 con 0x556dabf6d240 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58480/0 (socket says 172.21.15.1:58480) 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/1976362413 learned_addr learned my addr 172.21.15.1:0/1976362413 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4effd640 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62980 0x556dabf84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/1976362413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf6d240 msgr2=0x556dabf85040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf6d240 0x556dabf85040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/1976362413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62980 msgr2=0x556dabf84b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62980 0x556dabf84b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.205+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/1976362413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dabf627b0 con 0x556dabf62060 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.206+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8a44004940 tx=0x7f8a44015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5228db68a84213e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.206+0000 7f8a34ff9640 1 -- 172.21.15.1:0/1976362413 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44019040 con 0x556dabf62060 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.206+0000 7f8a34ff9640 1 -- 172.21.15.1:0/1976362413 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a4400ab40 con 0x556dabf62060 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.206+0000 7f8a34ff9640 1 -- 172.21.15.1:0/1976362413 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011a30 con 0x556dabf62060 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- 172.21.15.1:0/1976362413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 msgr2=0x556dabf64ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8a44004940 tx=0x7f8a44015040 comp rx=0 tx=0).stop 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- 172.21.15.1:0/1976362413 shutdown_connections 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf6d240 0x556dabf85040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62980 0x556dabf84b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/1976362413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf62060 0x556dabf64ac0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- 172.21.15.1:0/1976362413 >> 172.21.15.1:0/1976362413 conn(0x556dabf5e5f0 msgr2=0x556dabf6c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- 172.21.15.1:0/1976362413 shutdown_connections 2024-09-19T05:31:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- 172.21.15.1:0/1976362413 wait complete. 2024-09-19T05:31:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 -- start start 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.207+0000 7f8a57a4f740 1 Processor -- start 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62060 0x556dabf715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf71b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501afd30 con 0x556dabf6d240 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501b11a0 con 0x556dabf62060 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a501b0400 con 0x556dabf62980 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 10 client.0 _ll_register_callbacks cb 0x7f8a400318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58488/0 (socket says 172.21.15.1:58488) 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/2728472071 learned_addr learned my addr 172.21.15.1:0/2728472071 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf71b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62060 0x556dabf715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 msgr2=0x556dabf71b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf71b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/2728472071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62060 msgr2=0x556dabf715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62060 0x556dabf715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 -- 172.21.15.1:0/2728472071 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dabfe7010 con 0x556dabf6d240 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a4e7fc640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8a440058c0 tx=0x7f8a4401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a916d6d3946e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a32ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44019070 con 0x556dabf6d240 2024-09-19T05:31:54.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8a440116b0 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.208+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a4400ab40 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8a4403a080 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 10 client.15678 fetch_fsmap learned FSMap version 21 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556dabfe8260 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a4400ab40 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8a44003820 con 0x556dabf6d240 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 10 client.15678 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 10 client.15678 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 20 client.15678 populate_metadata read hostname 'smithi001' 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabfe8790 0x556dabfeabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 4 client.15678 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e4ce4709", "release": true, "await": true}] 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e4ce4709", "release": true, "await": true}) -- 0x556dabecf0a0 con 0x556dabfe8790 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.209+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabfe8790 0x556dabfeabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:31:54.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.210+0000 7f8a4effd640 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabfe8790 0x556dabfeabb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54f5879c3396c8f server_cookie=736d0b202a3855e4 in_seq=0 out_seq=0 2024-09-19T05:31:54.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.210+0000 7f8a32ff5640 10 client.15678 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a32ff5640 1 -- 172.21.15.1:0/2728472071 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556dabecf0a0 con 0x556dabfe8790 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a32ff5640 10 client.15678 handle_command_reply: tid=0 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 client.15678 shutdown 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 msgr2=0x556dabfe6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8a440058c0 tx=0x7f8a4401f040 comp rx=0 tx=0).stop 2024-09-19T05:31:54.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 shutdown_connections 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556dabf6d240 0x556dabfe6ad0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556dabfe8790 0x556dabfeabb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556dabf62980 0x556dabf71b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 --2- 172.21.15.1:0/2728472071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dabf62060 0x556dabf715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 >> 172.21.15.1:0/2728472071 conn(0x556dabf5e5f0 msgr2=0x556dabf5cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a32ff5640 0 client.15678 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 shutdown_connections 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 1 -- 172.21.15.1:0/2728472071 wait complete. 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.221+0000 7f8a57a4f740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T05:31:54.224 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 40, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "e4ce4709": { 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 40, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 150.0, 2024-09-19T05:31:54.225 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:31:54.226 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:31:54.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 msgr2=0x7f8a380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 0x7f8a380a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8a48097c90 tx=0x7f8a48086040 comp rx=0 tx=0).stop 2024-09-19T05:31:54.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 msgr2=0x7f8a50101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:31:54.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800d750 tx=0x7f8a4800dc10 comp rx=0 tx=0).stop 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 shutdown_connections 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8a380a3240 0x7f8a380a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8a501082a0 0x7f8a50101410 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a501036e0 0x7f8a50100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 --2- 172.21.15.1:0/2663089095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a50102d30 0x7f8a50100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 >> 172.21.15.1:0/2663089095 conn(0x7f8a500fc7d0 msgr2=0x7f8a50105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 shutdown_connections 2024-09-19T05:31:54.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:31:54.222+0000 7f8a55676640 1 -- 172.21.15.1:0/2663089095 wait complete. 2024-09-19T05:31:54.414 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1073100 10.13 MB/sec execute 429 sec latency 29526.021 ms 2024-09-19T05:31:55.032 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e4ce4709', total seconds elapsed: 33.3 2024-09-19T05:31:55.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:55 smithi001 ceph-mon[30968]: pgmap v673: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 27 op/s 2024-09-19T05:31:55.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1076398 10.15 MB/sec execute 430 sec latency 11.956 ms 2024-09-19T05:31:55.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:55 smithi060 ceph-mon[35058]: pgmap v673: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 27 op/s 2024-09-19T05:31:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:55 smithi082 ceph-mon[35195]: pgmap v673: 129 pgs: 129 active+clean; 247 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 780 KiB/s wr, 27 op/s 2024-09-19T05:31:56.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1079089 10.15 MB/sec execute 431 sec latency 21.722 ms 2024-09-19T05:31:57.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:57 smithi001 ceph-mon[30968]: pgmap v674: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 866 KiB/s wr, 36 op/s 2024-09-19T05:31:57.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1081765 10.16 MB/sec execute 432 sec latency 29.795 ms 2024-09-19T05:31:57.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:57 smithi060 ceph-mon[35058]: pgmap v674: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 866 KiB/s wr, 36 op/s 2024-09-19T05:31:57.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:57 smithi082 ceph-mon[35195]: pgmap v674: 129 pgs: 129 active+clean; 246 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 866 KiB/s wr, 36 op/s 2024-09-19T05:31:58.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1084528 10.17 MB/sec execute 433 sec latency 24.131 ms 2024-09-19T05:31:59.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:31:59 smithi001 ceph-mon[30968]: pgmap v675: 129 pgs: 129 active+clean; 246 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 754 KiB/s wr, 41 op/s 2024-09-19T05:31:59.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1087556 10.19 MB/sec execute 434 sec latency 18.588 ms 2024-09-19T05:31:59.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:31:59 smithi060 ceph-mon[35058]: pgmap v675: 129 pgs: 129 active+clean; 246 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 754 KiB/s wr, 41 op/s 2024-09-19T05:31:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:31:59 smithi082 ceph-mon[35195]: pgmap v675: 129 pgs: 129 active+clean; 246 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 754 KiB/s wr, 41 op/s 2024-09-19T05:32:00.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1090918 10.21 MB/sec execute 435 sec latency 21.359 ms 2024-09-19T05:32:01.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:01 smithi001 ceph-mon[30968]: pgmap v676: 129 pgs: 129 active+clean; 251 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 956 KiB/s wr, 113 op/s 2024-09-19T05:32:01.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1094392 10.23 MB/sec execute 436 sec latency 12.160 ms 2024-09-19T05:32:01.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:01 smithi060 ceph-mon[35058]: pgmap v676: 129 pgs: 129 active+clean; 251 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 956 KiB/s wr, 113 op/s 2024-09-19T05:32:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:01 smithi082 ceph-mon[35195]: pgmap v676: 129 pgs: 129 active+clean; 251 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 956 KiB/s wr, 113 op/s 2024-09-19T05:32:02.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1097682 10.25 MB/sec execute 437 sec latency 36.880 ms 2024-09-19T05:32:03.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1100368 10.25 MB/sec execute 438 sec latency 86.862 ms 2024-09-19T05:32:03.426 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:03 smithi001 ceph-mon[30968]: pgmap v677: 129 pgs: 129 active+clean; 252 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 117 op/s 2024-09-19T05:32:03.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:03 smithi060 ceph-mon[35058]: pgmap v677: 129 pgs: 129 active+clean; 252 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 117 op/s 2024-09-19T05:32:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:03 smithi082 ceph-mon[35195]: pgmap v677: 129 pgs: 129 active+clean; 252 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 886 KiB/s wr, 117 op/s 2024-09-19T05:32:04.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1103478 10.26 MB/sec execute 439 sec latency 13.493 ms 2024-09-19T05:32:05.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1106187 10.28 MB/sec execute 440 sec latency 25.489 ms 2024-09-19T05:32:05.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:05 smithi060 ceph-mon[35058]: pgmap v678: 129 pgs: 129 active+clean; 253 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 912 KiB/s wr, 115 op/s 2024-09-19T05:32:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:05 smithi082 ceph-mon[35195]: pgmap v678: 129 pgs: 129 active+clean; 253 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 912 KiB/s wr, 115 op/s 2024-09-19T05:32:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:05 smithi001 ceph-mon[30968]: pgmap v678: 129 pgs: 129 active+clean; 253 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 912 KiB/s wr, 115 op/s 2024-09-19T05:32:06.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1109147 10.29 MB/sec execute 441 sec latency 22.290 ms 2024-09-19T05:32:07.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1112401 10.31 MB/sec execute 442 sec latency 19.992 ms 2024-09-19T05:32:07.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:07 smithi060 ceph-mon[35058]: pgmap v679: 129 pgs: 129 active+clean; 259 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-19T05:32:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:07 smithi082 ceph-mon[35195]: pgmap v679: 129 pgs: 129 active+clean; 259 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-19T05:32:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:07 smithi001 ceph-mon[30968]: pgmap v679: 129 pgs: 129 active+clean; 259 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.5 MiB/s wr, 198 op/s 2024-09-19T05:32:08.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1115601 10.33 MB/sec execute 443 sec latency 39.015 ms 2024-09-19T05:32:09.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1118838 10.34 MB/sec execute 444 sec latency 49.002 ms 2024-09-19T05:32:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:09 smithi060 ceph-mon[35058]: pgmap v680: 129 pgs: 129 active+clean; 260 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T05:32:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:09 smithi082 ceph-mon[35195]: pgmap v680: 129 pgs: 129 active+clean; 260 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T05:32:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:09 smithi001 ceph-mon[30968]: pgmap v680: 129 pgs: 129 active+clean; 260 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2024-09-19T05:32:10.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1121753 10.35 MB/sec execute 445 sec latency 27.863 ms 2024-09-19T05:32:11.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1124834 10.36 MB/sec execute 446 sec latency 16.006 ms 2024-09-19T05:32:11.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:11 smithi060 ceph-mon[35058]: pgmap v681: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-09-19T05:32:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:11 smithi082 ceph-mon[35195]: pgmap v681: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-09-19T05:32:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:11 smithi001 ceph-mon[30968]: pgmap v681: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-09-19T05:32:12.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1127250 10.37 MB/sec execute 447 sec latency 61.476 ms 2024-09-19T05:32:13.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1130118 10.38 MB/sec execute 448 sec latency 36.708 ms 2024-09-19T05:32:13.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:13 smithi060 ceph-mon[35058]: pgmap v682: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-19T05:32:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:32:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:13 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:13 smithi082 ceph-mon[35195]: pgmap v682: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-19T05:32:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:32:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:13 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:13 smithi001 ceph-mon[30968]: pgmap v682: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 224 op/s 2024-09-19T05:32:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:32:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:13 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:14.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:32:14.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:32:14.345 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:14.415 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1133435 10.40 MB/sec execute 449 sec latency 23.268 ms 2024-09-19T05:32:14.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:32:14.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:32:14.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:14.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:32:14.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:32:14.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:32:15.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1136726 10.42 MB/sec execute 450 sec latency 13.951 ms 2024-09-19T05:32:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:15 smithi060 ceph-mon[35058]: pgmap v683: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-19T05:32:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:15 smithi082 ceph-mon[35195]: pgmap v683: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-19T05:32:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:15 smithi001 ceph-mon[30968]: pgmap v683: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 218 op/s 2024-09-19T05:32:16.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1139412 10.42 MB/sec execute 451 sec latency 22.062 ms 2024-09-19T05:32:17.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1142292 10.43 MB/sec execute 452 sec latency 15.485 ms 2024-09-19T05:32:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:17 smithi060 ceph-mon[35058]: pgmap v684: 129 pgs: 129 active+clean; 265 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2024-09-19T05:32:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:17 smithi082 ceph-mon[35195]: pgmap v684: 129 pgs: 129 active+clean; 265 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2024-09-19T05:32:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:17 smithi001 ceph-mon[30968]: pgmap v684: 129 pgs: 129 active+clean; 265 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 225 op/s 2024-09-19T05:32:18.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1144722 10.44 MB/sec execute 453 sec latency 85.584 ms 2024-09-19T05:32:19.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1148009 10.46 MB/sec execute 454 sec latency 17.354 ms 2024-09-19T05:32:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:19 smithi060 ceph-mon[35058]: pgmap v685: 129 pgs: 129 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:19 smithi082 ceph-mon[35195]: pgmap v685: 129 pgs: 129 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:19 smithi001 ceph-mon[30968]: pgmap v685: 129 pgs: 129 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:20.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1151417 10.48 MB/sec execute 455 sec latency 15.952 ms 2024-09-19T05:32:21.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1154773 10.50 MB/sec execute 456 sec latency 31.646 ms 2024-09-19T05:32:21.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:21 smithi060 ceph-mon[35058]: pgmap v686: 129 pgs: 129 active+clean; 273 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:32:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:21 smithi082 ceph-mon[35195]: pgmap v686: 129 pgs: 129 active+clean; 273 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:32:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:21 smithi001 ceph-mon[30968]: pgmap v686: 129 pgs: 129 active+clean; 273 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 243 op/s 2024-09-19T05:32:22.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1158174 10.51 MB/sec execute 457 sec latency 17.682 ms 2024-09-19T05:32:23.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1159576 10.50 MB/sec execute 458 sec latency 249.309 ms 2024-09-19T05:32:23.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:23 smithi060 ceph-mon[35058]: pgmap v687: 129 pgs: 129 active+clean; 271 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:23 smithi082 ceph-mon[35195]: pgmap v687: 129 pgs: 129 active+clean; 271 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:23 smithi001 ceph-mon[30968]: pgmap v687: 129 pgs: 129 active+clean; 271 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.7 MiB/s wr, 221 op/s 2024-09-19T05:32:24.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1162658 10.51 MB/sec execute 459 sec latency 19.119 ms 2024-09-19T05:32:25.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1165735 10.53 MB/sec execute 460 sec latency 23.470 ms 2024-09-19T05:32:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:25 smithi060 ceph-mon[35058]: pgmap v688: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-19T05:32:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:25 smithi082 ceph-mon[35195]: pgmap v688: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-19T05:32:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:25 smithi001 ceph-mon[30968]: pgmap v688: 129 pgs: 129 active+clean; 264 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.4 MiB/s wr, 179 op/s 2024-09-19T05:32:26.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1169006 10.55 MB/sec execute 461 sec latency 25.424 ms 2024-09-19T05:32:27.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1172371 10.57 MB/sec execute 462 sec latency 14.796 ms 2024-09-19T05:32:27.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:27 smithi060 ceph-mon[35058]: pgmap v689: 129 pgs: 129 active+clean; 255 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-19T05:32:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:27 smithi082 ceph-mon[35195]: pgmap v689: 129 pgs: 129 active+clean; 255 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-19T05:32:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:27 smithi001 ceph-mon[30968]: pgmap v689: 129 pgs: 129 active+clean; 255 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-19T05:32:28.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1175800 10.58 MB/sec execute 463 sec latency 13.896 ms 2024-09-19T05:32:29.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1178993 10.59 MB/sec execute 464 sec latency 28.943 ms 2024-09-19T05:32:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:29 smithi060 ceph-mon[35058]: pgmap v690: 129 pgs: 129 active+clean; 260 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 292 op/s 2024-09-19T05:32:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:29 smithi082 ceph-mon[35195]: pgmap v690: 129 pgs: 129 active+clean; 260 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 292 op/s 2024-09-19T05:32:29.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:29 smithi001 ceph-mon[30968]: pgmap v690: 129 pgs: 129 active+clean; 260 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.2 MiB/s wr, 292 op/s 2024-09-19T05:32:30.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1181578 10.60 MB/sec execute 465 sec latency 62.430 ms 2024-09-19T05:32:31.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1183615 10.60 MB/sec execute 466 sec latency 71.472 ms 2024-09-19T05:32:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:31 smithi060 ceph-mon[35058]: pgmap v691: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:32:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:31 smithi082 ceph-mon[35195]: pgmap v691: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:32:31.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:31 smithi001 ceph-mon[30968]: pgmap v691: 129 pgs: 129 active+clean; 263 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-19T05:32:32.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1186682 10.62 MB/sec execute 467 sec latency 19.194 ms 2024-09-19T05:32:33.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1189908 10.63 MB/sec execute 468 sec latency 21.451 ms 2024-09-19T05:32:33.643 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:33 smithi001 ceph-mon[30968]: pgmap v692: 129 pgs: 129 active+clean; 264 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T05:32:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:33 smithi060 ceph-mon[35058]: pgmap v692: 129 pgs: 129 active+clean; 264 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T05:32:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:33 smithi082 ceph-mon[35195]: pgmap v692: 129 pgs: 129 active+clean; 264 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-19T05:32:34.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1192598 10.64 MB/sec execute 469 sec latency 24.106 ms 2024-09-19T05:32:35.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1195255 10.64 MB/sec execute 470 sec latency 20.965 ms 2024-09-19T05:32:35.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:35 smithi060 ceph-mon[35058]: pgmap v693: 129 pgs: 129 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 255 op/s 2024-09-19T05:32:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:35 smithi082 ceph-mon[35195]: pgmap v693: 129 pgs: 129 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 255 op/s 2024-09-19T05:32:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:35 smithi001 ceph-mon[30968]: pgmap v693: 129 pgs: 129 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 255 op/s 2024-09-19T05:32:36.416 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1197493 10.65 MB/sec execute 471 sec latency 63.979 ms 2024-09-19T05:32:37.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1200774 10.67 MB/sec execute 472 sec latency 19.726 ms 2024-09-19T05:32:37.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:37 smithi060 ceph-mon[35058]: pgmap v694: 129 pgs: 129 active+clean; 266 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 290 op/s 2024-09-19T05:32:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:37 smithi082 ceph-mon[35195]: pgmap v694: 129 pgs: 129 active+clean; 266 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 290 op/s 2024-09-19T05:32:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:37 smithi001 ceph-mon[30968]: pgmap v694: 129 pgs: 129 active+clean; 266 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 290 op/s 2024-09-19T05:32:38.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1204091 10.68 MB/sec execute 473 sec latency 11.744 ms 2024-09-19T05:32:39.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1206602 10.68 MB/sec execute 474 sec latency 31.184 ms 2024-09-19T05:32:39.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:39 smithi060 ceph-mon[35058]: pgmap v695: 129 pgs: 129 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T05:32:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:39 smithi082 ceph-mon[35195]: pgmap v695: 129 pgs: 129 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T05:32:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:39 smithi001 ceph-mon[30968]: pgmap v695: 129 pgs: 129 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-19T05:32:40.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1209258 10.69 MB/sec execute 475 sec latency 16.849 ms 2024-09-19T05:32:41.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1211707 10.70 MB/sec execute 476 sec latency 73.390 ms 2024-09-19T05:32:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:41 smithi060 ceph-mon[35058]: pgmap v696: 129 pgs: 129 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 293 op/s 2024-09-19T05:32:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:41 smithi082 ceph-mon[35195]: pgmap v696: 129 pgs: 129 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 293 op/s 2024-09-19T05:32:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:41 smithi001 ceph-mon[30968]: pgmap v696: 129 pgs: 129 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 293 op/s 2024-09-19T05:32:42.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1214813 10.71 MB/sec execute 477 sec latency 23.975 ms 2024-09-19T05:32:43.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1217642 10.72 MB/sec execute 478 sec latency 11.269 ms 2024-09-19T05:32:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:43 smithi060 ceph-mon[35058]: pgmap v697: 129 pgs: 129 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 270 op/s 2024-09-19T05:32:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:43 smithi082 ceph-mon[35195]: pgmap v697: 129 pgs: 129 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 270 op/s 2024-09-19T05:32:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:43 smithi001 ceph-mon[30968]: pgmap v697: 129 pgs: 129 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 270 op/s 2024-09-19T05:32:44.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1219203 10.71 MB/sec execute 479 sec latency 183.125 ms 2024-09-19T05:32:45.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1222421 10.73 MB/sec execute 480 sec latency 35.826 ms 2024-09-19T05:32:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:45 smithi060 ceph-mon[35058]: pgmap v698: 129 pgs: 129 active+clean; 279 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:32:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:45 smithi082 ceph-mon[35195]: pgmap v698: 129 pgs: 129 active+clean; 279 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:32:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:45 smithi001 ceph-mon[30968]: pgmap v698: 129 pgs: 129 active+clean; 279 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 249 op/s 2024-09-19T05:32:46.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1225418 10.74 MB/sec execute 481 sec latency 44.598 ms 2024-09-19T05:32:47.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1227909 10.74 MB/sec execute 482 sec latency 50.729 ms 2024-09-19T05:32:47.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:47 smithi060 ceph-mon[35058]: pgmap v699: 129 pgs: 129 active+clean; 284 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2024-09-19T05:32:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:47 smithi082 ceph-mon[35195]: pgmap v699: 129 pgs: 129 active+clean; 284 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2024-09-19T05:32:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:47 smithi001 ceph-mon[30968]: pgmap v699: 129 pgs: 129 active+clean; 284 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2024-09-19T05:32:48.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1230607 10.75 MB/sec execute 483 sec latency 22.625 ms 2024-09-19T05:32:49.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1233547 10.76 MB/sec execute 484 sec latency 27.631 ms 2024-09-19T05:32:49.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:49 smithi060 ceph-mon[35058]: pgmap v700: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-19T05:32:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:49 smithi082 ceph-mon[35195]: pgmap v700: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-19T05:32:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:49 smithi001 ceph-mon[30968]: pgmap v700: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.4 MiB/s wr, 305 op/s 2024-09-19T05:32:50.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1236656 10.78 MB/sec execute 485 sec latency 22.724 ms 2024-09-19T05:32:51.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1239568 10.79 MB/sec execute 486 sec latency 63.609 ms 2024-09-19T05:32:51.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:51 smithi060 ceph-mon[35058]: pgmap v701: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 260 op/s 2024-09-19T05:32:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:51 smithi082 ceph-mon[35195]: pgmap v701: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 260 op/s 2024-09-19T05:32:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:51 smithi001 ceph-mon[30968]: pgmap v701: 129 pgs: 129 active+clean; 286 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 260 op/s 2024-09-19T05:32:52.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1241918 10.78 MB/sec execute 487 sec latency 33.119 ms 2024-09-19T05:32:53.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1244544 10.80 MB/sec execute 488 sec latency 28.012 ms 2024-09-19T05:32:53.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:53 smithi060 ceph-mon[35058]: pgmap v702: 129 pgs: 129 active+clean; 285 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 260 op/s 2024-09-19T05:32:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:53 smithi082 ceph-mon[35195]: pgmap v702: 129 pgs: 129 active+clean; 285 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 260 op/s 2024-09-19T05:32:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:53 smithi001 ceph-mon[30968]: pgmap v702: 129 pgs: 129 active+clean; 285 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 260 op/s 2024-09-19T05:32:54.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1247460 10.81 MB/sec execute 489 sec latency 20.503 ms 2024-09-19T05:32:55.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1250699 10.82 MB/sec execute 490 sec latency 29.182 ms 2024-09-19T05:32:55.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:55 smithi060 ceph-mon[35058]: pgmap v703: 129 pgs: 129 active+clean; 285 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 249 op/s 2024-09-19T05:32:55.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:55 smithi082 ceph-mon[35195]: pgmap v703: 129 pgs: 129 active+clean; 285 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 249 op/s 2024-09-19T05:32:55.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:55 smithi001 ceph-mon[30968]: pgmap v703: 129 pgs: 129 active+clean; 285 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 249 op/s 2024-09-19T05:32:56.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1253491 10.83 MB/sec execute 491 sec latency 82.377 ms 2024-09-19T05:32:57.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1256261 10.83 MB/sec execute 492 sec latency 24.626 ms 2024-09-19T05:32:57.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:57 smithi060 ceph-mon[35058]: pgmap v704: 129 pgs: 129 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 327 op/s 2024-09-19T05:32:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:57 smithi082 ceph-mon[35195]: pgmap v704: 129 pgs: 129 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 327 op/s 2024-09-19T05:32:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:57 smithi001 ceph-mon[30968]: pgmap v704: 129 pgs: 129 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 327 op/s 2024-09-19T05:32:58.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1259553 10.85 MB/sec execute 493 sec latency 23.364 ms 2024-09-19T05:32:59.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1262190 10.86 MB/sec execute 494 sec latency 24.239 ms 2024-09-19T05:32:59.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:32:59 smithi060 ceph-mon[35058]: pgmap v705: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 311 op/s 2024-09-19T05:32:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:32:59 smithi082 ceph-mon[35195]: pgmap v705: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 311 op/s 2024-09-19T05:32:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:32:59 smithi001 ceph-mon[30968]: pgmap v705: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 311 op/s 2024-09-19T05:33:00.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1265225 10.87 MB/sec execute 495 sec latency 20.108 ms 2024-09-19T05:33:01.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1268218 10.88 MB/sec execute 496 sec latency 96.917 ms 2024-09-19T05:33:01.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:01 smithi060 ceph-mon[35058]: pgmap v706: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-19T05:33:01.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:01 smithi082 ceph-mon[35195]: pgmap v706: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-19T05:33:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:01 smithi001 ceph-mon[30968]: pgmap v706: 129 pgs: 129 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 286 op/s 2024-09-19T05:33:02.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1271021 10.89 MB/sec execute 497 sec latency 61.445 ms 2024-09-19T05:33:03.417 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1273818 10.89 MB/sec execute 498 sec latency 14.589 ms 2024-09-19T05:33:03.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:03 smithi060 ceph-mon[35058]: pgmap v707: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 326 op/s 2024-09-19T05:33:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:03 smithi082 ceph-mon[35195]: pgmap v707: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 326 op/s 2024-09-19T05:33:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:03 smithi001 ceph-mon[30968]: pgmap v707: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 326 op/s 2024-09-19T05:33:04.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1276467 10.90 MB/sec execute 499 sec latency 20.283 ms 2024-09-19T05:33:05.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1279260 10.91 MB/sec execute 500 sec latency 25.457 ms 2024-09-19T05:33:05.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:05 smithi060 ceph-mon[35058]: pgmap v708: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-09-19T05:33:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:05 smithi082 ceph-mon[35195]: pgmap v708: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-09-19T05:33:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:05 smithi001 ceph-mon[30968]: pgmap v708: 129 pgs: 129 active+clean; 266 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-09-19T05:33:06.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1282273 10.93 MB/sec execute 501 sec latency 55.835 ms 2024-09-19T05:33:07.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1284959 10.93 MB/sec execute 502 sec latency 24.699 ms 2024-09-19T05:33:07.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:07 smithi060 ceph-mon[35058]: pgmap v709: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 351 op/s 2024-09-19T05:33:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:07 smithi082 ceph-mon[35195]: pgmap v709: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 351 op/s 2024-09-19T05:33:07.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:07 smithi001 ceph-mon[30968]: pgmap v709: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 351 op/s 2024-09-19T05:33:08.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1288544 10.95 MB/sec execute 503 sec latency 12.328 ms 2024-09-19T05:33:09.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1291678 10.95 MB/sec execute 504 sec latency 12.658 ms 2024-09-19T05:33:09.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:09 smithi060 ceph-mon[35058]: pgmap v710: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 289 op/s 2024-09-19T05:33:09.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:09 smithi082 ceph-mon[35195]: pgmap v710: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 289 op/s 2024-09-19T05:33:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:09 smithi001 ceph-mon[30968]: pgmap v710: 129 pgs: 129 active+clean; 270 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.1 MiB/s wr, 289 op/s 2024-09-19T05:33:10.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1294793 10.97 MB/sec execute 505 sec latency 22.000 ms 2024-09-19T05:33:11.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1297163 10.97 MB/sec execute 506 sec latency 72.127 ms 2024-09-19T05:33:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:11 smithi060 ceph-mon[35058]: pgmap v711: 129 pgs: 129 active+clean; 272 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 248 op/s 2024-09-19T05:33:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:11 smithi082 ceph-mon[35195]: pgmap v711: 129 pgs: 129 active+clean; 272 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 248 op/s 2024-09-19T05:33:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:11 smithi001 ceph-mon[30968]: pgmap v711: 129 pgs: 129 active+clean; 272 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 248 op/s 2024-09-19T05:33:12.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1300333 10.99 MB/sec execute 507 sec latency 41.952 ms 2024-09-19T05:33:13.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1303642 11.00 MB/sec execute 508 sec latency 20.522 ms 2024-09-19T05:33:13.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:13 smithi060 ceph-mon[35058]: pgmap v712: 129 pgs: 129 active+clean; 277 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 325 op/s 2024-09-19T05:33:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:13 smithi082 ceph-mon[35195]: pgmap v712: 129 pgs: 129 active+clean; 277 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 325 op/s 2024-09-19T05:33:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:13 smithi001 ceph-mon[30968]: pgmap v712: 129 pgs: 129 active+clean; 277 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 325 op/s 2024-09-19T05:33:14.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1306532 11.01 MB/sec execute 509 sec latency 32.132 ms 2024-09-19T05:33:14.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:33:14.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:14 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:33:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:14 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:33:14.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:14.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:14 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:15.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1309780 11.02 MB/sec execute 510 sec latency 17.556 ms 2024-09-19T05:33:15.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:15 smithi060 ceph-mon[35058]: pgmap v713: 129 pgs: 129 active+clean; 279 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-19T05:33:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:33:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:33:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:15 smithi082 ceph-mon[35195]: pgmap v713: 129 pgs: 129 active+clean; 279 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-19T05:33:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:33:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:33:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:15 smithi001 ceph-mon[30968]: pgmap v713: 129 pgs: 129 active+clean; 279 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-19T05:33:15.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:33:15.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:33:15.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:33:16.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1312160 11.02 MB/sec execute 511 sec latency 46.919 ms 2024-09-19T05:33:17.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1314589 11.03 MB/sec execute 512 sec latency 71.587 ms 2024-09-19T05:33:17.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:17 smithi060 ceph-mon[35058]: pgmap v714: 129 pgs: 129 active+clean; 279 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-09-19T05:33:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:17 smithi082 ceph-mon[35195]: pgmap v714: 129 pgs: 129 active+clean; 279 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-09-19T05:33:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:17 smithi001 ceph-mon[30968]: pgmap v714: 129 pgs: 129 active+clean; 279 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-09-19T05:33:18.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1317834 11.04 MB/sec execute 513 sec latency 21.259 ms 2024-09-19T05:33:19.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1321035 11.06 MB/sec execute 514 sec latency 18.985 ms 2024-09-19T05:33:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:19 smithi060 ceph-mon[35058]: pgmap v715: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-19T05:33:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:19 smithi082 ceph-mon[35195]: pgmap v715: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-19T05:33:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:19 smithi001 ceph-mon[30968]: pgmap v715: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-19T05:33:20.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1323967 11.06 MB/sec execute 515 sec latency 15.393 ms 2024-09-19T05:33:21.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1327005 11.07 MB/sec execute 516 sec latency 19.517 ms 2024-09-19T05:33:21.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:21 smithi060 ceph-mon[35058]: pgmap v716: 129 pgs: 129 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-19T05:33:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:21 smithi082 ceph-mon[35195]: pgmap v716: 129 pgs: 129 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-19T05:33:21.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:21 smithi001 ceph-mon[30968]: pgmap v716: 129 pgs: 129 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-19T05:33:22.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1328799 11.07 MB/sec execute 517 sec latency 125.245 ms 2024-09-19T05:33:23.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1332117 11.08 MB/sec execute 518 sec latency 19.403 ms 2024-09-19T05:33:23.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:23 smithi060 ceph-mon[35058]: pgmap v717: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 313 op/s 2024-09-19T05:33:23.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:23 smithi082 ceph-mon[35195]: pgmap v717: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 313 op/s 2024-09-19T05:33:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:23 smithi001 ceph-mon[30968]: pgmap v717: 129 pgs: 129 active+clean; 281 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 313 op/s 2024-09-19T05:33:24.418 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1335368 11.10 MB/sec execute 519 sec latency 48.553 ms 2024-09-19T05:33:25.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1338048 11.10 MB/sec execute 520 sec latency 26.399 ms 2024-09-19T05:33:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:25 smithi060 ceph-mon[35058]: pgmap v718: 129 pgs: 129 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-19T05:33:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:25 smithi082 ceph-mon[35195]: pgmap v718: 129 pgs: 129 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-19T05:33:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:25 smithi001 ceph-mon[30968]: pgmap v718: 129 pgs: 129 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-19T05:33:26.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1340629 11.10 MB/sec execute 521 sec latency 18.373 ms 2024-09-19T05:33:27.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1342819 11.11 MB/sec execute 522 sec latency 58.559 ms 2024-09-19T05:33:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:27 smithi060 ceph-mon[35058]: pgmap v719: 129 pgs: 129 active+clean; 265 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-09-19T05:33:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:27 smithi082 ceph-mon[35195]: pgmap v719: 129 pgs: 129 active+clean; 265 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-09-19T05:33:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:27 smithi001 ceph-mon[30968]: pgmap v719: 129 pgs: 129 active+clean; 265 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-09-19T05:33:28.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1346131 11.12 MB/sec execute 523 sec latency 22.590 ms 2024-09-19T05:33:29.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1349111 11.13 MB/sec execute 524 sec latency 27.266 ms 2024-09-19T05:33:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:29 smithi060 ceph-mon[35058]: pgmap v720: 129 pgs: 129 active+clean; 262 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-19T05:33:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:29 smithi082 ceph-mon[35195]: pgmap v720: 129 pgs: 129 active+clean; 262 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-19T05:33:29.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:29 smithi001 ceph-mon[30968]: pgmap v720: 129 pgs: 129 active+clean; 262 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-19T05:33:30.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1352219 11.14 MB/sec execute 525 sec latency 12.523 ms 2024-09-19T05:33:31.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1355337 11.15 MB/sec execute 526 sec latency 23.457 ms 2024-09-19T05:33:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:31 smithi060 ceph-mon[35058]: pgmap v721: 129 pgs: 129 active+clean; 266 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:33:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:31 smithi082 ceph-mon[35195]: pgmap v721: 129 pgs: 129 active+clean; 266 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:33:31.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:31 smithi001 ceph-mon[30968]: pgmap v721: 129 pgs: 129 active+clean; 266 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 273 op/s 2024-09-19T05:33:32.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1357366 11.15 MB/sec execute 527 sec latency 82.195 ms 2024-09-19T05:33:33.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1360416 11.16 MB/sec execute 528 sec latency 41.950 ms 2024-09-19T05:33:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:33 smithi060 ceph-mon[35058]: pgmap v722: 129 pgs: 129 active+clean; 267 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-19T05:33:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:33 smithi082 ceph-mon[35195]: pgmap v722: 129 pgs: 129 active+clean; 267 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-19T05:33:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:33 smithi001 ceph-mon[30968]: pgmap v722: 129 pgs: 129 active+clean; 267 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-19T05:33:34.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1363468 11.17 MB/sec execute 529 sec latency 20.943 ms 2024-09-19T05:33:35.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1366394 11.18 MB/sec execute 530 sec latency 20.943 ms 2024-09-19T05:33:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:35 smithi060 ceph-mon[35058]: pgmap v723: 129 pgs: 129 active+clean; 270 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:33:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:35 smithi082 ceph-mon[35195]: pgmap v723: 129 pgs: 129 active+clean; 270 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:33:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:35 smithi001 ceph-mon[30968]: pgmap v723: 129 pgs: 129 active+clean; 270 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 278 op/s 2024-09-19T05:33:36.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1368875 11.18 MB/sec execute 531 sec latency 21.190 ms 2024-09-19T05:33:37.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1371282 11.19 MB/sec execute 532 sec latency 57.552 ms 2024-09-19T05:33:37.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:37 smithi060 ceph-mon[35058]: pgmap v724: 129 pgs: 129 active+clean; 273 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:37 smithi082 ceph-mon[35195]: pgmap v724: 129 pgs: 129 active+clean; 273 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:37 smithi001 ceph-mon[30968]: pgmap v724: 129 pgs: 129 active+clean; 273 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:38.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1374235 11.20 MB/sec execute 533 sec latency 41.605 ms 2024-09-19T05:33:39.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1375924 11.22 MB/sec execute 534 sec latency 38.937 ms 2024-09-19T05:33:39.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:39 smithi060 ceph-mon[35058]: pgmap v725: 129 pgs: 129 active+clean; 276 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 335 op/s 2024-09-19T05:33:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:39 smithi082 ceph-mon[35195]: pgmap v725: 129 pgs: 129 active+clean; 276 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 335 op/s 2024-09-19T05:33:39.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:39 smithi001 ceph-mon[30968]: pgmap v725: 129 pgs: 129 active+clean; 276 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 335 op/s 2024-09-19T05:33:40.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1379183 11.24 MB/sec execute 535 sec latency 25.767 ms 2024-09-19T05:33:41.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1382373 11.25 MB/sec execute 536 sec latency 12.067 ms 2024-09-19T05:33:41.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:41 smithi060 ceph-mon[35058]: pgmap v726: 129 pgs: 129 active+clean; 276 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2024-09-19T05:33:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:41 smithi082 ceph-mon[35195]: pgmap v726: 129 pgs: 129 active+clean; 276 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2024-09-19T05:33:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:41 smithi001 ceph-mon[30968]: pgmap v726: 129 pgs: 129 active+clean; 276 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 288 op/s 2024-09-19T05:33:42.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1384459 11.24 MB/sec execute 537 sec latency 104.809 ms 2024-09-19T05:33:43.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1386472 11.25 MB/sec execute 538 sec latency 52.415 ms 2024-09-19T05:33:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:43 smithi060 ceph-mon[35058]: pgmap v727: 129 pgs: 129 active+clean; 279 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:43 smithi082 ceph-mon[35195]: pgmap v727: 129 pgs: 129 active+clean; 279 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:43 smithi001 ceph-mon[30968]: pgmap v727: 129 pgs: 129 active+clean; 279 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-19T05:33:44.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1389782 11.26 MB/sec execute 539 sec latency 6.810 ms 2024-09-19T05:33:45.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1393086 11.27 MB/sec execute 540 sec latency 13.704 ms 2024-09-19T05:33:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:45 smithi060 ceph-mon[35058]: pgmap v728: 129 pgs: 129 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:33:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:45 smithi082 ceph-mon[35195]: pgmap v728: 129 pgs: 129 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:33:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:45 smithi001 ceph-mon[30968]: pgmap v728: 129 pgs: 129 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:33:46.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1396009 11.28 MB/sec execute 541 sec latency 28.541 ms 2024-09-19T05:33:46.461 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:33:46.462 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T05:33:46.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:33:46.734 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:33:47.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1397614 11.27 MB/sec execute 542 sec latency 55.985 ms 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1529463459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102570 msgr2=0x7fe3141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1529463459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102570 0x7fe3141029b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe304009900 tx=0x7fe30402a480 comp rx=0 tx=0).stop 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1529463459 shutdown_connections 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1529463459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314102ef0 0x7fe31410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1529463459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102570 0x7fe3141029b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1529463459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314100e20 0x7fe314101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1529463459 >> 172.21.15.1:0/1529463459 conn(0x7fe3140fc7d0 msgr2=0x7fe3140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1529463459 shutdown_connections 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.403+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1529463459 wait complete. 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 Processor -- start 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 -- start start 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314102570 0x7fe3140fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102ef0 0x7fe3140fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe314110f80 con 0x7fe314102ef0 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe314110e00 con 0x7fe314100e20 2024-09-19T05:33:47.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31bcb3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe314111100 con 0x7fe314102570 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31a250640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102ef0 0x7fe3140fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe31924e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314102570 0x7fe3140fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56748/0 (socket says 172.21.15.1:56748) 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 -- 172.21.15.1:0/1986947787 learned_addr learned my addr 172.21.15.1:0/1986947787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 -- 172.21.15.1:0/1986947787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314102570 msgr2=0x7fe3140fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314102570 0x7fe3140fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 -- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102ef0 msgr2=0x7fe3140fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102ef0 0x7fe3140fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.404+0000 7fe319a4f640 1 -- 172.21.15.1:0/1986947787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3141a6990 con 0x7fe314100e20 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe319a4f640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e9f0 tx=0x7fe31000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:47.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31000cd80 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe310005500 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3141a6c80 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310010690 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.405+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3141a7140 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.406+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe314101200 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.407+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe3100046c0 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.408+0000 7fe30affd640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 0x7fe3000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.408+0000 7fe31924e640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 0x7fe3000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.408+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe3100d0140 con 0x7fe314100e20 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.408+0000 7fe31924e640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 0x7fe3000a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe304009230 tx=0x7fe3040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:47.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.412+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe31009ca50 con 0x7fe314100e20 2024-09-19T05:33:47.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.646+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31410a0a0 con 0x7fe314100e20 2024-09-19T05:33:47.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.647+0000 7fe30affd640 1 -- 172.21.15.1:0/1986947787 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fe31009c350 con 0x7fe314100e20 2024-09-19T05:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:33:47.649 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:33:47.649 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:33:47.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 msgr2=0x7fe3000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 0x7fe3000a5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe304009230 tx=0x7fe3040058d0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 msgr2=0x7fe3140fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:47.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe31000e9f0 tx=0x7fe31000edf0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 shutdown_connections 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe3000a3240 0x7fe3000a5700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe314102ef0 0x7fe3140fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe314102570 0x7fe3140fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 --2- 172.21.15.1:0/1986947787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe314100e20 0x7fe3140fcc80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.649+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 >> 172.21.15.1:0/1986947787 conn(0x7fe3140fc7d0 msgr2=0x7fe31406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.650+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 shutdown_connections 2024-09-19T05:33:47.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:47.650+0000 7fe31bcb3640 1 -- 172.21.15.1:0/1986947787 wait complete. 2024-09-19T05:33:47.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:47 smithi001 ceph-mon[30968]: pgmap v729: 129 pgs: 129 active+clean; 271 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 323 op/s 2024-09-19T05:33:47.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:47 smithi060 ceph-mon[35058]: pgmap v729: 129 pgs: 129 active+clean; 271 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 323 op/s 2024-09-19T05:33:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:47 smithi082 ceph-mon[35195]: pgmap v729: 129 pgs: 129 active+clean; 271 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 323 op/s 2024-09-19T05:33:48.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1400585 11.28 MB/sec execute 543 sec latency 42.037 ms 2024-09-19T05:33:48.493 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T05:33:48.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T05:33:48.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:48 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1986947787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:33:48.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:48 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1986947787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:33:48.773 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:33:48.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:48 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1986947787' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:33:49.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 -- 172.21.15.1:0/1281146758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 msgr2=0x7facf4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 --2- 172.21.15.1:0/1281146758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4101200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7facec009900 tx=0x7facec02a480 comp rx=0 tx=0).stop 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 -- 172.21.15.1:0/1281146758 shutdown_connections 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 --2- 172.21.15.1:0/1281146758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 0x7facf410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 --2- 172.21.15.1:0/1281146758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 --2- 172.21.15.1:0/1281146758 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4101200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 -- 172.21.15.1:0/1281146758 >> 172.21.15.1:0/1281146758 conn(0x7facf40fc7d0 msgr2=0x7facf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 -- 172.21.15.1:0/1281146758 shutdown_connections 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.375+0000 7facfc06a640 1 -- 172.21.15.1:0/1281146758 wait complete. 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 Processor -- start 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 -- start start 2024-09-19T05:33:49.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 0x7facf4111e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7facf4110f80 con 0x7facf4100e20 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7facf4110e00 con 0x7facf4102570 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfc06a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facf4111100 con 0x7facf4102ef0 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facf9e06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facf9605640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facf9605640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56774/0 (socket says 172.21.15.1:56774) 2024-09-19T05:33:49.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facf9605640 1 -- 172.21.15.1:0/2747142160 learned_addr learned my addr 172.21.15.1:0/2747142160 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facf9e06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38298/0 (socket says 172.21.15.1:38298) 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.376+0000 7facfa607640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 0x7facf4111e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 -- 172.21.15.1:0/2747142160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 msgr2=0x7facf4111e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 0x7facf4111e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 -- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 msgr2=0x7facf4113340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4113340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 -- 172.21.15.1:0/2747142160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf41a6aa0 con 0x7facf4102570 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf9605640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7face800ebc0 tx=0x7face800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf2ffd640 1 -- 172.21.15.1:0/2747142160 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8010630 con 0x7facf4102570 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf2ffd640 1 -- 172.21.15.1:0/2747142160 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face8010cb0 con 0x7facf4102570 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf41a6c70 con 0x7facf4102570 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facf2ffd640 1 -- 172.21.15.1:0/2747142160 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8018bd0 con 0x7facf4102570 2024-09-19T05:33:49.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.377+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf41a7180 con 0x7facf4102570 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.379+0000 7facf2ffd640 1 -- 172.21.15.1:0/2747142160 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7face80107d0 con 0x7facf4102570 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 Processor -- start 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 -- start start 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4070400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d4072d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c1d3fcb2a0 con 0x55c1d4065760 2024-09-19T05:33:49.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1d3f72b10 con 0x55c1d4066080 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfe443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d3fc7260 con 0x55c1d4070940 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfa607640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facf9e06640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.380+0000 7facfa607640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38302/0 (socket says 172.21.15.1:38302) 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 -- 172.21.15.1:0/3135693502 learned_addr learned my addr 172.21.15.1:0/3135693502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facf2ffd640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facf9605640 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d4072d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facf2ffd640 1 -- 172.21.15.1:0/2747142160 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7face80d0340 con 0x7facf4102570 2024-09-19T05:33:49.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 -- 172.21.15.1:0/3135693502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 msgr2=0x55c1d4072d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d4072d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 -- 172.21.15.1:0/3135693502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 msgr2=0x55c1d4070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 -- 172.21.15.1:0/3135693502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d3d3cb90 con 0x55c1d4065760 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facfa607640 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7face4009e20 tx=0x7face4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2c5f19977fe846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.381+0000 7facdbfff640 1 -- 172.21.15.1:0/3135693502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4017050 con 0x55c1d4065760 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facdbfff640 1 -- 172.21.15.1:0/3135693502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face4009e50 con 0x55c1d4065760 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facdbfff640 1 -- 172.21.15.1:0/3135693502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face400f3c0 con 0x55c1d4065760 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfa607640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 0x7facdc0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7face4023000 tx=0x7face4024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 -- 172.21.15.1:0/3135693502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 msgr2=0x55c1d4065b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7face4009e20 tx=0x7face4011810 comp rx=0 tx=0).stop 2024-09-19T05:33:49.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 -- 172.21.15.1:0/3135693502 shutdown_connections 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d4072d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 --2- 172.21.15.1:0/3135693502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d4065b40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.382+0000 7facfe443740 1 -- 172.21.15.1:0/3135693502 >> 172.21.15.1:0/3135693502 conn(0x55c1d4061cf0 msgr2=0x55c1d40620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- 172.21.15.1:0/3135693502 shutdown_connections 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- 172.21.15.1:0/3135693502 wait complete. 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- start start 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 Processor -- start 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 0x55c1d406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d406e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c1d4073510 con 0x55c1d4066080 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1d3f536e0 con 0x55c1d4070940 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.383+0000 7facfe443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d4073690 con 0x55c1d4065760 2024-09-19T05:33:49.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facfe443740 10 client.0 _ll_register_callbacks cb 0x55c1d3f77a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9e06640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 0x55c1d406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38306/0 (socket says 172.21.15.1:38306) 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 -- 172.21.15.1:0/1180047064 learned_addr learned my addr 172.21.15.1:0/1180047064 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facfa607640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 -- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 msgr2=0x55c1d406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 0x55c1d406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 -- 172.21.15.1:0/1180047064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 msgr2=0x55c1d406e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d406e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 -- 172.21.15.1:0/1180047064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d407ca00 con 0x55c1d4066080 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9e06640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 0x55c1d406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facf9605640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7face800eb90 tx=0x7face8018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239c32fb393fe2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:33:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8010e60 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7face809c860 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.384+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face4009e50 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7face809c600 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 10 client.15696 fetch_fsmap learned FSMap version 21 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c1d407f370 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face4009e50 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7face809ba50 con 0x55c1d4066080 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 10 client.15696 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 10 client.15696 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 20 client.15696 populate_metadata read hostname 'smithi001' 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d4080780 0x55c1d4082b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 4 client.15696 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1d3fd89d0 con 0x55c1d4080780 2024-09-19T05:33:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.385+0000 7facf9e06640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d4080780 0x55c1d4082b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.386+0000 7facf9e06640 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d4080780 0x55c1d4082b90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c50301e57cf3baa server_cookie=97ca885884531a53 in_seq=0 out_seq=0 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.386+0000 7facd97fa640 10 client.15696 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.386+0000 7facd97fa640 1 -- 172.21.15.1:0/1180047064 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1d3fd89d0 con 0x55c1d4080780 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.386+0000 7facd97fa640 10 client.15696 handle_command_reply: tid=0 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.386+0000 7facfe443740 1 client.15696 shutdown 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 msgr2=0x55c1d406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7face800eb90 tx=0x7face8018670 comp rx=0 tx=0).stop 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 shutdown_connections 2024-09-19T05:33:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d406e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4066080 0x55c1d406dd50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d4080780 0x55c1d4082b90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 --2- 172.21.15.1:0/1180047064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4065760 0x55c1d406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facd97fa640 0 client.15696 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 >> 172.21.15.1:0/1180047064 conn(0x55c1d4061cf0 msgr2=0x55c1d4060e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 shutdown_connections 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 1 -- 172.21.15.1:0/1180047064 wait complete. 2024-09-19T05:33:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.387+0000 7facfe443740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T05:33:49.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 Processor -- start 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 -- start start 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4088460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d40889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7facf41aeef0 con 0x55c1d4065760 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7facf41b1770 con 0x55c1d4066080 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.405+0000 7facfe443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facf41af560 con 0x55c1d4070940 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9e06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4088460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9e06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38322/0 (socket says 172.21.15.1:38322) 2024-09-19T05:33:49.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9e06640 1 -- 172.21.15.1:0/1047569051 learned_addr learned my addr 172.21.15.1:0/1047569051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facfa607640 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d40889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 -- 172.21.15.1:0/1047569051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 msgr2=0x55c1d40889a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d40889a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 -- 172.21.15.1:0/1047569051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 msgr2=0x55c1d406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 -- 172.21.15.1:0/1047569051 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d4065590 con 0x55c1d4066080 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9e06640 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:49.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facf9605640 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4088460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7face8098fd0 tx=0x7face80a0a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f41eb53247c1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facdb7fe640 1 -- 172.21.15.1:0/1047569051 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8010e60 con 0x55c1d4066080 2024-09-19T05:33:49.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facdb7fe640 1 -- 172.21.15.1:0/1047569051 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face80a51c0 con 0x55c1d4066080 2024-09-19T05:33:49.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.406+0000 7facdb7fe640 1 -- 172.21.15.1:0/1047569051 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8098040 con 0x55c1d4066080 2024-09-19T05:33:49.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- 172.21.15.1:0/1047569051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 msgr2=0x55c1d4088460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4088460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7face8098fd0 tx=0x7face80a0a80 comp rx=0 tx=0).stop 2024-09-19T05:33:49.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- 172.21.15.1:0/1047569051 shutdown_connections 2024-09-19T05:33:49.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4070940 0x55c1d40889a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4066080 0x55c1d4088460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 --2- 172.21.15.1:0/1047569051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- 172.21.15.1:0/1047569051 >> 172.21.15.1:0/1047569051 conn(0x55c1d4061cf0 msgr2=0x55c1d406f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- 172.21.15.1:0/1047569051 shutdown_connections 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- 172.21.15.1:0/1047569051 wait complete. 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.407+0000 7facfe443740 1 -- start start 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 Processor -- start 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d40788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d40758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7facf41afc30 con 0x55c1d4065760 2024-09-19T05:33:49.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7facf41b10a0 con 0x55c1d4070940 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7facf41b0300 con 0x55c1d4066080 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfe443740 10 client.0 _ll_register_callbacks cb 0x7face809c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facf9605640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facf9605640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:58680/0 (socket says 172.21.15.1:58680) 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facf9605640 1 -- 172.21.15.1:0/1365631292 learned_addr learned my addr 172.21.15.1:0/1365631292 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facfa607640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d40758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.408+0000 7facf9e06640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d40788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 -- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 msgr2=0x55c1d4078e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 -- 172.21.15.1:0/1365631292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 msgr2=0x55c1d40788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d40788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 -- 172.21.15.1:0/1365631292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d405d260 con 0x55c1d4070940 2024-09-19T05:33:49.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facf9605640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfa607640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d40758b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7face401cbb0 tx=0x7face401cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cacd60b337dced41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4038060 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7face401c850 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face80a51c0 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7face4017020 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfe443740 10 client.25304 fetch_fsmap learned FSMap version 21 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c1d40eb880 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.409+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face80a51c0 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7face400f620 con 0x55c1d4070940 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 10 client.25304 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 10 client.25304 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 20 client.25304 populate_metadata read hostname 'smithi001' 2024-09-19T05:33:49.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d40ebf00 0x55c1d40ee320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:33:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 4 client.25304 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T05:33:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55c1d3fd2d20 con 0x55c1d40ebf00 2024-09-19T05:33:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facf9e06640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d40ebf00 0x55c1d40ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:33:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facf9e06640 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d40ebf00 0x55c1d40ee320 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1856d8c97a459fd server_cookie=6ac11cc72d8ddc45 in_seq=0 out_seq=0 2024-09-19T05:33:49.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.410+0000 7facd97fa640 10 client.25304 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:33:49.419 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403858 11.30 MB/sec execute 544 sec latency 18.400 ms 2024-09-19T05:33:49.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.556+0000 7facd97fa640 1 -- 172.21.15.1:0/1365631292 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c1d3fd2d20 con 0x55c1d40ebf00 2024-09-19T05:33:49.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.556+0000 7facd97fa640 10 client.25304 handle_command_reply: tid=0 2024-09-19T05:33:49.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.556+0000 7facfe443740 1 client.25304 shutdown 2024-09-19T05:33:49.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.556+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 msgr2=0x55c1d40758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.556+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d40758b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7face401cbb0 tx=0x7face401cb40 comp rx=0 tx=0).stop 2024-09-19T05:33:49.559 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:49 smithi001 ceph-mon[30968]: pgmap v730: 129 pgs: 129 active+clean; 269 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 291 op/s 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 shutdown_connections 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1d4070940 0x55c1d40758b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c1d40ebf00 0x55c1d40ee320 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d4066080 0x55c1d4078e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 --2- 172.21.15.1:0/1365631292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c1d4065760 0x55c1d40788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 >> 172.21.15.1:0/1365631292 conn(0x55c1d4061cf0 msgr2=0x55c1d4060650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facd97fa640 0 client.25304 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 shutdown_connections 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 1 -- 172.21.15.1:0/1365631292 wait complete. 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfe443740 20 client.25304 trim_cache size 0 max 16384 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 42, 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "8ae466c": { 2024-09-19T05:33:49.561 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 42, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 142.2, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:33:49.562 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:33:49.563 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 msgr2=0x7facdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 0x7facdc0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7face4023000 tx=0x7face4024000 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 msgr2=0x7facf4111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.557+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7face800ebc0 tx=0x7face800c6a0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 shutdown_connections 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4102ef0 0x7facf4111e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facf4102570 0x7facf4111700 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 --2- 172.21.15.1:0/2747142160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7facf4100e20 0x7facf4113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 >> 172.21.15.1:0/2747142160 conn(0x7facf40fc7d0 msgr2=0x7facf4103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 shutdown_connections 2024-09-19T05:33:49.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:33:49.558+0000 7facfc06a640 1 -- 172.21.15.1:0/2747142160 wait complete. 2024-09-19T05:33:49.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:49 smithi060 ceph-mon[35058]: pgmap v730: 129 pgs: 129 active+clean; 269 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 291 op/s 2024-09-19T05:33:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:49 smithi082 ceph-mon[35195]: pgmap v730: 129 pgs: 129 active+clean; 269 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.1 MiB/s wr, 291 op/s 2024-09-19T05:33:50.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.28 MB/sec execute 545 sec latency 864.525 ms 2024-09-19T05:33:50.794 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8ae466c', quiesce took 4.3 seconds. Will release after: 17.9 2024-09-19T05:33:51.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.26 MB/sec execute 546 sec latency 1864.956 ms 2024-09-19T05:33:51.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:51 smithi060 ceph-mon[35058]: pgmap v731: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 282 op/s 2024-09-19T05:33:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:51 smithi082 ceph-mon[35195]: pgmap v731: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 282 op/s 2024-09-19T05:33:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:51 smithi001 ceph-mon[30968]: pgmap v731: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.0 MiB/s wr, 282 op/s 2024-09-19T05:33:52.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.24 MB/sec execute 547 sec latency 2865.079 ms 2024-09-19T05:33:53.420 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.21 MB/sec execute 548 sec latency 3865.200 ms 2024-09-19T05:33:53.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:53 smithi060 ceph-mon[35058]: pgmap v732: 129 pgs: 129 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 293 op/s 2024-09-19T05:33:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:53 smithi082 ceph-mon[35195]: pgmap v732: 129 pgs: 129 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 293 op/s 2024-09-19T05:33:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:53 smithi001 ceph-mon[30968]: pgmap v732: 129 pgs: 129 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.4 MiB/s wr, 293 op/s 2024-09-19T05:33:54.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.19 MB/sec execute 549 sec latency 4865.313 ms 2024-09-19T05:33:55.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.17 MB/sec execute 550 sec latency 5865.392 ms 2024-09-19T05:33:55.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:55 smithi060 ceph-mon[35058]: pgmap v733: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-09-19T05:33:55.769 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:55 smithi082 ceph-mon[35195]: pgmap v733: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-09-19T05:33:55.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:55 smithi001 ceph-mon[30968]: pgmap v733: 129 pgs: 129 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-09-19T05:33:56.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.15 MB/sec execute 551 sec latency 6865.517 ms 2024-09-19T05:33:57.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.13 MB/sec execute 552 sec latency 7865.562 ms 2024-09-19T05:33:57.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:57 smithi060 ceph-mon[35058]: pgmap v734: 129 pgs: 129 active+clean; 274 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 4.3 MiB/s wr, 248 op/s 2024-09-19T05:33:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:57 smithi082 ceph-mon[35195]: pgmap v734: 129 pgs: 129 active+clean; 274 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 4.3 MiB/s wr, 248 op/s 2024-09-19T05:33:57.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:57 smithi001 ceph-mon[30968]: pgmap v734: 129 pgs: 129 active+clean; 274 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 4.3 MiB/s wr, 248 op/s 2024-09-19T05:33:58.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.11 MB/sec execute 553 sec latency 8865.656 ms 2024-09-19T05:33:59.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.09 MB/sec execute 554 sec latency 9865.780 ms 2024-09-19T05:33:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:33:59 smithi060 ceph-mon[35058]: pgmap v735: 129 pgs: 129 active+clean; 273 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-19T05:33:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:33:59 smithi082 ceph-mon[35195]: pgmap v735: 129 pgs: 129 active+clean; 273 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-19T05:33:59.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:33:59 smithi001 ceph-mon[30968]: pgmap v735: 129 pgs: 129 active+clean; 273 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.5 MiB/s wr, 174 op/s 2024-09-19T05:34:00.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.07 MB/sec execute 555 sec latency 10865.888 ms 2024-09-19T05:34:01.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.05 MB/sec execute 556 sec latency 11866.020 ms 2024-09-19T05:34:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:01 smithi060 ceph-mon[35058]: pgmap v736: 129 pgs: 129 active+clean; 258 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2024-09-19T05:34:01.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:01 smithi082 ceph-mon[35195]: pgmap v736: 129 pgs: 129 active+clean; 258 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2024-09-19T05:34:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:01 smithi001 ceph-mon[30968]: pgmap v736: 129 pgs: 129 active+clean; 258 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2024-09-19T05:34:02.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.03 MB/sec execute 557 sec latency 12866.105 ms 2024-09-19T05:34:03.421 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 11.01 MB/sec execute 558 sec latency 13866.195 ms 2024-09-19T05:34:03.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:03 smithi060 ceph-mon[35058]: pgmap v737: 129 pgs: 129 active+clean; 249 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 2.9 MiB/s wr, 104 op/s 2024-09-19T05:34:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:03 smithi082 ceph-mon[35195]: pgmap v737: 129 pgs: 129 active+clean; 249 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 2.9 MiB/s wr, 104 op/s 2024-09-19T05:34:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:03 smithi001 ceph-mon[30968]: pgmap v737: 129 pgs: 129 active+clean; 249 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 2.9 MiB/s wr, 104 op/s 2024-09-19T05:34:04.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.99 MB/sec execute 559 sec latency 14866.228 ms 2024-09-19T05:34:05.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.97 MB/sec execute 560 sec latency 15866.338 ms 2024-09-19T05:34:05.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:05 smithi060 ceph-mon[35058]: pgmap v738: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:34:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:05 smithi082 ceph-mon[35195]: pgmap v738: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:34:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:05 smithi001 ceph-mon[30968]: pgmap v738: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 2.3 MiB/s wr, 83 op/s 2024-09-19T05:34:06.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.95 MB/sec execute 561 sec latency 16866.452 ms 2024-09-19T05:34:07.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.94 MB/sec execute 562 sec latency 17866.580 ms 2024-09-19T05:34:07.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:07 smithi060 ceph-mon[35058]: pgmap v739: 129 pgs: 129 active+clean; 244 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-09-19T05:34:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:07 smithi082 ceph-mon[35195]: pgmap v739: 129 pgs: 129 active+clean; 244 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-09-19T05:34:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:07 smithi001 ceph-mon[30968]: pgmap v739: 129 pgs: 129 active+clean; 244 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 2.6 MiB/s wr, 96 op/s 2024-09-19T05:34:08.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.92 MB/sec execute 563 sec latency 18866.711 ms 2024-09-19T05:34:08.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:34:09.064 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:09.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.90 MB/sec execute 564 sec latency 19866.771 ms 2024-09-19T05:34:09.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 -- 172.21.15.1:0/1339756112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0106a80 msgr2=0x7f00a0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 --2- 172.21.15.1:0/1339756112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0106a80 0x7f00a0106e60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0090009930 tx=0x7f009002a420 comp rx=0 tx=0).stop 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 -- 172.21.15.1:0/1339756112 shutdown_connections 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 --2- 172.21.15.1:0/1339756112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 0x7f00a010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 --2- 172.21.15.1:0/1339756112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0100a80 0x7f00a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 --2- 172.21.15.1:0/1339756112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0106a80 0x7f00a0106e60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 -- 172.21.15.1:0/1339756112 >> 172.21.15.1:0/1339756112 conn(0x7f00a00fc7a0 msgr2=0x7f00a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 -- 172.21.15.1:0/1339756112 shutdown_connections 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.569+0000 7f00a5624640 1 -- 172.21.15.1:0/1339756112 wait complete. 2024-09-19T05:34:09.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 Processor -- start 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 -- start start 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 0x7f00a01978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0106a80 0x7f00a019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0110e80 con 0x7f00a0100a80 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0110d00 con 0x7f00a0101420 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.570+0000 7f00a5624640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0111000 con 0x7f00a0106a80 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57036/0 (socket says 172.21.15.1:57036) 2024-09-19T05:34:09.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 -- 172.21.15.1:0/293975675 learned_addr learned my addr 172.21.15.1:0/293975675 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009f7fe640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0106a80 0x7f00a019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f00967fc640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 0x7f00a01978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 -- 172.21.15.1:0/293975675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0106a80 msgr2=0x7f00a019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0106a80 0x7f00a019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 -- 172.21.15.1:0/293975675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 msgr2=0x7f00a01978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 0x7f00a01978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 -- 172.21.15.1:0/293975675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a019c350 con 0x7f00a0100a80 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009effd640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0090009230 tx=0x7f0090004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009003f030 con 0x7f00a0100a80 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0090003ad0 con 0x7f00a0100a80 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a019c5e0 con 0x7f00a0100a80 2024-09-19T05:34:09.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090035070 con 0x7f00a0100a80 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.571+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a006a790 con 0x7f00a0100a80 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.572+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a01021c0 con 0x7f00a0100a80 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.574+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0090042030 con 0x7f00a0100a80 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.574+0000 7f009cff9640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 0x7f008c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.575+0000 7f00967fc640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 0x7f008c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.575+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f00900f0480 con 0x7f00a0100a80 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.575+0000 7f00967fc640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 0x7f008c0a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f00a00fee50 tx=0x7f008800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:09.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.578+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00900bc7a0 con 0x7f00a0100a80 2024-09-19T05:34:09.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:09 smithi060 ceph-mon[35058]: pgmap v740: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.4 MiB/s wr, 92 op/s 2024-09-19T05:34:09.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:09 smithi082 ceph-mon[35195]: pgmap v740: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.4 MiB/s wr, 92 op/s 2024-09-19T05:34:09.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.791+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00a0100ee0 con 0x7f00a0100a80 2024-09-19T05:34:09.794 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:09 smithi001 ceph-mon[30968]: pgmap v740: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 2.4 MiB/s wr, 92 op/s 2024-09-19T05:34:09.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.792+0000 7f009cff9640 1 -- 172.21.15.1:0/293975675 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f00a0100ee0 con 0x7f00a0100a80 2024-09-19T05:34:09.795 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:34:09.795 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:34:09.795 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 msgr2=0x7f008c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 0x7f008c0a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f00a00fee50 tx=0x7f008800b390 comp rx=0 tx=0).stop 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 msgr2=0x7f00a01973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0090009230 tx=0x7f0090004270 comp rx=0 tx=0).stop 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 shutdown_connections 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f008c0a32c0 0x7f008c0a5780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00a0106a80 0x7f00a019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00a0101420 0x7f00a01978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 --2- 172.21.15.1:0/293975675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00a0100a80 0x7f00a01973a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:09.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 >> 172.21.15.1:0/293975675 conn(0x7f00a00fc7a0 msgr2=0x7f00a00fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:09.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 shutdown_connections 2024-09-19T05:34:09.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:09.794+0000 7f00a5624640 1 -- 172.21.15.1:0/293975675 wait complete. 2024-09-19T05:34:10.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403862 10.88 MB/sec execute 565 sec latency 20866.855 ms 2024-09-19T05:34:10.577 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 8ae466c --release --await' 2024-09-19T05:34:10.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 8ae466c --release --await 2024-09-19T05:34:10.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:10 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/293975675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:10.837 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:10.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:10 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/293975675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:11.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:10 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/293975675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 -- 172.21.15.1:0/3723935892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 msgr2=0x7f928410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 --2- 172.21.15.1:0/3723935892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928410df20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9278009900 tx=0x7f927802a410 comp rx=0 tx=0).stop 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 -- 172.21.15.1:0/3723935892 shutdown_connections 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 --2- 172.21.15.1:0/3723935892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f928410e460 0x7f9284110850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 --2- 172.21.15.1:0/3723935892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928410df20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 --2- 172.21.15.1:0/3723935892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92841008b0 0x7f9284100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 -- 172.21.15.1:0/3723935892 >> 172.21.15.1:0/3723935892 conn(0x7f92840fc780 msgr2=0x7f92840feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 -- 172.21.15.1:0/3723935892 shutdown_connections 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.337+0000 7f928897c640 1 -- 172.21.15.1:0/3723935892 wait complete. 2024-09-19T05:34:11.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 Processor -- start 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 -- start start 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92841008b0 0x7f928419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410e460 0x7f928419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9284114170 con 0x7f9284101260 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9284113ff0 con 0x7f92841008b0 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928897c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92841142f0 con 0x7f928410e460 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57056/0 (socket says 172.21.15.1:57056) 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f9281d9b640 1 -- 172.21.15.1:0/518601192 learned_addr learned my addr 172.21.15.1:0/518601192 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:11.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f928259c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92841008b0 0x7f928419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.338+0000 7f9282d9d640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410e460 0x7f928419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 -- 172.21.15.1:0/518601192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410e460 msgr2=0x7f928419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410e460 0x7f928419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 -- 172.21.15.1:0/518601192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92841008b0 msgr2=0x7f928419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92841008b0 0x7f928419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 -- 172.21.15.1:0/518601192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928419f640 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f9281d9b640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9278006010 tx=0x7f92780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f92737fe640 1 -- 172.21.15.1:0/518601192 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927803f030 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f92737fe640 1 -- 172.21.15.1:0/518601192 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9278003ce0 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928419f8d0 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f92737fe640 1 -- 172.21.15.1:0/518601192 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278035070 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.339+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92841a7210 con 0x7f9284101260 2024-09-19T05:34:11.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.341+0000 7f92737fe640 1 -- 172.21.15.1:0/518601192 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9278042030 con 0x7f9284101260 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 Processor -- start 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 -- start start 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35060 0x5595e5e35440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5595e5d9a620 con 0x5595e5e40240 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5595e5d41e50 con 0x5595e5e35060 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928ad55740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595e5d965e0 con 0x5595e5e35980 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57060/0 (socket says 172.21.15.1:57060) 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f9281d9b640 1 -- 172.21.15.1:0/806565043 learned_addr learned my addr 172.21.15.1:0/806565043 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f92737fe640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 0x7f926c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f9282d9d640 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35060 0x5595e5e35440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.342+0000 7f928259c640 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9282d9d640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 0x7f926c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f92737fe640 1 -- 172.21.15.1:0/518601192 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f92780f0220 con 0x7f9284101260 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 -- 172.21.15.1:0/806565043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 msgr2=0x5595e5e3fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 -- 172.21.15.1:0/806565043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35060 msgr2=0x5595e5e35440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35060 0x5595e5e35440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 -- 172.21.15.1:0/806565043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e5d32d40 con 0x5595e5e40240 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9281d9b640 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f92780c4c30 tx=0x7f927802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef570b98ba2252d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9282d9d640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 0x7f926c0a5780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f927c009fd0 tx=0x7f927c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9270ff9640 1 -- 172.21.15.1:0/806565043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278049070 con 0x5595e5e40240 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9270ff9640 1 -- 172.21.15.1:0/806565043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927803b580 con 0x5595e5e40240 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.343+0000 7f9270ff9640 1 -- 172.21.15.1:0/806565043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92780c5160 con 0x5595e5e40240 2024-09-19T05:34:11.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- 172.21.15.1:0/806565043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 msgr2=0x5595e5e42630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f92780c4c30 tx=0x7f927802a410 comp rx=0 tx=0).stop 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- 172.21.15.1:0/806565043 shutdown_connections 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e42630 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 --2- 172.21.15.1:0/806565043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35060 0x5595e5e35440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- 172.21.15.1:0/806565043 >> 172.21.15.1:0/806565043 conn(0x5595e5e315f0 msgr2=0x5595e5e319d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- 172.21.15.1:0/806565043 shutdown_connections 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- 172.21.15.1:0/806565043 wait complete. 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 -- start start 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.344+0000 7f928ad55740 1 Processor -- start 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e3dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5595e5e42bd0 con 0x5595e5e35060 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5595e5d22f10 con 0x5595e5e40240 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595e5e42d50 con 0x5595e5e35980 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928ad55740 10 client.0 _ll_register_callbacks cb 0x5595e5d46db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57076/0 (socket says 172.21.15.1:57076) 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 -- 172.21.15.1:0/3026318183 learned_addr learned my addr 172.21.15.1:0/3026318183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f9281d9b640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f9282d9d640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e3dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 -- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 msgr2=0x5595e5e3d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 -- 172.21.15.1:0/3026318183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 msgr2=0x5595e5e3dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e3dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 -- 172.21.15.1:0/3026318183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e5aa9580 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f9282d9d640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f928259c640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9274010820 tx=0x7f9274010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6448913d9f4e2363 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f9269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.345+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927400fb10 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f927400fcb0 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595e5da7b90 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9274024050 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 10 client.15720 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5595e5b73960 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5595e5da7b90 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f927400e550 con 0x5595e5e35060 2024-09-19T05:34:11.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 10 client.15720 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 10 client.15720 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 20 client.15720 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5e4fcd0 0x5595e5e520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 4 client.15720 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595e5da20a0 con 0x5595e5e4fcd0 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.346+0000 7f9281d9b640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5e4fcd0 0x5595e5e520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.347+0000 7f9281d9b640 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5e4fcd0 0x5595e5e520c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e53bc423dae477 server_cookie=3163717c29d381c in_seq=0 out_seq=0 2024-09-19T05:34:11.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.347+0000 7f9269ffb640 10 client.15720 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.347+0000 7f9269ffb640 1 -- 172.21.15.1:0/3026318183 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595e5da20a0 con 0x5595e5e4fcd0 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.347+0000 7f9269ffb640 10 client.15720 handle_command_reply: tid=0 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.347+0000 7f928ad55740 1 client.15720 shutdown 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 msgr2=0x5595e5e3d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9274010820 tx=0x7f9274010ce0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 shutdown_connections 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e3dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5e4fcd0 0x5595e5e520c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35980 0x5595e5e3d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 --2- 172.21.15.1:0/3026318183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35060 0x5595e5e3d160 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f9269ffb640 0 client.15720 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:11.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 >> 172.21.15.1:0/3026318183 conn(0x5595e5e315f0 msgr2=0x5595e5e372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 shutdown_connections 2024-09-19T05:34:11.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 1 -- 172.21.15.1:0/3026318183 wait complete. 2024-09-19T05:34:11.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.348+0000 7f928ad55740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T05:34:11.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 Processor -- start 2024-09-19T05:34:11.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 -- start start 2024-09-19T05:34:11.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e30640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e57d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92841af010 con 0x5595e5e35980 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92841b1890 con 0x5595e5e40240 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928ad55740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92841af680 con 0x5595e5e35060 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57078/0 (socket says 172.21.15.1:57078) 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 -- 172.21.15.1:0/947395222 learned_addr learned my addr 172.21.15.1:0/947395222 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9282d9d640 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e57d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f928259c640 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e30640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 -- 172.21.15.1:0/947395222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 msgr2=0x5595e5e30640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e30640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 -- 172.21.15.1:0/947395222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 msgr2=0x5595e5e57d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e57d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.365+0000 7f9281d9b640 1 -- 172.21.15.1:0/947395222 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e5e2fbb0 con 0x5595e5e35980 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f9281d9b640 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f92780bc530 tx=0x7f9278046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54be6937ef14ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f926bfff640 1 -- 172.21.15.1:0/947395222 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278049040 con 0x5595e5e35980 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f926bfff640 1 -- 172.21.15.1:0/947395222 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92780c5160 con 0x5595e5e35980 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f926bfff640 1 -- 172.21.15.1:0/947395222 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92780bc800 con 0x5595e5e35980 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 -- 172.21.15.1:0/947395222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 msgr2=0x5595e5e57830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f92780bc530 tx=0x7f9278046040 comp rx=0 tx=0).stop 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 -- 172.21.15.1:0/947395222 shutdown_connections 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e40240 0x5595e5e57d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e35980 0x5595e5e57830 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 --2- 172.21.15.1:0/947395222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e30640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 -- 172.21.15.1:0/947395222 >> 172.21.15.1:0/947395222 conn(0x5595e5e315f0 msgr2=0x5595e5e2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 -- 172.21.15.1:0/947395222 shutdown_connections 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.366+0000 7f928ad55740 1 -- 172.21.15.1:0/947395222 wait complete. 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 -- start start 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 Processor -- start 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e48340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35980 0x5595e5e44ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92841afd50 con 0x5595e5e40240 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92841b11c0 con 0x5595e5e35980 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92841b0420 con 0x5595e5e35060 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928ad55740 10 client.0 _ll_register_callbacks cb 0x7f9274010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f9282d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f9282d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57092/0 (socket says 172.21.15.1:57092) 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f9282d9d640 1 -- 172.21.15.1:0/3658640925 learned_addr learned my addr 172.21.15.1:0/3658640925 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f928259c640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e48340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.367+0000 7f9281d9b640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35980 0x5595e5e44ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 -- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 msgr2=0x5595e5e48340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e48340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 -- 172.21.15.1:0/3658640925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35980 msgr2=0x5595e5e44ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35980 0x5595e5e44ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 -- 172.21.15.1:0/3658640925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e5e45920 con 0x5595e5e40240 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9282d9d640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f927c00ab40 tx=0x7f927c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1216ee0e76728fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c004b20 con 0x5595e5e40240 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f927c004cc0 con 0x5595e5e40240 2024-09-19T05:34:11.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92780c5160 con 0x5595e5e40240 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f927c037050 con 0x5595e5e40240 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f928ad55740 10 client.15726 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5595e5ebb600 con 0x5595e5e40240 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92780c5160 con 0x5595e5e40240 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.368+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f927c00f040 con 0x5595e5e40240 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 10 client.15726 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 10 client.15726 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 20 client.15726 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5ebbd70 0x5595e5ebe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 4 client.15726 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8ae466c", "release": true, "await": true}] 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8ae466c", "release": true, "await": true}) -- 0x5595e5d1e5a0 con 0x5595e5ebbd70 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928259c640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5ebbd70 0x5595e5ebe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f928259c640 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5ebbd70 0x5595e5ebe190 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=897af286a7a746f1 server_cookie=dfe7225bff6878c0 in_seq=0 out_seq=0 2024-09-19T05:34:11.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.369+0000 7f9269ffb640 10 client.15726 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.384+0000 7f9269ffb640 1 -- 172.21.15.1:0/3658640925 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5595e5d1e5a0 con 0x5595e5ebbd70 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.384+0000 7f9269ffb640 10 client.15726 handle_command_reply: tid=0 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.384+0000 7f928ad55740 1 client.15726 shutdown 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 msgr2=0x5595e5e453e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f927c00ab40 tx=0x7f927c004a40 comp rx=0 tx=0).stop 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 shutdown_connections 2024-09-19T05:34:11.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5595e5e40240 0x5595e5e453e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5595e5e35980 0x5595e5e44ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5595e5ebbd70 0x5595e5ebe190 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 --2- 172.21.15.1:0/3658640925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595e5e35060 0x5595e5e48340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f9269ffb640 0 client.15726 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 >> 172.21.15.1:0/3658640925 conn(0x5595e5e315f0 msgr2=0x5595e5e372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 shutdown_connections 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 1 -- 172.21.15.1:0/3658640925 wait complete. 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928ad55740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:34:11.389 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 44, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "8ae466c": { 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 44, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 142.2, 2024-09-19T05:34:11.390 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:11.391 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 msgr2=0x7f926c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 0x7f926c0a5780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f927c009fd0 tx=0x7f927c009600 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 msgr2=0x7f928419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9278006010 tx=0x7f92780042f0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 shutdown_connections 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f926c0a32c0 0x7f926c0a5780 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410e460 0x7f928419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.385+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9284101260 0x7f928419abd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.386+0000 7f928897c640 1 --2- 172.21.15.1:0/518601192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92841008b0 0x7f928419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:11.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.386+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 >> 172.21.15.1:0/518601192 conn(0x7f92840fc780 msgr2=0x7f92840feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:11.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.386+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 shutdown_connections 2024-09-19T05:34:11.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:11.386+0000 7f928897c640 1 -- 172.21.15.1:0/518601192 wait complete. 2024-09-19T05:34:11.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1403882 10.86 MB/sec execute 566 sec latency 21823.188 ms 2024-09-19T05:34:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:11 smithi082 ceph-mon[35195]: pgmap v741: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:34:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:11 smithi001 ceph-mon[30968]: pgmap v741: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:34:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:11 smithi060 ceph-mon[35058]: pgmap v741: 129 pgs: 129 active+clean; 240 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.4 MiB/s wr, 85 op/s 2024-09-19T05:34:12.209 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8ae466c', total seconds elapsed: 25.7 2024-09-19T05:34:12.209 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T05:34:12.209 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:34:12.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1407265 10.87 MB/sec execute 567 sec latency 9.231 ms 2024-09-19T05:34:12.470 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 -- 172.21.15.1:0/3307867338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 msgr2=0x7f5f901158d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/3307867338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f901158d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009ca0 tx=0x7f5f8802a8b0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 -- 172.21.15.1:0/3307867338 shutdown_connections 2024-09-19T05:34:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/3307867338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f901158d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/3307867338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 0x7f5f9010ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/3307867338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 0x7f5f9010e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.052+0000 7f5f94cf3640 1 -- 172.21.15.1:0/3307867338 >> 172.21.15.1:0/3307867338 conn(0x7f5f9006e2d0 msgr2=0x7f5f9006e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.054+0000 7f5f94cf3640 1 -- 172.21.15.1:0/3307867338 shutdown_connections 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.056+0000 7f5f94cf3640 1 -- 172.21.15.1:0/3307867338 wait complete. 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 Processor -- start 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 -- start start 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 0x7f5f9011e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 0x7f5f9011eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90118520 con 0x7f5f9010e890 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901183a0 con 0x7f5f90109a80 2024-09-19T05:34:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f94cf3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901186a0 con 0x7f5f901134e0 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.057+0000 7f5f8ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:51690/0 (socket says 172.21.15.1:51690) 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 -- 172.21.15.1:0/4052630386 learned_addr learned my addr 172.21.15.1:0/4052630386 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8e59c640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 0x7f5f9011e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8dd9b640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 0x7f5f9011eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 -- 172.21.15.1:0/4052630386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 msgr2=0x7f5f9011e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 0x7f5f9011e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 -- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 msgr2=0x7f5f9011eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 0x7f5f9011eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.058+0000 7f5f8ed9d640 1 -- 172.21.15.1:0/4052630386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9011a390 con 0x7f5f901134e0 2024-09-19T05:34:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.059+0000 7f5f8ed9d640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f880098d0 tx=0x7f5f88003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.059+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88030df0 con 0x7f5f901134e0 2024-09-19T05:34:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.059+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9011a620 con 0x7f5f901134e0 2024-09-19T05:34:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.060+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f901248a0 con 0x7f5f901134e0 2024-09-19T05:34:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.060+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f88040070 con 0x7f5f901134e0 2024-09-19T05:34:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.060+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88045ad0 con 0x7f5f901134e0 2024-09-19T05:34:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.063+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70005290 con 0x7f5f901134e0 2024-09-19T05:34:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.065+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5f88004040 con 0x7f5f901134e0 2024-09-19T05:34:13.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.066+0000 7f5f7f7fe640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 0x7f5f780a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:13.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.066+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f5f880f12e0 con 0x7f5f901134e0 2024-09-19T05:34:13.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.068+0000 7f5f8e59c640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 0x7f5f780a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:13.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.069+0000 7f5f8e59c640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 0x7f5f780a5910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005e10 tx=0x7f5f84005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:13.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.074+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f8804a060 con 0x7f5f901134e0 2024-09-19T05:34:13.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.348+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f70005580 con 0x7f5f901134e0 2024-09-19T05:34:13.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.349+0000 7f5f7f7fe640 1 -- 172.21.15.1:0/4052630386 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f5f880bdbf0 con 0x7f5f901134e0 2024-09-19T05:34:13.352 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:34:13.352 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:34:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:34:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 msgr2=0x7f5f780a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 0x7f5f780a5910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005e10 tx=0x7f5f84005da0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 msgr2=0x7f5f90119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f880098d0 tx=0x7f5f88003f80 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 shutdown_connections 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f5f780a3450 0x7f5f780a5910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f901134e0 0x7f5f90119ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5f9010e890 0x7f5f9011eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 --2- 172.21.15.1:0/4052630386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f90109a80 0x7f5f9011e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 >> 172.21.15.1:0/4052630386 conn(0x7f5f9006e2d0 msgr2=0x7f5f9010a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 shutdown_connections 2024-09-19T05:34:13.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:13.351+0000 7f5f94cf3640 1 -- 172.21.15.1:0/4052630386 wait complete. 2024-09-19T05:34:13.422 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1408842 10.86 MB/sec execute 568 sec latency 142.820 ms 2024-09-19T05:34:13.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:13 smithi001 ceph-mon[30968]: pgmap v742: 129 pgs: 129 active+clean; 238 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.3 MiB/s wr, 91 op/s 2024-09-19T05:34:13.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:13 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4052630386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:13 smithi082 ceph-mon[35195]: pgmap v742: 129 pgs: 129 active+clean; 238 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.3 MiB/s wr, 91 op/s 2024-09-19T05:34:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:13 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4052630386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:13 smithi060 ceph-mon[35058]: pgmap v742: 129 pgs: 129 active+clean; 238 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.3 MiB/s wr, 91 op/s 2024-09-19T05:34:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:13 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4052630386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:14.020 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T05:34:14.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T05:34:14.289 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:14.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1411695 10.87 MB/sec execute 569 sec latency 10.508 ms 2024-09-19T05:34:14.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 -- 172.21.15.1:0/3205088549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 msgr2=0x7f16341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 --2- 172.21.15.1:0/3205088549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f16341029b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1620009900 tx=0x7f162002a480 comp rx=0 tx=0).stop 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 -- 172.21.15.1:0/3205088549 shutdown_connections 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 --2- 172.21.15.1:0/3205088549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 0x7f163410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 --2- 172.21.15.1:0/3205088549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f16341029b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 --2- 172.21.15.1:0/3205088549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f1634101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 -- 172.21.15.1:0/3205088549 >> 172.21.15.1:0/3205088549 conn(0x7f16340fc7d0 msgr2=0x7f16340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 -- 172.21.15.1:0/3205088549 shutdown_connections 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.830+0000 7f163ad76640 1 -- 172.21.15.1:0/3205088549 wait complete. 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 Processor -- start 2024-09-19T05:34:14.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 -- start start 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f16341984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 0x7f163419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1634110f80 con 0x7f1634102570 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1634110e00 con 0x7f1634100e20 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f163ad76640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1634111100 con 0x7f1634102ef0 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60978/0 (socket says 172.21.15.1:60978) 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f1633fff640 1 -- 172.21.15.1:0/3143788456 learned_addr learned my addr 172.21.15.1:0/3143788456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f1638b12640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f16341984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.831+0000 7f1639313640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 0x7f163419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 -- 172.21.15.1:0/3143788456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 msgr2=0x7f163419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 0x7f163419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 -- 172.21.15.1:0/3143788456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 msgr2=0x7f16341984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f16341984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 -- 172.21.15.1:0/3143788456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163419d480 con 0x7f1634102570 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1638b12640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f16341984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1633fff640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1620006010 tx=0x7f1620003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1631ffb640 1 -- 172.21.15.1:0/3143788456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162003f070 con 0x7f1634102570 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1631ffb640 1 -- 172.21.15.1:0/3143788456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1620031c30 con 0x7f1634102570 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163419d710 con 0x7f1634102570 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f1631ffb640 1 -- 172.21.15.1:0/3143788456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620035030 con 0x7f1634102570 2024-09-19T05:34:14.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.832+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16341a5050 con 0x7f1634102570 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1631ffb640 1 -- 172.21.15.1:0/3143788456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1620042070 con 0x7f1634102570 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 Processor -- start 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 -- start start 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 0x5584a1584400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1584940 0x5584a1586d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584a14df2a0 con 0x5584a1579760 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584a1486b10 con 0x5584a1584940 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f163d14f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584a14db260 con 0x5584a157a080 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1639313640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1639313640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60980/0 (socket says 172.21.15.1:60980) 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1639313640 1 -- 172.21.15.1:0/2439280551 learned_addr learned my addr 172.21.15.1:0/2439280551 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1638b12640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 0x5584a1584400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.836+0000 7f1633fff640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1584940 0x5584a1586d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1631ffb640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 0x7f16240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 -- 172.21.15.1:0/2439280551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1584940 msgr2=0x5584a1586d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1584940 0x5584a1586d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 -- 172.21.15.1:0/2439280551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 msgr2=0x5584a1579b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 -- 172.21.15.1:0/2439280551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a1250b90 con 0x5584a157a080 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1639313640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1631ffb640 1 -- 172.21.15.1:0/3143788456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f16200effb0 con 0x7f1634102570 2024-09-19T05:34:14.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1638b12640 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 0x5584a1584400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1628009fd0 tx=0x7f16280118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92ad28e781feab6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f1639313640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 0x7f16240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f161effd640 1 -- 172.21.15.1:0/2439280551 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628004030 con 0x5584a157a080 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f161effd640 1 -- 172.21.15.1:0/2439280551 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1628005500 con 0x5584a157a080 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.837+0000 7f161effd640 1 -- 172.21.15.1:0/2439280551 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628004db0 con 0x5584a157a080 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 -- 172.21.15.1:0/2439280551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 msgr2=0x5584a1584400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f1639313640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 0x7f16240a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f162c003e10 tx=0x7f162c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 0x5584a1584400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1628009fd0 tx=0x7f16280118d0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 -- 172.21.15.1:0/2439280551 shutdown_connections 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1584940 0x5584a1586d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a157a080 0x5584a1584400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 --2- 172.21.15.1:0/2439280551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1579760 0x5584a1579b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 -- 172.21.15.1:0/2439280551 >> 172.21.15.1:0/2439280551 conn(0x5584a1575cf0 msgr2=0x5584a15760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 -- 172.21.15.1:0/2439280551 shutdown_connections 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.838+0000 7f163d14f740 1 -- 172.21.15.1:0/2439280551 wait complete. 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 -- start start 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 Processor -- start 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 0x5584a15821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584a1587510 con 0x5584a1584940 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584a14676e0 con 0x5584a157a080 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584a1587690 con 0x5584a1579760 2024-09-19T05:34:14.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f163d14f740 10 client.0 _ll_register_callbacks cb 0x5584a148ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1639313640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 0x5584a15821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1638b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:53790/0 (socket says 172.21.15.1:53790) 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1638b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:46428/0 (socket says 172.21.15.1:46428) 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1633fff640 1 -- 172.21.15.1:0/705133458 learned_addr learned my addr 172.21.15.1:0/705133458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:14.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.839+0000 7f1639313640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 0x5584a15821d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60986/0 (socket says 172.21.15.1:60986) 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 -- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 msgr2=0x5584a1581750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 -- 172.21.15.1:0/705133458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 msgr2=0x5584a15821d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 0x5584a15821d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 -- 172.21.15.1:0/705133458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a1590980 con 0x5584a157a080 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1638b12640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1633fff640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16200bc260 tx=0x7f16200f3680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=294fa6aa334fd8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1613fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620049070 con 0x5584a157a080 2024-09-19T05:34:14.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f16200b8940 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1628005500 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f16200dae60 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f163d14f740 10 client.25343 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.840+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584a15932b0 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1628005500 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f16200f2110 con 0x5584a157a080 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 10 client.25343 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 10 client.25343 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 20 client.25343 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a1594600 0x5584a1596a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 4 client.25343 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:34:14.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584a14ec9d0 con 0x5584a1594600 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f1638b12640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a1594600 0x5584a1596a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f1638b12640 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a1594600 0x5584a1596a20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55bfd15af19573dc server_cookie=728af4ccb77167ff in_seq=0 out_seq=0 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.841+0000 7f1613fff640 10 client.25343 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f1613fff640 1 -- 172.21.15.1:0/705133458 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584a14ec9d0 con 0x5584a1594600 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f1613fff640 10 client.25343 handle_command_reply: tid=0 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 client.25343 shutdown 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 msgr2=0x5584a1581c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16200bc260 tx=0x7f16200f3680 comp rx=0 tx=0).stop 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 shutdown_connections 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a1584940 0x5584a15821d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a157a080 0x5584a1581c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a1594600 0x5584a1596a20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 --2- 172.21.15.1:0/705133458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1579760 0x5584a1581750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f1613fff640 0 client.25343 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 >> 172.21.15.1:0/705133458 conn(0x5584a1575cf0 msgr2=0x5584a157ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 shutdown_connections 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.842+0000 7f163d14f740 1 -- 172.21.15.1:0/705133458 wait complete. 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.843+0000 7f163d14f740 20 client.25343 trim_cache size 0 max 16384 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 Processor -- start 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 -- start start 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a1580a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a1574d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16341acc00 con 0x5584a157a080 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f16341af480 con 0x5584a1579760 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f163d14f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16341ad270 con 0x5584a1584940 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60988/0 (socket says 172.21.15.1:60988) 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 -- 172.21.15.1:0/3079580236 learned_addr learned my addr 172.21.15.1:0/3079580236 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1639313640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a1574d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1638b12640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a1580a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 -- 172.21.15.1:0/3079580236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 msgr2=0x5584a1574d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a1574d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 -- 172.21.15.1:0/3079580236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 msgr2=0x5584a1580a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a1580a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.861+0000 7f1633fff640 1 -- 172.21.15.1:0/3079580236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a1575b20 con 0x5584a157a080 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.862+0000 7f1638b12640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a1580a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.862+0000 7f1633fff640 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f16200b8730 tx=0x7f16200ba7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee5d05ba80ec6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.862+0000 7f161e7fc640 1 -- 172.21.15.1:0/3079580236 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620049030 con 0x5584a157a080 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.862+0000 7f161e7fc640 1 -- 172.21.15.1:0/3079580236 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16200f3b00 con 0x5584a157a080 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.862+0000 7f161e7fc640 1 -- 172.21.15.1:0/3079580236 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16200b8940 con 0x5584a157a080 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- 172.21.15.1:0/3079580236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 msgr2=0x5584a1583620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f16200b8730 tx=0x7f16200ba7e0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- 172.21.15.1:0/3079580236 shutdown_connections 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a1574d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1583620 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 --2- 172.21.15.1:0/3079580236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a1580a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- 172.21.15.1:0/3079580236 >> 172.21.15.1:0/3079580236 conn(0x5584a1575cf0 msgr2=0x5584a1574650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- 172.21.15.1:0/3079580236 shutdown_connections 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- 172.21.15.1:0/3079580236 wait complete. 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 -- start start 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.863+0000 7f163d14f740 1 Processor -- start 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a15fb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16341ad940 con 0x5584a157a080 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f16341aedb0 con 0x5584a1579760 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16341ae010 con 0x5584a1584940 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f163d14f740 10 client.0 _ll_register_callbacks cb 0x7f1620005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:53802/0 (socket says 172.21.15.1:53802) 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60998/0 (socket says 172.21.15.1:60998) 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 -- 172.21.15.1:0/293298858 learned_addr learned my addr 172.21.15.1:0/293298858 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1639313640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a15fb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 -- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 msgr2=0x5584a15fb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a15fb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 -- 172.21.15.1:0/293298858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 msgr2=0x5584a1589710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 -- 172.21.15.1:0/293298858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a1576980 con 0x5584a1579760 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1633fff640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1638b12640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1628005fd0 tx=0x7f1628004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c2aa8cff8b8a143 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1613fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.864+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162802d070 con 0x5584a1579760 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584a14e6d20 con 0x5584a1579760 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1628004250 con 0x5584a1579760 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1628039050 con 0x5584a1579760 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 10 client.25349 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:14.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584a1571260 con 0x5584a1579760 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5584a14e6d20 con 0x5584a1579760 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1628003680 con 0x5584a1579760 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 10 client.25349 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 10 client.25349 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 20 client.25349 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a16043e0 0x5584a16067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 4 client.25349 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x5584a1462ec0 con 0x5584a16043e0 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.865+0000 7f1633fff640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a16043e0 0x5584a16067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.866+0000 7f1613fff640 10 client.25349 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:14.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.866+0000 7f1633fff640 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a16043e0 0x5584a16067d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9770b504736e653 server_cookie=b64e7550d8b9249b in_seq=0 out_seq=0 2024-09-19T05:34:14.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.966+0000 7f1613fff640 1 -- 172.21.15.1:0/293298858 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5584a1462ec0 con 0x5584a16043e0 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.966+0000 7f1613fff640 10 client.25349 handle_command_reply: tid=0 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.966+0000 7f163d14f740 1 client.25349 shutdown 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 msgr2=0x5584a15891d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1628005fd0 tx=0x7f1628004a50 comp rx=0 tx=0).stop 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 shutdown_connections 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584a16043e0 0x5584a16067d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584a1584940 0x5584a15fb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584a157a080 0x5584a1589710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f1613fff640 0 client.25349 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:14.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 --2- 172.21.15.1:0/293298858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584a1579760 0x5584a15891d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 >> 172.21.15.1:0/293298858 conn(0x5584a1575cf0 msgr2=0x5584a1581f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 shutdown_connections 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 1 -- 172.21.15.1:0/293298858 wait complete. 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.967+0000 7f163d14f740 20 client.25349 trim_cache size 0 max 16384 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:34:14.976 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 46, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "7ae4fec0": { 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 46, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 142.2, 2024-09-19T05:34:14.977 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:14.978 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:34:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.969+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 msgr2=0x7f16240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.969+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 0x7f16240a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f162c003e10 tx=0x7f162c004a40 comp rx=0 tx=0).stop 2024-09-19T05:34:14.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.969+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 msgr2=0x7f1634198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.969+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1620006010 tx=0x7f1620003c10 comp rx=0 tx=0).stop 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 shutdown_connections 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f16240a3240 0x7f16240a5700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1634102ef0 0x7f163419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1634102570 0x7f1634198a10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 --2- 172.21.15.1:0/3143788456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1634100e20 0x7f16341984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 >> 172.21.15.1:0/3143788456 conn(0x7f16340fc7d0 msgr2=0x7f163406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 shutdown_connections 2024-09-19T05:34:14.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:14.971+0000 7f163ad76640 1 -- 172.21.15.1:0/3143788456 wait complete. 2024-09-19T05:34:15.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.87 MB/sec execute 570 sec latency 482.856 ms 2024-09-19T05:34:15.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:15 smithi001 ceph-mon[30968]: pgmap v743: 129 pgs: 129 active+clean; 239 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-19T05:34:15.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:34:15.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:34:15.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:34:15.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:34:15.816 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ae4fec0', quiesce took 3.6 seconds. Will release after: 18.599999999999998 2024-09-19T05:34:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:15 smithi060 ceph-mon[35058]: pgmap v743: 129 pgs: 129 active+clean; 239 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-19T05:34:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:34:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:34:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:34:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:34:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:15 smithi082 ceph-mon[35195]: pgmap v743: 129 pgs: 129 active+clean; 239 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 96 op/s 2024-09-19T05:34:16.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:34:16.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:34:16.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:34:16.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:34:16.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.85 MB/sec execute 571 sec latency 1482.971 ms 2024-09-19T05:34:17.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.83 MB/sec execute 572 sec latency 2483.095 ms 2024-09-19T05:34:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:17 smithi001 ceph-mon[30968]: pgmap v744: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 3.2 MiB/s wr, 120 op/s 2024-09-19T05:34:18.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:17 smithi060 ceph-mon[35058]: pgmap v744: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 3.2 MiB/s wr, 120 op/s 2024-09-19T05:34:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:17 smithi082 ceph-mon[35195]: pgmap v744: 129 pgs: 129 active+clean; 246 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 3.2 MiB/s wr, 120 op/s 2024-09-19T05:34:18.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.81 MB/sec execute 573 sec latency 3483.209 ms 2024-09-19T05:34:19.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.79 MB/sec execute 574 sec latency 4483.263 ms 2024-09-19T05:34:19.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:19 smithi001 ceph-mon[30968]: pgmap v745: 129 pgs: 129 active+clean; 255 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.0 MiB/s wr, 148 op/s 2024-09-19T05:34:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:19 smithi060 ceph-mon[35058]: pgmap v745: 129 pgs: 129 active+clean; 255 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.0 MiB/s wr, 148 op/s 2024-09-19T05:34:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:19 smithi082 ceph-mon[35195]: pgmap v745: 129 pgs: 129 active+clean; 255 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 4.0 MiB/s wr, 148 op/s 2024-09-19T05:34:20.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.77 MB/sec execute 575 sec latency 5483.338 ms 2024-09-19T05:34:21.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.75 MB/sec execute 576 sec latency 6483.447 ms 2024-09-19T05:34:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:21 smithi001 ceph-mon[30968]: pgmap v746: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.9 MiB/s wr, 136 op/s 2024-09-19T05:34:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:21 smithi060 ceph-mon[35058]: pgmap v746: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.9 MiB/s wr, 136 op/s 2024-09-19T05:34:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:21 smithi082 ceph-mon[35195]: pgmap v746: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 3.9 MiB/s wr, 136 op/s 2024-09-19T05:34:22.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.74 MB/sec execute 577 sec latency 7483.574 ms 2024-09-19T05:34:23.423 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.72 MB/sec execute 578 sec latency 8483.680 ms 2024-09-19T05:34:23.803 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:23 smithi060 ceph-mon[35058]: pgmap v747: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.0 MiB/s wr, 142 op/s 2024-09-19T05:34:23.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:23 smithi082 ceph-mon[35195]: pgmap v747: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.0 MiB/s wr, 142 op/s 2024-09-19T05:34:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:23 smithi001 ceph-mon[30968]: pgmap v747: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 4.0 MiB/s wr, 142 op/s 2024-09-19T05:34:24.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.70 MB/sec execute 579 sec latency 9483.753 ms 2024-09-19T05:34:25.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.68 MB/sec execute 580 sec latency 10483.821 ms 2024-09-19T05:34:25.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:25 smithi001 ceph-mon[30968]: pgmap v748: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-09-19T05:34:26.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:25 smithi060 ceph-mon[35058]: pgmap v748: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-09-19T05:34:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:25 smithi082 ceph-mon[35195]: pgmap v748: 129 pgs: 129 active+clean; 257 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-09-19T05:34:26.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.66 MB/sec execute 581 sec latency 11483.921 ms 2024-09-19T05:34:27.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.64 MB/sec execute 582 sec latency 12483.992 ms 2024-09-19T05:34:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:27 smithi001 ceph-mon[30968]: pgmap v749: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 3.5 MiB/s wr, 115 op/s 2024-09-19T05:34:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:27 smithi060 ceph-mon[35058]: pgmap v749: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 3.5 MiB/s wr, 115 op/s 2024-09-19T05:34:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:27 smithi082 ceph-mon[35195]: pgmap v749: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 3.5 MiB/s wr, 115 op/s 2024-09-19T05:34:28.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.63 MB/sec execute 583 sec latency 13484.116 ms 2024-09-19T05:34:29.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.61 MB/sec execute 584 sec latency 14484.248 ms 2024-09-19T05:34:29.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:29 smithi001 ceph-mon[30968]: pgmap v750: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.3 MiB/s wr, 97 op/s 2024-09-19T05:34:30.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:29 smithi060 ceph-mon[35058]: pgmap v750: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.3 MiB/s wr, 97 op/s 2024-09-19T05:34:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:29 smithi082 ceph-mon[35195]: pgmap v750: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 2.3 MiB/s wr, 97 op/s 2024-09-19T05:34:30.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.59 MB/sec execute 585 sec latency 15484.395 ms 2024-09-19T05:34:31.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.57 MB/sec execute 586 sec latency 16484.472 ms 2024-09-19T05:34:31.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:31 smithi001 ceph-mon[30968]: pgmap v751: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-19T05:34:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:31 smithi060 ceph-mon[35058]: pgmap v751: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-19T05:34:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:31 smithi082 ceph-mon[35195]: pgmap v751: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-09-19T05:34:32.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.55 MB/sec execute 587 sec latency 17484.589 ms 2024-09-19T05:34:33.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.54 MB/sec execute 588 sec latency 18484.706 ms 2024-09-19T05:34:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:33 smithi001 ceph-mon[30968]: pgmap v752: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-09-19T05:34:34.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:33 smithi060 ceph-mon[35058]: pgmap v752: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-09-19T05:34:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:33 smithi082 ceph-mon[35195]: pgmap v752: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-09-19T05:34:34.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:34:34.424 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.52 MB/sec execute 589 sec latency 19484.759 ms 2024-09-19T05:34:34.676 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:35.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 -- 172.21.15.1:0/2831775738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd07810e3c0 msgr2=0x7fd078110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:35.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/2831775738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd07810e3c0 0x7fd078110810 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd070009ca0 tx=0x7fd07002a950 comp rx=0 tx=0).stop 2024-09-19T05:34:35.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 -- 172.21.15.1:0/2831775738 shutdown_connections 2024-09-19T05:34:35.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/2831775738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd07810e3c0 0x7fd078110810 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/2831775738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 0x7fd07810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/2831775738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd078074620 0x7fd078074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 -- 172.21.15.1:0/2831775738 >> 172.21.15.1:0/2831775738 conn(0x7fd0780fd8c0 msgr2=0x7fd0780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 -- 172.21.15.1:0/2831775738 shutdown_connections 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.290+0000 7fd07f2a2640 1 -- 172.21.15.1:0/2831775738 wait complete. 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 Processor -- start 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 -- start start 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 0x7fd07819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd07810e3c0 0x7fd07819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781141b0 con 0x7fd078074620 2024-09-19T05:34:35.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd078114030 con 0x7fd078074f40 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07f2a2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd078114330 con 0x7fd07810e3c0 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51212/0 (socket says 172.21.15.1:51212) 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 -- 172.21.15.1:0/1302085359 learned_addr learned my addr 172.21.15.1:0/1302085359 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d83f640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd07810e3c0 0x7fd07819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07c83d640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 0x7fd07819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 -- 172.21.15.1:0/1302085359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd07810e3c0 msgr2=0x7fd07819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd07810e3c0 0x7fd07819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 -- 172.21.15.1:0/1302085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 msgr2=0x7fd07819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 0x7fd07819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.291+0000 7fd07d03e640 1 -- 172.21.15.1:0/1302085359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07819f5e0 con 0x7fd078074620 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd07d03e640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd07400d770 tx=0x7fd07400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074017070 con 0x7fd078074620 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd074005500 con 0x7fd078074620 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07819f8d0 con 0x7fd078074620 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074004e00 con 0x7fd078074620 2024-09-19T05:34:35.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.292+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0781a71b0 con 0x7fd078074620 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.293+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd078074a00 con 0x7fd078074620 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.294+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd074004fa0 con 0x7fd078074620 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.295+0000 7fd06e7fc640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 0x7fd0640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.295+0000 7fd07c83d640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 0x7fd0640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.295+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd0740cf5e0 con 0x7fd078074620 2024-09-19T05:34:35.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.295+0000 7fd07c83d640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 0x7fd0640a5780 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd07810f6e0 tx=0x7fd06800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:35.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.299+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd07409b900 con 0x7fd078074620 2024-09-19T05:34:35.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.50 MB/sec execute 590 sec latency 20484.792 ms 2024-09-19T05:34:35.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.510+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd07819b990 con 0x7fd078074620 2024-09-19T05:34:35.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.511+0000 7fd06e7fc640 1 -- 172.21.15.1:0/1302085359 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fd07409fc00 con 0x7fd078074620 2024-09-19T05:34:35.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:34:35.514 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:34:35.514 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:34:35.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 msgr2=0x7fd0640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:35.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 0x7fd0640a5780 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd07810f6e0 tx=0x7fd06800b390 comp rx=0 tx=0).stop 2024-09-19T05:34:35.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 msgr2=0x7fd07819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:35.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd07400d770 tx=0x7fd07400dc30 comp rx=0 tx=0).stop 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 shutdown_connections 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0640a32c0 0x7fd0640a5780 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd07810e3c0 0x7fd07819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd078074f40 0x7fd07819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 --2- 172.21.15.1:0/1302085359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd078074620 0x7fd07819a630 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 >> 172.21.15.1:0/1302085359 conn(0x7fd0780fd8c0 msgr2=0x7fd0780fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 shutdown_connections 2024-09-19T05:34:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:35.513+0000 7fd07f2a2640 1 -- 172.21.15.1:0/1302085359 wait complete. 2024-09-19T05:34:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:35 smithi001 ceph-mon[30968]: pgmap v753: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 426 KiB/s wr, 26 op/s 2024-09-19T05:34:35.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:35 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1302085359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:35 smithi060 ceph-mon[35058]: pgmap v753: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 426 KiB/s wr, 26 op/s 2024-09-19T05:34:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:35 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1302085359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:35 smithi082 ceph-mon[35195]: pgmap v753: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 426 KiB/s wr, 26 op/s 2024-09-19T05:34:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:35 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1302085359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:34:36.301 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 7ae4fec0 --release --await' 2024-09-19T05:34:36.302 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 7ae4fec0 --release --await 2024-09-19T05:34:36.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1413312 10.48 MB/sec execute 591 sec latency 21484.850 ms 2024-09-19T05:34:36.603 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:34:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 -- 172.21.15.1:0/3788238419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 msgr2=0x7fec8c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 --2- 172.21.15.1:0/3788238419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c103180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009900 tx=0x7fec7c02a480 comp rx=0 tx=0).stop 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 -- 172.21.15.1:0/3788238419 shutdown_connections 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 --2- 172.21.15.1:0/3788238419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c10c180 0x7fec8c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 --2- 172.21.15.1:0/3788238419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c1036c0 0x7fec8c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 --2- 172.21.15.1:0/3788238419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c103180 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 -- 172.21.15.1:0/3788238419 >> 172.21.15.1:0/3788238419 conn(0x7fec8c0fc7a0 msgr2=0x7fec8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 -- 172.21.15.1:0/3788238419 shutdown_connections 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.090+0000 7fec9110d640 1 -- 172.21.15.1:0/3788238419 wait complete. 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 Processor -- start 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 -- start start 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 0x7fec8c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c10c180 0x7fec8c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c111f60 con 0x7fec8c102da0 2024-09-19T05:34:37.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c111de0 con 0x7fec8c1036c0 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec9110d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1120e0 con 0x7fec8c10c180 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec8ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.091+0000 7fec8ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51230/0 (socket says 172.21.15.1:51230) 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 -- 172.21.15.1:0/3353561514 learned_addr learned my addr 172.21.15.1:0/3353561514 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c10c180 0x7fec8c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec83fff640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 0x7fec8c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 -- 172.21.15.1:0/3353561514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c10c180 msgr2=0x7fec8c19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c10c180 0x7fec8c19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 -- 172.21.15.1:0/3353561514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 msgr2=0x7fec8c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 0x7fec8c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 -- 172.21.15.1:0/3353561514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8c19d430 con 0x7fec8c102da0 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec83fff640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 0x7fec8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:37.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fec7c006010 tx=0x7fec7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec88d99640 1 -- 172.21.15.1:0/3353561514 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c03f030 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec88d99640 1 -- 172.21.15.1:0/3353561514 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec7c003ce0 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8c19d6c0 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec88d99640 1 -- 172.21.15.1:0/3353561514 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c035070 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.092+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec8c1a5000 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec88d99640 1 -- 172.21.15.1:0/3353561514 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fec7c042030 con 0x7fec8c102da0 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 Processor -- start 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 -- start start 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffa7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cffa7650 0x5617cffa9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5617cfefd620 con 0x5617cff97f40 2024-09-19T05:34:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5617cfea4e50 con 0x5617cff98860 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec934e6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617cfef95e0 con 0x5617cffa7650 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51236/0 (socket says 172.21.15.1:51236) 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.095+0000 7fec8b59e640 1 -- 172.21.15.1:0/810343157 learned_addr learned my addr 172.21.15.1:0/810343157 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffa7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec83fff640 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cffa7650 0x5617cffa9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec88d99640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 0x7fec780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 -- 172.21.15.1:0/810343157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cffa7650 msgr2=0x5617cffa9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cffa7650 0x5617cffa9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 -- 172.21.15.1:0/810343157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 msgr2=0x5617cffa7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffa7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 -- 172.21.15.1:0/810343157 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cfe95d40 con 0x5617cff97f40 2024-09-19T05:34:37.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec88d99640 1 -- 172.21.15.1:0/3353561514 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fec7c0f0380 con 0x7fec8c102da0 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 0x7fec780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec8400af50 tx=0x7fec8400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5a61883c0d438 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec817fa640 1 -- 172.21.15.1:0/810343157 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8401ac60 con 0x5617cff97f40 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 0x7fec780a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec84020000 tx=0x7fec8401c030 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec817fa640 1 -- 172.21.15.1:0/810343157 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8401ae00 con 0x5617cff97f40 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.096+0000 7fec817fa640 1 -- 172.21.15.1:0/810343157 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84005770 con 0x5617cff97f40 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 -- 172.21.15.1:0/810343157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 msgr2=0x5617cff98320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec8400af50 tx=0x7fec8400f850 comp rx=0 tx=0).stop 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 -- 172.21.15.1:0/810343157 shutdown_connections 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cffa7650 0x5617cffa9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffa7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 --2- 172.21.15.1:0/810343157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff97f40 0x5617cff98320 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 -- 172.21.15.1:0/810343157 >> 172.21.15.1:0/810343157 conn(0x5617cff945f0 msgr2=0x5617cff949d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 -- 172.21.15.1:0/810343157 shutdown_connections 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.097+0000 7fec934e6740 1 -- 172.21.15.1:0/810343157 wait complete. 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 -- start start 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 Processor -- start 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 0x5617cffa50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5617cffaa220 con 0x5617cff98860 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5617cfe85f10 con 0x5617cffa7650 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617cffaa3a0 con 0x5617cff97f40 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec934e6740 10 client.0 _ll_register_callbacks cb 0x5617cfea9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51240/0 (socket says 172.21.15.1:51240) 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 -- 172.21.15.1:0/2027843341 learned_addr learned my addr 172.21.15.1:0/2027843341 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:37.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec8b59e640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 0x5617cffa50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 -- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 msgr2=0x5617cffa4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 -- 172.21.15.1:0/2027843341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 msgr2=0x5617cffa50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 0x5617cffa50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec83fff640 1 -- 172.21.15.1:0/2027843341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cfc0c580 con 0x5617cff98860 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.098+0000 7fec8b59e640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 0x5617cffa50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec83fff640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fec7400bf40 tx=0x7fec740128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4629841186c0c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7401f060 con 0x5617cff98860 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fec74010960 con 0x5617cff98860 2024-09-19T05:34:37.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8401ae00 con 0x5617cff98860 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fec74026050 con 0x5617cff98860 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 10 client.15768 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5617cfcd6960 con 0x5617cff98860 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8401ae00 con 0x5617cff98860 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fec74019030 con 0x5617cff98860 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 10 client.15768 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 10 client.15768 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 20 client.15768 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617cffb7390 0x5617cffb97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 4 client.15768 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.099+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617cff0ab90 con 0x5617cffb7390 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.100+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617cffb7390 0x5617cffb97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.100+0000 7fec727fc640 10 client.15768 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:37.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.100+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617cffb7390 0x5617cffb97d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d385af6e913e72 server_cookie=88da03639ec33d2e in_seq=0 out_seq=0 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec727fc640 1 -- 172.21.15.1:0/2027843341 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617cff0ab90 con 0x5617cffb7390 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec727fc640 10 client.15768 handle_command_reply: tid=0 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 client.15768 shutdown 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 msgr2=0x5617cffa4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fec7400bf40 tx=0x7fec740128e0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 shutdown_connections 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cffa7650 0x5617cffa50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cff98860 0x5617cffa4b70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617cffb7390 0x5617cffb97d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 --2- 172.21.15.1:0/2027843341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec727fc640 0 client.15768 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 >> 172.21.15.1:0/2027843341 conn(0x5617cff945f0 msgr2=0x5617cff9a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 shutdown_connections 2024-09-19T05:34:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 1 -- 172.21.15.1:0/2027843341 wait complete. 2024-09-19T05:34:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.101+0000 7fec934e6740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T05:34:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.119+0000 7fec934e6740 1 Processor -- start 2024-09-19T05:34:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.119+0000 7fec934e6740 1 -- start start 2024-09-19T05:34:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffbf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1aab00 con 0x5617cffa7650 2024-09-19T05:34:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1ad380 con 0x5617cff98860 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec934e6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1ab170 con 0x5617cff97f40 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51254/0 (socket says 172.21.15.1:51254) 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 -- 172.21.15.1:0/195274375 learned_addr learned my addr 172.21.15.1:0/195274375 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec83fff640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffbf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 -- 172.21.15.1:0/195274375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 msgr2=0x5617cffa3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 -- 172.21.15.1:0/195274375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 msgr2=0x5617cffbf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffbf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec8b59e640 1 -- 172.21.15.1:0/195274375 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cffa2b80 con 0x5617cffa7650 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.120+0000 7fec83fff640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffbf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec8b59e640 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fec84014fd0 tx=0x7fec840124d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03819d50572281b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec80ff9640 1 -- 172.21.15.1:0/195274375 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84032070 con 0x5617cffa7650 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec80ff9640 1 -- 172.21.15.1:0/195274375 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec840059d0 con 0x5617cffa7650 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec80ff9640 1 -- 172.21.15.1:0/195274375 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84004e30 con 0x5617cffa7650 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec934e6740 1 -- 172.21.15.1:0/195274375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 msgr2=0x5617cffbf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.121+0000 7fec934e6740 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fec84014fd0 tx=0x7fec840124d0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- 172.21.15.1:0/195274375 shutdown_connections 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617cffbf5e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffbf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- 172.21.15.1:0/195274375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffa3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- 172.21.15.1:0/195274375 >> 172.21.15.1:0/195274375 conn(0x5617cff945f0 msgr2=0x5617cffa4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- 172.21.15.1:0/195274375 shutdown_connections 2024-09-19T05:34:37.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- 172.21.15.1:0/195274375 wait complete. 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- start start 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 Processor -- start 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffabc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1ab840 con 0x5617cffa7650 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1accb0 con 0x5617cff98860 2024-09-19T05:34:37.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec934e6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec8c1abf10 con 0x5617cff97f40 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.122+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec934e6740 10 client.0 _ll_register_callbacks cb 0x7fec7400ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51258/0 (socket says 172.21.15.1:51258) 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 -- 172.21.15.1:0/3231268843 learned_addr learned my addr 172.21.15.1:0/3231268843 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffabc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec83fff640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 -- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 msgr2=0x5617cffabc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffabc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 -- 172.21.15.1:0/3231268843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 msgr2=0x5617cffac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 -- 172.21.15.1:0/3231268843 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d001b6a0 con 0x5617cffa7650 2024-09-19T05:34:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec8b59e640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fec8400f890 tx=0x7fec840120b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac01d5a5a8de2ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec727fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84032070 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fec8401ac70 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec840059d0 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fec84003970 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec934e6740 10 client.15774 fetch_fsmap learned FSMap version 21 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.123+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5617d0022a40 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec840059d0 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fec84023070 con 0x5617cffa7650 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 10 client.15774 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 10 client.15774 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 20 client.15774 populate_metadata read hostname 'smithi001' 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617d0022f70 0x5617d0025360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:34:37.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 4 client.15774 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ae4fec0", "release": true, "await": true}] 2024-09-19T05:34:37.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ae4fec0", "release": true, "await": true}) -- 0x5617cff050a0 con 0x5617d0022f70 2024-09-19T05:34:37.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.124+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617d0022f70 0x5617d0025360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:34:37.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.125+0000 7fec8ad9d640 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617d0022f70 0x5617d0025360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a9ebe9dcd6f052a server_cookie=711ef9578c8d9612 in_seq=0 out_seq=0 2024-09-19T05:34:37.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.125+0000 7fec727fc640 10 client.15774 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec727fc640 1 -- 172.21.15.1:0/3231268843 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5617cff050a0 con 0x5617d0022f70 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec727fc640 10 client.15774 handle_command_reply: tid=0 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 client.15774 shutdown 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 msgr2=0x5617d001b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fec8400f890 tx=0x7fec840120b0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 shutdown_connections 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5617cffa7650 0x5617d001b0b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5617cff98860 0x5617cffac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5617d0022f70 0x5617d0025360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 --2- 172.21.15.1:0/3231268843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617cff97f40 0x5617cffabc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 >> 172.21.15.1:0/3231268843 conn(0x5617cff945f0 msgr2=0x5617cff92f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec727fc640 0 client.15774 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 shutdown_connections 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 1 -- 172.21.15.1:0/3231268843 wait complete. 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.135+0000 7fec934e6740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:34:37.138 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 48, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "7ae4fec0": { 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 48, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 142.2, 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:34:37.139 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:34:37.140 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 msgr2=0x7fec780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 0x7fec780a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec84020000 tx=0x7fec8401c030 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 msgr2=0x7fec8c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fec7c006010 tx=0x7fec7c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 shutdown_connections 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fec780a3240 0x7fec780a5700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec8c10c180 0x7fec8c19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec8c1036c0 0x7fec8c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 --2- 172.21.15.1:0/3353561514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fec8c102da0 0x7fec8c198480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:34:37.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 >> 172.21.15.1:0/3353561514 conn(0x7fec8c0fc7a0 msgr2=0x7fec8c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:34:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 shutdown_connections 2024-09-19T05:34:37.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:34:37.136+0000 7fec9110d640 1 -- 172.21.15.1:0/3353561514 wait complete. 2024-09-19T05:34:37.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1414247 10.48 MB/sec execute 592 sec latency 22196.153 ms 2024-09-19T05:34:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:37 smithi001 ceph-mon[30968]: pgmap v754: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 310 KiB/s wr, 20 op/s 2024-09-19T05:34:37.896 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ae4fec0', total seconds elapsed: 25.7 2024-09-19T05:34:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:37 smithi060 ceph-mon[35058]: pgmap v754: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 310 KiB/s wr, 20 op/s 2024-09-19T05:34:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:37 smithi082 ceph-mon[35195]: pgmap v754: 129 pgs: 129 active+clean; 252 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 310 KiB/s wr, 20 op/s 2024-09-19T05:34:38.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1416962 10.48 MB/sec execute 593 sec latency 19.278 ms 2024-09-19T05:34:39.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1419965 10.49 MB/sec execute 594 sec latency 10.759 ms 2024-09-19T05:34:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:39 smithi001 ceph-mon[30968]: pgmap v755: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 257 KiB/s wr, 21 op/s 2024-09-19T05:34:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:39 smithi060 ceph-mon[35058]: pgmap v755: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 257 KiB/s wr, 21 op/s 2024-09-19T05:34:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:39 smithi082 ceph-mon[35195]: pgmap v755: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 257 KiB/s wr, 21 op/s 2024-09-19T05:34:40.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1422430 10.49 MB/sec execute 595 sec latency 19.280 ms 2024-09-19T05:34:41.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1425387 10.50 MB/sec execute 596 sec latency 43.197 ms 2024-09-19T05:34:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:41 smithi001 ceph-mon[30968]: pgmap v756: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-09-19T05:34:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:41 smithi060 ceph-mon[35058]: pgmap v756: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-09-19T05:34:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:41 smithi082 ceph-mon[35195]: pgmap v756: 129 pgs: 129 active+clean; 253 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-09-19T05:34:42.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1428594 10.52 MB/sec execute 597 sec latency 25.091 ms 2024-09-19T05:34:43.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1431790 10.53 MB/sec execute 598 sec latency 33.143 ms 2024-09-19T05:34:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:43 smithi001 ceph-mon[30968]: pgmap v757: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 236 KiB/s wr, 23 op/s 2024-09-19T05:34:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:43 smithi060 ceph-mon[35058]: pgmap v757: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 236 KiB/s wr, 23 op/s 2024-09-19T05:34:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:43 smithi082 ceph-mon[35195]: pgmap v757: 129 pgs: 129 active+clean; 254 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 236 KiB/s wr, 23 op/s 2024-09-19T05:34:44.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1434150 10.53 MB/sec execute 599 sec latency 39.113 ms 2024-09-19T05:34:45.425 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 600 sec 2024-09-19T05:34:45.523 INFO:tasks.workunit.client.0.smithi001.stdout: 0 cleanup 600 sec 2024-09-19T05:34:45.523 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:34:45.523 INFO:tasks.workunit.client.0.smithi001.stdout: Operation Count AvgLat MaxLat 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: ---------------------------------------- 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: NTCreateX 201134 1.634 29669.050 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Close 147729 0.002 0.106 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Rename 8516 5.925 22196.139 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Unlink 40640 1.290 86.857 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Deltree 6 61.841 112.884 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Mkdir 3 0.005 0.006 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Qpathinfo 182257 0.506 147.499 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Qfileinfo 31952 0.001 0.028 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Qfsinfo 33426 0.185 37.779 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Sfileinfo 16387 0.017 14.393 2024-09-19T05:34:45.524 INFO:tasks.workunit.client.0.smithi001.stdout: Find 70457 0.063 21.554 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: WriteX 100423 0.014 72.969 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: ReadX 314998 0.014 72.896 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: LockX 654 0.801 46.798 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: UnlockX 654 0.652 51.210 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: Flush 14103 3.944 249.304 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stdout:Throughput 10.5266 MB/sec 1 clients 1 procs max_latency=29669.058 ms 2024-09-19T05:34:45.525 INFO:tasks.workunit.client.0.smithi001.stderr:+ dbench 10 2024-09-19T05:34:45.526 INFO:tasks.workunit.client.0.smithi001.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-19T05:34:45.526 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:34:45.526 INFO:tasks.workunit.client.0.smithi001.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-19T05:34:45.526 INFO:tasks.workunit.client.0.smithi001.stdout:8 of 10 processes prepared for launch 0 sec 2024-09-19T05:34:45.625 INFO:tasks.workunit.client.0.smithi001.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-19T05:34:45.625 INFO:tasks.workunit.client.0.smithi001.stdout:releasing clients 2024-09-19T05:34:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:45 smithi001 ceph-mon[30968]: pgmap v758: 129 pgs: 129 active+clean; 258 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 586 KiB/s wr, 78 op/s 2024-09-19T05:34:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:45 smithi060 ceph-mon[35058]: pgmap v758: 129 pgs: 129 active+clean; 258 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 586 KiB/s wr, 78 op/s 2024-09-19T05:34:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:45 smithi082 ceph-mon[35195]: pgmap v758: 129 pgs: 129 active+clean; 258 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 586 KiB/s wr, 78 op/s 2024-09-19T05:34:46.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 449 158.01 MB/sec warmup 1 sec latency 40.936 ms 2024-09-19T05:34:47.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 962 110.02 MB/sec warmup 2 sec latency 56.106 ms 2024-09-19T05:34:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:47 smithi001 ceph-mon[30968]: pgmap v759: 129 pgs: 129 active+clean; 262 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-09-19T05:34:48.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:47 smithi060 ceph-mon[35058]: pgmap v759: 129 pgs: 129 active+clean; 262 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-09-19T05:34:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:47 smithi082 ceph-mon[35195]: pgmap v759: 129 pgs: 129 active+clean; 262 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.2 MiB/s wr, 145 op/s 2024-09-19T05:34:48.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1564 87.04 MB/sec warmup 3 sec latency 103.380 ms 2024-09-19T05:34:49.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1782 65.78 MB/sec warmup 4 sec latency 453.071 ms 2024-09-19T05:34:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:49 smithi001 ceph-mon[30968]: pgmap v760: 129 pgs: 129 active+clean; 265 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-19T05:34:50.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:49 smithi060 ceph-mon[35058]: pgmap v760: 129 pgs: 129 active+clean; 265 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-19T05:34:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:49 smithi082 ceph-mon[35195]: pgmap v760: 129 pgs: 129 active+clean; 265 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-09-19T05:34:50.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2517 57.46 MB/sec warmup 5 sec latency 56.343 ms 2024-09-19T05:34:51.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 3337 59.14 MB/sec warmup 6 sec latency 38.640 ms 2024-09-19T05:34:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:51 smithi001 ceph-mon[30968]: pgmap v761: 129 pgs: 129 active+clean; 311 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 235 op/s 2024-09-19T05:34:52.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:51 smithi060 ceph-mon[35058]: pgmap v761: 129 pgs: 129 active+clean; 311 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 235 op/s 2024-09-19T05:34:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:51 smithi082 ceph-mon[35195]: pgmap v761: 129 pgs: 129 active+clean; 311 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 235 op/s 2024-09-19T05:34:52.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 3789 56.81 MB/sec warmup 7 sec latency 54.769 ms 2024-09-19T05:34:53.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 4006 50.08 MB/sec warmup 8 sec latency 66.707 ms 2024-09-19T05:34:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:53 smithi001 ceph-mon[30968]: pgmap v762: 129 pgs: 129 active+clean; 385 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 15 MiB/s wr, 310 op/s 2024-09-19T05:34:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:53 smithi060 ceph-mon[35058]: pgmap v762: 129 pgs: 129 active+clean; 385 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 15 MiB/s wr, 310 op/s 2024-09-19T05:34:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:53 smithi082 ceph-mon[35195]: pgmap v762: 129 pgs: 129 active+clean; 385 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 15 MiB/s wr, 310 op/s 2024-09-19T05:34:54.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 4196 44.62 MB/sec warmup 9 sec latency 223.310 ms 2024-09-19T05:34:55.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 4574 41.37 MB/sec warmup 10 sec latency 95.367 ms 2024-09-19T05:34:55.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:55 smithi001 ceph-mon[30968]: pgmap v763: 129 pgs: 129 active+clean; 410 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 17 MiB/s wr, 338 op/s 2024-09-19T05:34:56.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:55 smithi060 ceph-mon[35058]: pgmap v763: 129 pgs: 129 active+clean; 410 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 17 MiB/s wr, 338 op/s 2024-09-19T05:34:56.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:55 smithi082 ceph-mon[35195]: pgmap v763: 129 pgs: 129 active+clean; 410 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 17 MiB/s wr, 338 op/s 2024-09-19T05:34:56.625 INFO:tasks.workunit.client.0.smithi001.stdout: 10 5173 41.17 MB/sec warmup 11 sec latency 57.895 ms 2024-09-19T05:34:57.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 6013 39.51 MB/sec warmup 12 sec latency 33.163 ms 2024-09-19T05:34:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:57 smithi001 ceph-mon[30968]: pgmap v764: 129 pgs: 129 active+clean; 412 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 373 op/s 2024-09-19T05:34:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:57 smithi060 ceph-mon[35058]: pgmap v764: 129 pgs: 129 active+clean; 412 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 373 op/s 2024-09-19T05:34:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:57 smithi082 ceph-mon[35195]: pgmap v764: 129 pgs: 129 active+clean; 412 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 18 MiB/s wr, 373 op/s 2024-09-19T05:34:58.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 6791 41.35 MB/sec warmup 13 sec latency 33.817 ms 2024-09-19T05:34:59.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 7295 41.78 MB/sec warmup 14 sec latency 68.842 ms 2024-09-19T05:34:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:34:59 smithi001 ceph-mon[30968]: pgmap v765: 129 pgs: 129 active+clean; 395 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 328 op/s 2024-09-19T05:35:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:34:59 smithi060 ceph-mon[35058]: pgmap v765: 129 pgs: 129 active+clean; 395 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 328 op/s 2024-09-19T05:35:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:34:59 smithi082 ceph-mon[35195]: pgmap v765: 129 pgs: 129 active+clean; 395 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 328 op/s 2024-09-19T05:35:00.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 7507 39.46 MB/sec warmup 15 sec latency 65.288 ms 2024-09-19T05:35:01.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 7703 37.02 MB/sec warmup 16 sec latency 137.097 ms 2024-09-19T05:35:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:01 smithi001 ceph-mon[30968]: pgmap v766: 129 pgs: 129 active+clean; 398 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 309 op/s 2024-09-19T05:35:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:01 smithi060 ceph-mon[35058]: pgmap v766: 129 pgs: 129 active+clean; 398 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 309 op/s 2024-09-19T05:35:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:01 smithi082 ceph-mon[35195]: pgmap v766: 129 pgs: 129 active+clean; 398 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 18 MiB/s wr, 309 op/s 2024-09-19T05:35:02.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 8002 35.24 MB/sec warmup 17 sec latency 107.159 ms 2024-09-19T05:35:03.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 8663 35.75 MB/sec warmup 18 sec latency 36.786 ms 2024-09-19T05:35:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:03 smithi001 ceph-mon[30968]: pgmap v767: 129 pgs: 129 active+clean; 404 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 317 op/s 2024-09-19T05:35:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:03 smithi060 ceph-mon[35058]: pgmap v767: 129 pgs: 129 active+clean; 404 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 317 op/s 2024-09-19T05:35:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:03 smithi082 ceph-mon[35195]: pgmap v767: 129 pgs: 129 active+clean; 404 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 13 MiB/s wr, 317 op/s 2024-09-19T05:35:04.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 9480 34.80 MB/sec warmup 19 sec latency 104.529 ms 2024-09-19T05:35:05.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 10210 36.11 MB/sec warmup 20 sec latency 28.981 ms 2024-09-19T05:35:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:05 smithi001 ceph-mon[30968]: pgmap v768: 129 pgs: 129 active+clean; 409 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 291 op/s 2024-09-19T05:35:06.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:05 smithi060 ceph-mon[35058]: pgmap v768: 129 pgs: 129 active+clean; 409 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 291 op/s 2024-09-19T05:35:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:05 smithi082 ceph-mon[35195]: pgmap v768: 129 pgs: 129 active+clean; 409 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 291 op/s 2024-09-19T05:35:06.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 10771 36.68 MB/sec warmup 21 sec latency 65.851 ms 2024-09-19T05:35:07.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 11014 35.55 MB/sec warmup 22 sec latency 50.550 ms 2024-09-19T05:35:07.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:07 smithi001 ceph-mon[30968]: pgmap v769: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-09-19T05:35:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:07 smithi060 ceph-mon[35058]: pgmap v769: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-09-19T05:35:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:07 smithi082 ceph-mon[35195]: pgmap v769: 129 pgs: 129 active+clean; 414 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-09-19T05:35:08.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 11206 34.05 MB/sec warmup 23 sec latency 71.041 ms 2024-09-19T05:35:09.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 11495 32.87 MB/sec warmup 24 sec latency 121.518 ms 2024-09-19T05:35:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:09 smithi001 ceph-mon[30968]: pgmap v770: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.8 MiB/s wr, 242 op/s 2024-09-19T05:35:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:09 smithi060 ceph-mon[35058]: pgmap v770: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.8 MiB/s wr, 242 op/s 2024-09-19T05:35:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:09 smithi082 ceph-mon[35195]: pgmap v770: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.8 MiB/s wr, 242 op/s 2024-09-19T05:35:10.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 12070 33.01 MB/sec warmup 25 sec latency 41.267 ms 2024-09-19T05:35:11.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 13019 32.77 MB/sec warmup 26 sec latency 34.647 ms 2024-09-19T05:35:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:11 smithi001 ceph-mon[30968]: pgmap v771: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:35:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:11 smithi060 ceph-mon[35058]: pgmap v771: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:35:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:11 smithi082 ceph-mon[35195]: pgmap v771: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:35:12.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 13712 33.70 MB/sec warmup 27 sec latency 52.653 ms 2024-09-19T05:35:13.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 14336 34.51 MB/sec warmup 28 sec latency 76.167 ms 2024-09-19T05:35:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:13 smithi001 ceph-mon[30968]: pgmap v772: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:35:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:13 smithi060 ceph-mon[35058]: pgmap v772: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:35:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:13 smithi082 ceph-mon[35195]: pgmap v772: 129 pgs: 129 active+clean; 424 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:35:14.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 14549 33.56 MB/sec warmup 29 sec latency 73.078 ms 2024-09-19T05:35:15.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 14734 32.48 MB/sec warmup 30 sec latency 81.947 ms 2024-09-19T05:35:15.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:15 smithi001 ceph-mon[30968]: pgmap v773: 129 pgs: 129 active+clean; 429 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 226 op/s 2024-09-19T05:35:15.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:15 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:35:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:15 smithi060 ceph-mon[35058]: pgmap v773: 129 pgs: 129 active+clean; 429 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 226 op/s 2024-09-19T05:35:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:15 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:35:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:15 smithi082 ceph-mon[35195]: pgmap v773: 129 pgs: 129 active+clean; 429 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 226 op/s 2024-09-19T05:35:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:15 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:35:16.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 15037 31.62 MB/sec warmup 31 sec latency 97.452 ms 2024-09-19T05:35:16.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:35:16.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:35:16.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:35:17.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:35:17.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:35:17.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:35:17.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:35:17.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:35:17.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:35:17.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 15570 31.72 MB/sec warmup 32 sec latency 51.707 ms 2024-09-19T05:35:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:17 smithi060 ceph-mon[35058]: pgmap v774: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-09-19T05:35:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:17 smithi082 ceph-mon[35195]: pgmap v774: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-09-19T05:35:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:17 smithi001 ceph-mon[30968]: pgmap v774: 129 pgs: 129 active+clean; 423 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 225 op/s 2024-09-19T05:35:18.626 INFO:tasks.workunit.client.0.smithi001.stdout: 10 16413 31.51 MB/sec warmup 33 sec latency 50.881 ms 2024-09-19T05:35:19.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 16977 31.83 MB/sec warmup 34 sec latency 158.681 ms 2024-09-19T05:35:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:19 smithi060 ceph-mon[35058]: pgmap v775: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2024-09-19T05:35:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:19 smithi082 ceph-mon[35195]: pgmap v775: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2024-09-19T05:35:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:19 smithi001 ceph-mon[30968]: pgmap v775: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 266 op/s 2024-09-19T05:35:20.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 17575 32.42 MB/sec warmup 35 sec latency 102.288 ms 2024-09-19T05:35:21.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 17974 32.20 MB/sec warmup 36 sec latency 66.013 ms 2024-09-19T05:35:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:21 smithi060 ceph-mon[35058]: pgmap v776: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2024-09-19T05:35:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:21 smithi082 ceph-mon[35195]: pgmap v776: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2024-09-19T05:35:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:21 smithi001 ceph-mon[30968]: pgmap v776: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2024-09-19T05:35:22.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 18193 31.50 MB/sec warmup 37 sec latency 68.344 ms 2024-09-19T05:35:23.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 18368 30.71 MB/sec warmup 38 sec latency 124.263 ms 2024-09-19T05:35:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:23 smithi060 ceph-mon[35058]: pgmap v777: 129 pgs: 129 active+clean; 461 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 302 op/s 2024-09-19T05:35:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:23 smithi082 ceph-mon[35195]: pgmap v777: 129 pgs: 129 active+clean; 461 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 302 op/s 2024-09-19T05:35:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:23 smithi001 ceph-mon[30968]: pgmap v777: 129 pgs: 129 active+clean; 461 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 302 op/s 2024-09-19T05:35:24.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 18612 30.04 MB/sec warmup 39 sec latency 265.726 ms 2024-09-19T05:35:25.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 18956 29.80 MB/sec warmup 40 sec latency 376.020 ms 2024-09-19T05:35:26.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:25 smithi060 ceph-mon[35058]: pgmap v778: 129 pgs: 129 active+clean; 470 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 287 op/s 2024-09-19T05:35:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:25 smithi082 ceph-mon[35195]: pgmap v778: 129 pgs: 129 active+clean; 470 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 287 op/s 2024-09-19T05:35:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:25 smithi001 ceph-mon[30968]: pgmap v778: 129 pgs: 129 active+clean; 470 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.6 MiB/s wr, 287 op/s 2024-09-19T05:35:26.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 19785 29.85 MB/sec warmup 41 sec latency 73.969 ms 2024-09-19T05:35:27.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 20490 30.18 MB/sec warmup 42 sec latency 29.049 ms 2024-09-19T05:35:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:27 smithi060 ceph-mon[35058]: pgmap v779: 129 pgs: 129 active+clean; 484 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.0 MiB/s wr, 327 op/s 2024-09-19T05:35:28.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:27 smithi082 ceph-mon[35195]: pgmap v779: 129 pgs: 129 active+clean; 484 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.0 MiB/s wr, 327 op/s 2024-09-19T05:35:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:27 smithi001 ceph-mon[30968]: pgmap v779: 129 pgs: 129 active+clean; 484 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.0 MiB/s wr, 327 op/s 2024-09-19T05:35:28.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 21152 30.83 MB/sec warmup 43 sec latency 50.694 ms 2024-09-19T05:35:29.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 21537 30.70 MB/sec warmup 44 sec latency 124.956 ms 2024-09-19T05:35:30.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:29 smithi060 ceph-mon[35058]: pgmap v780: 129 pgs: 129 active+clean; 485 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 330 op/s 2024-09-19T05:35:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:29 smithi082 ceph-mon[35195]: pgmap v780: 129 pgs: 129 active+clean; 485 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 330 op/s 2024-09-19T05:35:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:29 smithi001 ceph-mon[30968]: pgmap v780: 129 pgs: 129 active+clean; 485 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.8 MiB/s wr, 330 op/s 2024-09-19T05:35:30.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 21676 30.14 MB/sec warmup 45 sec latency 296.616 ms 2024-09-19T05:35:31.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 21833 29.51 MB/sec warmup 46 sec latency 74.670 ms 2024-09-19T05:35:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:31 smithi060 ceph-mon[35058]: pgmap v781: 129 pgs: 129 active+clean; 492 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 354 op/s 2024-09-19T05:35:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:31 smithi082 ceph-mon[35195]: pgmap v781: 129 pgs: 129 active+clean; 492 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 354 op/s 2024-09-19T05:35:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:31 smithi001 ceph-mon[30968]: pgmap v781: 129 pgs: 129 active+clean; 492 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 354 op/s 2024-09-19T05:35:32.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 22074 28.95 MB/sec warmup 47 sec latency 101.280 ms 2024-09-19T05:35:33.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 22533 28.84 MB/sec warmup 48 sec latency 62.571 ms 2024-09-19T05:35:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:33 smithi082 ceph-mon[35195]: pgmap v782: 129 pgs: 129 active+clean; 490 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 401 op/s 2024-09-19T05:35:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:33 smithi001 ceph-mon[30968]: pgmap v782: 129 pgs: 129 active+clean; 490 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 401 op/s 2024-09-19T05:35:34.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:33 smithi060 ceph-mon[35058]: pgmap v782: 129 pgs: 129 active+clean; 490 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 401 op/s 2024-09-19T05:35:34.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 23355 28.93 MB/sec warmup 49 sec latency 38.654 ms 2024-09-19T05:35:35.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 23791 28.62 MB/sec warmup 50 sec latency 139.943 ms 2024-09-19T05:35:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:35 smithi082 ceph-mon[35195]: pgmap v783: 129 pgs: 129 active+clean; 489 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 355 op/s 2024-09-19T05:35:36.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:35 smithi001 ceph-mon[30968]: pgmap v783: 129 pgs: 129 active+clean; 489 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 355 op/s 2024-09-19T05:35:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:35 smithi060 ceph-mon[35058]: pgmap v783: 129 pgs: 129 active+clean; 489 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 355 op/s 2024-09-19T05:35:36.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 24467 29.21 MB/sec warmup 51 sec latency 75.444 ms 2024-09-19T05:35:37.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 24994 29.55 MB/sec warmup 52 sec latency 65.213 ms 2024-09-19T05:35:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:37 smithi082 ceph-mon[35195]: pgmap v784: 129 pgs: 129 active+clean; 467 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.3 MiB/s wr, 399 op/s 2024-09-19T05:35:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:37 smithi001 ceph-mon[30968]: pgmap v784: 129 pgs: 129 active+clean; 467 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.3 MiB/s wr, 399 op/s 2024-09-19T05:35:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:37 smithi060 ceph-mon[35058]: pgmap v784: 129 pgs: 129 active+clean; 467 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.3 MiB/s wr, 399 op/s 2024-09-19T05:35:38.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 25227 29.19 MB/sec warmup 53 sec latency 69.379 ms 2024-09-19T05:35:39.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 25422 28.68 MB/sec warmup 54 sec latency 171.067 ms 2024-09-19T05:35:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:39 smithi001 ceph-mon[30968]: pgmap v785: 129 pgs: 129 active+clean; 464 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-09-19T05:35:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:39 smithi060 ceph-mon[35058]: pgmap v785: 129 pgs: 129 active+clean; 464 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-09-19T05:35:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:39 smithi082 ceph-mon[35195]: pgmap v785: 129 pgs: 129 active+clean; 464 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-09-19T05:35:40.627 INFO:tasks.workunit.client.0.smithi001.stdout: 10 25611 28.22 MB/sec warmup 55 sec latency 177.596 ms 2024-09-19T05:35:41.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 25993 28.01 MB/sec warmup 56 sec latency 261.088 ms 2024-09-19T05:35:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:41 smithi001 ceph-mon[30968]: pgmap v786: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 402 op/s 2024-09-19T05:35:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:41 smithi060 ceph-mon[35058]: pgmap v786: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 402 op/s 2024-09-19T05:35:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:41 smithi082 ceph-mon[35195]: pgmap v786: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 402 op/s 2024-09-19T05:35:42.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 26787 28.07 MB/sec warmup 57 sec latency 53.774 ms 2024-09-19T05:35:43.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 27522 28.35 MB/sec warmup 58 sec latency 50.788 ms 2024-09-19T05:35:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:43 smithi001 ceph-mon[30968]: pgmap v787: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 349 op/s 2024-09-19T05:35:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:43 smithi060 ceph-mon[35058]: pgmap v787: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 349 op/s 2024-09-19T05:35:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:43 smithi082 ceph-mon[35195]: pgmap v787: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 349 op/s 2024-09-19T05:35:44.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 28248 28.92 MB/sec warmup 59 sec latency 41.134 ms 2024-09-19T05:35:45.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 28500 28.71 MB/sec warmup 60 sec latency 320.484 ms 2024-09-19T05:35:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:45 smithi001 ceph-mon[30968]: pgmap v788: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 299 op/s 2024-09-19T05:35:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:45 smithi060 ceph-mon[35058]: pgmap v788: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 299 op/s 2024-09-19T05:35:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:45 smithi082 ceph-mon[35195]: pgmap v788: 129 pgs: 129 active+clean; 474 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.0 MiB/s wr, 299 op/s 2024-09-19T05:35:46.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 28719 28.46 MB/sec warmup 61 sec latency 84.633 ms 2024-09-19T05:35:47.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 28925 28.05 MB/sec warmup 62 sec latency 116.815 ms 2024-09-19T05:35:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:47 smithi001 ceph-mon[30968]: pgmap v789: 129 pgs: 129 active+clean; 484 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-19T05:35:48.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:47 smithi060 ceph-mon[35058]: pgmap v789: 129 pgs: 129 active+clean; 484 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-19T05:35:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:47 smithi082 ceph-mon[35195]: pgmap v789: 129 pgs: 129 active+clean; 484 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-19T05:35:48.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 29164 27.68 MB/sec warmup 63 sec latency 205.281 ms 2024-09-19T05:35:49.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 29590 27.63 MB/sec warmup 64 sec latency 65.510 ms 2024-09-19T05:35:50.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:49 smithi001 ceph-mon[30968]: pgmap v790: 129 pgs: 129 active+clean; 491 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.4 MiB/s wr, 390 op/s 2024-09-19T05:35:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:49 smithi060 ceph-mon[35058]: pgmap v790: 129 pgs: 129 active+clean; 491 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.4 MiB/s wr, 390 op/s 2024-09-19T05:35:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:49 smithi082 ceph-mon[35195]: pgmap v790: 129 pgs: 129 active+clean; 491 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 7.4 MiB/s wr, 390 op/s 2024-09-19T05:35:50.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 29873 27.34 MB/sec warmup 65 sec latency 220.110 ms 2024-09-19T05:35:51.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 30586 27.32 MB/sec warmup 66 sec latency 118.978 ms 2024-09-19T05:35:52.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:51 smithi001 ceph-mon[30968]: pgmap v791: 129 pgs: 129 active+clean; 478 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.1 MiB/s wr, 346 op/s 2024-09-19T05:35:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:51 smithi060 ceph-mon[35058]: pgmap v791: 129 pgs: 129 active+clean; 478 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.1 MiB/s wr, 346 op/s 2024-09-19T05:35:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:51 smithi082 ceph-mon[35195]: pgmap v791: 129 pgs: 129 active+clean; 478 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.1 MiB/s wr, 346 op/s 2024-09-19T05:35:52.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 31319 27.69 MB/sec warmup 67 sec latency 57.471 ms 2024-09-19T05:35:53.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 31861 27.94 MB/sec warmup 68 sec latency 72.107 ms 2024-09-19T05:35:54.053 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:53 smithi060 ceph-mon[35058]: pgmap v792: 129 pgs: 129 active+clean; 475 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-19T05:35:54.059 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:53 smithi082 ceph-mon[35195]: pgmap v792: 129 pgs: 129 active+clean; 475 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-19T05:35:54.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:53 smithi001 ceph-mon[30968]: pgmap v792: 129 pgs: 129 active+clean; 475 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.4 MiB/s wr, 365 op/s 2024-09-19T05:35:54.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 32196 27.87 MB/sec warmup 69 sec latency 66.844 ms 2024-09-19T05:35:55.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 32399 27.56 MB/sec warmup 70 sec latency 149.092 ms 2024-09-19T05:35:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:55 smithi001 ceph-mon[30968]: pgmap v793: 129 pgs: 129 active+clean; 469 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.3 MiB/s wr, 356 op/s 2024-09-19T05:35:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:55 smithi060 ceph-mon[35058]: pgmap v793: 129 pgs: 129 active+clean; 469 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.3 MiB/s wr, 356 op/s 2024-09-19T05:35:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:55 smithi082 ceph-mon[35195]: pgmap v793: 129 pgs: 129 active+clean; 469 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.3 MiB/s wr, 356 op/s 2024-09-19T05:35:56.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 32607 27.23 MB/sec warmup 71 sec latency 131.341 ms 2024-09-19T05:35:57.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 32996 27.11 MB/sec warmup 72 sec latency 70.505 ms 2024-09-19T05:35:58.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:57 smithi001 ceph-mon[30968]: pgmap v794: 129 pgs: 129 active+clean; 466 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 7.3 MiB/s wr, 422 op/s 2024-09-19T05:35:58.253 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:57 smithi060 ceph-mon[35058]: pgmap v794: 129 pgs: 129 active+clean; 466 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 7.3 MiB/s wr, 422 op/s 2024-09-19T05:35:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:57 smithi082 ceph-mon[35195]: pgmap v794: 129 pgs: 129 active+clean; 466 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 7.3 MiB/s wr, 422 op/s 2024-09-19T05:35:58.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 33655 27.09 MB/sec warmup 73 sec latency 101.610 ms 2024-09-19T05:35:59.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 34376 27.19 MB/sec warmup 74 sec latency 65.571 ms 2024-09-19T05:36:00.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:35:59 smithi001 ceph-mon[30968]: pgmap v795: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 382 op/s 2024-09-19T05:36:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:35:59 smithi060 ceph-mon[35058]: pgmap v795: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 382 op/s 2024-09-19T05:36:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:35:59 smithi082 ceph-mon[35195]: pgmap v795: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 382 op/s 2024-09-19T05:36:00.354 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:36:00.354 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T05:36:00.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:36:00.628 INFO:tasks.workunit.client.0.smithi001.stdout: 10 34859 27.38 MB/sec warmup 75 sec latency 395.598 ms 2024-09-19T05:36:00.742 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:01.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35342 27.49 MB/sec warmup 76 sec latency 491.696 ms 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 -- 172.21.15.1:0/303707811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70102790 msgr2=0x7fbb701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/303707811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70102790 0x7fbb701067e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009900 tx=0x7fbb6002a410 comp rx=0 tx=0).stop 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 -- 172.21.15.1:0/303707811 shutdown_connections 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/303707811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70106f10 0x7fbb7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/303707811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70102790 0x7fbb701067e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/303707811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70101de0 0x7fbb701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:01.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 -- 172.21.15.1:0/303707811 >> 172.21.15.1:0/303707811 conn(0x7fbb700fd8c0 msgr2=0x7fbb700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 -- 172.21.15.1:0/303707811 shutdown_connections 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.646+0000 7fbb76ed3640 1 -- 172.21.15.1:0/303707811 wait complete. 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 Processor -- start 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 -- start start 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70102790 0x7fbb70074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70106f10 0x7fbb70074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70111f30 con 0x7fbb70101de0 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70111db0 con 0x7fbb70106f10 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb76ed3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701120b0 con 0x7fbb70102790 2024-09-19T05:36:01.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37132/0 (socket says 172.21.15.1:37132) 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 -- 172.21.15.1:0/1777579670 learned_addr learned my addr 172.21.15.1:0/1777579670 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb75470640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70106f10 0x7fbb70074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb67fff640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70102790 0x7fbb70074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 -- 172.21.15.1:0/1777579670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70102790 msgr2=0x7fbb70074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70102790 0x7fbb70074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 -- 172.21.15.1:0/1777579670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70106f10 msgr2=0x7fbb70074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70106f10 0x7fbb70074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.647+0000 7fbb74c6f640 1 -- 172.21.15.1:0/1777579670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb701a6900 con 0x7fbb70101de0 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb74c6f640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00ea60 tx=0x7fbb6c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:01.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00cde0 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb701a6bf0 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb6c0035f0 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c010670 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.648+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701a7150 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.649+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb701021c0 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.650+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbb6c0037a0 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.651+0000 7fbb65ffb640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.651+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbb6c0cff70 con 0x7fbb70101de0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.651+0000 7fbb67fff640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.651+0000 7fbb67fff640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 0x7fbb580a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009230 tx=0x7fbb600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:01.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:01.655+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb6c09c8e0 con 0x7fbb70101de0 2024-09-19T05:36:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:01 smithi001 ceph-mon[30968]: pgmap v796: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 305 op/s 2024-09-19T05:36:02.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.022+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb7010a150 con 0x7fbb70101de0 2024-09-19T05:36:02.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.024+0000 7fbb65ffb640 1 -- 172.21.15.1:0/1777579670 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fbb6c0bae20 con 0x7fbb70101de0 2024-09-19T05:36:02.026 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:36:02.026 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:36:02.026 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:36:02.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.028+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 msgr2=0x7fbb580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:02.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.028+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 0x7fbb580a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009230 tx=0x7fbb600058d0 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.028+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 msgr2=0x7fbb700744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.028+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00ea60 tx=0x7fbb6c00ef20 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 shutdown_connections 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb70106f10 0x7fbb70074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb70102790 0x7fbb70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 --2- 172.21.15.1:0/1777579670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb70101de0 0x7fbb700744f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 >> 172.21.15.1:0/1777579670 conn(0x7fbb700fd8c0 msgr2=0x7fbb700fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 shutdown_connections 2024-09-19T05:36:02.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:02.029+0000 7fbb76ed3640 1 -- 172.21.15.1:0/1777579670 wait complete. 2024-09-19T05:36:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:01 smithi060 ceph-mon[35058]: pgmap v796: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 305 op/s 2024-09-19T05:36:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:01 smithi082 ceph-mon[35195]: pgmap v796: 129 pgs: 129 active+clean; 468 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 305 op/s 2024-09-19T05:36:02.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35637 27.36 MB/sec warmup 77 sec latency 82.844 ms 2024-09-19T05:36:02.980 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T05:36:02.980 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T05:36:03.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:02 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1777579670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:03.246 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:03.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:02 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1777579670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:03.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:02 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1777579670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:03.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35893 27.18 MB/sec warmup 78 sec latency 100.062 ms 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 -- 172.21.15.1:0/3944028779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874102d90 msgr2=0x7f6874103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 --2- 172.21.15.1:0/3944028779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874102d90 0x7f6874103170 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6864009930 tx=0x7f686402a420 comp rx=0 tx=0).stop 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 -- 172.21.15.1:0/3944028779 shutdown_connections 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 --2- 172.21.15.1:0/3944028779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874108290 0x7f687410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 --2- 172.21.15.1:0/3944028779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 --2- 172.21.15.1:0/3944028779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874102d90 0x7f6874103170 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 -- 172.21.15.1:0/3944028779 >> 172.21.15.1:0/3944028779 conn(0x7f68740fc7d0 msgr2=0x7f68740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 -- 172.21.15.1:0/3944028779 shutdown_connections 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.776+0000 7f6878c5c640 1 -- 172.21.15.1:0/3944028779 wait complete. 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 Processor -- start 2024-09-19T05:36:03.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 -- start start 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874102d90 0x7f6874198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874108290 0x7f687419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6874112090 con 0x7f6874108290 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111f10 con 0x7f6874102d90 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6878c5c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6874112210 con 0x7f6874103740 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f687259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874102d90 0x7f6874198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:35202/0 (socket says 172.21.15.1:35202) 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 -- 172.21.15.1:0/2176563256 learned_addr learned my addr 172.21.15.1:0/2176563256 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f6872d9d640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874108290 0x7f687419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 -- 172.21.15.1:0/2176563256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874102d90 msgr2=0x7f6874198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874102d90 0x7f6874198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 -- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874108290 msgr2=0x7f687419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874108290 0x7f687419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.777+0000 7f686bfff640 1 -- 172.21.15.1:0/2176563256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687419d600 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f686bfff640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f685c00e9f0 tx=0x7f685c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f686b7fe640 1 -- 172.21.15.1:0/2176563256 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c00ccc0 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687419d8f0 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f686b7fe640 1 -- 172.21.15.1:0/2176563256 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f685c005500 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f686b7fe640 1 -- 172.21.15.1:0/2176563256 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c010690 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.778+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68741a51d0 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f686b7fe640 1 -- 172.21.15.1:0/2176563256 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f685c0046c0 con 0x7f6874103740 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 Processor -- start 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 -- start start 2024-09-19T05:36:03.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 0x56501a709b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a71b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.781+0000 7f687b035740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56501a66e160 con 0x56501a718e40 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687b035740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56501a615720 con 0x56501a709750 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687b035740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56501a66a120 con 0x56501a70a070 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f6872d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 0x56501a709b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f6872d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 0x56501a709b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:53866/0 (socket says 172.21.15.1:53866) 2024-09-19T05:36:03.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:35210/0 (socket says 172.21.15.1:35210) 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f6872d9d640 1 -- 172.21.15.1:0/846062982 learned_addr learned my addr 172.21.15.1:0/846062982 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f686bfff640 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a71b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f686b7fe640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 -- 172.21.15.1:0/846062982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 msgr2=0x56501a709b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 0x56501a709b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 -- 172.21.15.1:0/846062982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 msgr2=0x56501a71b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a71b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 -- 172.21.15.1:0/846062982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501a3dfba0 con 0x56501a70a070 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f6872d9d640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f686b7fe640 1 -- 172.21.15.1:0/2176563256 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f685c0d0050 con 0x7f6874103740 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.782+0000 7f687259c640 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6864005940 tx=0x7f6864005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3d326e887f4fe5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f6868ff9640 1 -- 172.21.15.1:0/846062982 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864040070 con 0x56501a70a070 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f6868ff9640 1 -- 172.21.15.1:0/846062982 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6864031870 con 0x56501a70a070 2024-09-19T05:36:03.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f6868ff9640 1 -- 172.21.15.1:0/846062982 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864035040 con 0x56501a70a070 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 -- 172.21.15.1:0/846062982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 msgr2=0x56501a718900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f6872d9d640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f686c010610 tx=0x7f686c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6864005940 tx=0x7f6864005bd0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 -- 172.21.15.1:0/846062982 shutdown_connections 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a71b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a718900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 --2- 172.21.15.1:0/846062982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a709750 0x56501a709b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.783+0000 7f687b035740 1 -- 172.21.15.1:0/846062982 >> 172.21.15.1:0/846062982 conn(0x56501a705de0 msgr2=0x56501a7061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- 172.21.15.1:0/846062982 shutdown_connections 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- 172.21.15.1:0/846062982 wait complete. 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- start start 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 Processor -- start 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a716260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a718e40 0x56501a7167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56501a71ba10 con 0x56501a709750 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56501a5f6900 con 0x56501a70a070 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56501a71bb90 con 0x56501a718e40 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687b035740 10 client.0 _ll_register_callbacks cb 0x56501a5f4780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37178/0 (socket says 172.21.15.1:37178) 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f687259c640 1 -- 172.21.15.1:0/2911548198 learned_addr learned my addr 172.21.15.1:0/2911548198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f686bfff640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a716260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.784+0000 7f6872d9d640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a718e40 0x56501a7167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 -- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a718e40 msgr2=0x56501a7167a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a718e40 0x56501a7167a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 -- 172.21.15.1:0/2911548198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 msgr2=0x56501a716260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a716260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 -- 172.21.15.1:0/2911548198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56501a636c50 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687259c640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6864009a50 tx=0x7f6864005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb069f82f38df87e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f6859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864040070 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6864031670 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6864031870 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6864056050 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687b035740 10 client.15792 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56501a727700 con 0x56501a709750 2024-09-19T05:36:03.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.785+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6864031870 con 0x56501a709750 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6864004340 con 0x56501a709750 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 10 client.15792 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 10 client.15792 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 20 client.15792 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a728a50 0x56501a72ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 4 client.15792 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56501a67b890 con 0x56501a728a50 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f686bfff640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a728a50 0x56501a72ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f686bfff640 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a728a50 0x56501a72ae40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d80aac9fed162f server_cookie=87996353b02cc745 in_seq=0 out_seq=0 2024-09-19T05:36:03.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.786+0000 7f6859ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:03.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f6859ffb640 1 -- 172.21.15.1:0/2911548198 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56501a67b890 con 0x56501a728a50 2024-09-19T05:36:03.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f6859ffb640 10 client.15792 handle_command_reply: tid=0 2024-09-19T05:36:03.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 client.15792 shutdown 2024-09-19T05:36:03.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 msgr2=0x56501a715d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6864009a50 tx=0x7f6864005250 comp rx=0 tx=0).stop 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 shutdown_connections 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a728a50 0x56501a72ae40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a718e40 0x56501a7167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a716260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 --2- 172.21.15.1:0/2911548198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a715d20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f6859ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 >> 172.21.15.1:0/2911548198 conn(0x56501a705de0 msgr2=0x56501a70bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 shutdown_connections 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 1 -- 172.21.15.1:0/2911548198 wait complete. 2024-09-19T05:36:03.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.791+0000 7f687b035740 20 client.15792 trim_cache size 0 max 16384 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 Processor -- start 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 -- start start 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a709750 0x56501a7145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a7303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68741aab60 con 0x56501a718e40 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ad3e0 con 0x56501a70a070 2024-09-19T05:36:03.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687b035740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ab1d0 con 0x56501a709750 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f6872d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f6872d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37190/0 (socket says 172.21.15.1:37190) 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f6872d9d640 1 -- 172.21.15.1:0/1937198976 learned_addr learned my addr 172.21.15.1:0/1937198976 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f687259c640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a709750 0x56501a7145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.810+0000 7f686bfff640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a7303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 -- 172.21.15.1:0/1937198976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a709750 msgr2=0x56501a7145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a709750 0x56501a7145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 -- 172.21.15.1:0/1937198976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 msgr2=0x56501a7303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a7303e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 -- 172.21.15.1:0/1937198976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501a718690 con 0x56501a718e40 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f686bfff640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a7303e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f6872d9d640 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f686c00f920 tx=0x7f686c013030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e091d2f4091d8f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f685bfff640 1 -- 172.21.15.1:0/1937198976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c004b20 con 0x56501a718e40 2024-09-19T05:36:03.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f685bfff640 1 -- 172.21.15.1:0/1937198976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686c004cc0 con 0x56501a718e40 2024-09-19T05:36:03.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.811+0000 7f685bfff640 1 -- 172.21.15.1:0/1937198976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c0057b0 con 0x56501a718e40 2024-09-19T05:36:03.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- 172.21.15.1:0/1937198976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 msgr2=0x56501a730920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:03.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f686c00f920 tx=0x7f686c013030 comp rx=0 tx=0).stop 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- 172.21.15.1:0/1937198976 shutdown_connections 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a718e40 0x56501a730920 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a70a070 0x56501a7303e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 --2- 172.21.15.1:0/1937198976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a709750 0x56501a7145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- 172.21.15.1:0/1937198976 >> 172.21.15.1:0/1937198976 conn(0x56501a705de0 msgr2=0x56501a717da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- 172.21.15.1:0/1937198976 shutdown_connections 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- 172.21.15.1:0/1937198976 wait complete. 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 -- start start 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.812+0000 7f687b035740 1 Processor -- start 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a71d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a718e40 0x56501a7923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ab8a0 con 0x56501a709750 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68741acd10 con 0x56501a718e40 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68741abf70 con 0x56501a70a070 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 10 client.0 _ll_register_callbacks cb 0x7f685c0d3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37196/0 (socket says 172.21.15.1:37196) 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 -- 172.21.15.1:0/224862802 learned_addr learned my addr 172.21.15.1:0/224862802 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f686bfff640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a71d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f6872d9d640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a718e40 0x56501a7923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 -- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 msgr2=0x56501a71d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a71d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 -- 172.21.15.1:0/224862802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a718e40 msgr2=0x56501a7923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a718e40 0x56501a7923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 -- 172.21.15.1:0/224862802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56501a7928f0 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687259c640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6864009a20 tx=0x7f6864005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1caeac61ad23e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f6859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864040070 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686c004cc0 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.813+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6864003c60 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6864067050 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 10 client.15798 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56501a793a70 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686c004cc0 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6864062030 con 0x56501a709750 2024-09-19T05:36:03.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 10 client.15798 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 10 client.15798 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 20 client.15798 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a794280 0x56501a7966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 4 client.15798 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x56501a675be0 con 0x56501a794280 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.814+0000 7f686bfff640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a794280 0x56501a7966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.815+0000 7f6859ffb640 10 client.15798 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:03.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:03.815+0000 7f686bfff640 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a794280 0x56501a7966a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958f9ba8382c9d2a server_cookie=a9cccb0e611dd90e in_seq=0 out_seq=0 2024-09-19T05:36:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:03 smithi001 ceph-mon[30968]: pgmap v797: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.2 MiB/s wr, 374 op/s 2024-09-19T05:36:04.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:03 smithi060 ceph-mon[35058]: pgmap v797: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.2 MiB/s wr, 374 op/s 2024-09-19T05:36:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:03 smithi082 ceph-mon[35195]: pgmap v797: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.2 MiB/s wr, 374 op/s 2024-09-19T05:36:04.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35927 26.83 MB/sec warmup 79 sec latency 817.133 ms 2024-09-19T05:36:04.809 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 50, 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "3bfdf922": { 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 50, 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:04.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.4, 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:04.811 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:36:04.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f6859ffb640 1 -- 172.21.15.1:0/224862802 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56501a675be0 con 0x56501a794280 2024-09-19T05:36:04.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f6859ffb640 10 client.15798 handle_command_reply: tid=0 2024-09-19T05:36:04.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 client.15798 shutdown 2024-09-19T05:36:04.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 msgr2=0x56501a71cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6864009a20 tx=0x7f6864005700 comp rx=0 tx=0).stop 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 shutdown_connections 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56501a718e40 0x56501a7923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x56501a794280 0x56501a7966a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56501a70a070 0x56501a71d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 --2- 172.21.15.1:0/224862802 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56501a709750 0x56501a71cf70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f6859ffb640 0 client.15798 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 >> 172.21.15.1:0/224862802 conn(0x56501a705de0 msgr2=0x56501a70b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 shutdown_connections 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 1 -- 172.21.15.1:0/224862802 wait complete. 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.807+0000 7f687b035740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 msgr2=0x7f68600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:04.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f686c010610 tx=0x7f686c004a40 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 msgr2=0x7f6874198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f685c00e9f0 tx=0x7f685c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 shutdown_connections 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6874108290 0x7f687419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6874103740 0x7f6874198b90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 --2- 172.21.15.1:0/2176563256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6874102d90 0x7f6874198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 >> 172.21.15.1:0/2176563256 conn(0x7f68740fc7d0 msgr2=0x7f6874105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 shutdown_connections 2024-09-19T05:36:04.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:04.808+0000 7f6878c5c640 1 -- 172.21.15.1:0/2176563256 wait complete. 2024-09-19T05:36:05.569 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3bfdf922', quiesce took 5.2 seconds. Will release after: 24.25 2024-09-19T05:36:05.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 26.50 MB/sec warmup 80 sec latency 1815.680 ms 2024-09-19T05:36:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:05 smithi001 ceph-mon[30968]: pgmap v798: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 311 op/s 2024-09-19T05:36:06.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:05 smithi060 ceph-mon[35058]: pgmap v798: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 311 op/s 2024-09-19T05:36:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:05 smithi082 ceph-mon[35195]: pgmap v798: 129 pgs: 129 active+clean; 489 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.3 MiB/s wr, 311 op/s 2024-09-19T05:36:06.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 26.17 MB/sec warmup 81 sec latency 2815.767 ms 2024-09-19T05:36:07.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 25.85 MB/sec warmup 82 sec latency 3815.843 ms 2024-09-19T05:36:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:07 smithi001 ceph-mon[30968]: pgmap v799: 129 pgs: 129 active+clean; 488 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.7 MiB/s wr, 352 op/s 2024-09-19T05:36:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:07 smithi060 ceph-mon[35058]: pgmap v799: 129 pgs: 129 active+clean; 488 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.7 MiB/s wr, 352 op/s 2024-09-19T05:36:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:07 smithi082 ceph-mon[35195]: pgmap v799: 129 pgs: 129 active+clean; 488 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.7 MiB/s wr, 352 op/s 2024-09-19T05:36:08.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 25.54 MB/sec warmup 83 sec latency 4815.884 ms 2024-09-19T05:36:09.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 25.24 MB/sec warmup 84 sec latency 5815.950 ms 2024-09-19T05:36:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:09 smithi001 ceph-mon[30968]: pgmap v800: 129 pgs: 129 active+clean; 482 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.8 MiB/s wr, 342 op/s 2024-09-19T05:36:10.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:09 smithi060 ceph-mon[35058]: pgmap v800: 129 pgs: 129 active+clean; 482 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.8 MiB/s wr, 342 op/s 2024-09-19T05:36:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:09 smithi082 ceph-mon[35195]: pgmap v800: 129 pgs: 129 active+clean; 482 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.8 MiB/s wr, 342 op/s 2024-09-19T05:36:10.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 24.94 MB/sec warmup 85 sec latency 6816.027 ms 2024-09-19T05:36:11.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 24.65 MB/sec warmup 86 sec latency 7816.102 ms 2024-09-19T05:36:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:11 smithi001 ceph-mon[30968]: pgmap v801: 129 pgs: 129 active+clean; 469 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2024-09-19T05:36:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:11 smithi060 ceph-mon[35058]: pgmap v801: 129 pgs: 129 active+clean; 469 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2024-09-19T05:36:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:11 smithi082 ceph-mon[35195]: pgmap v801: 129 pgs: 129 active+clean; 469 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.6 MiB/s wr, 286 op/s 2024-09-19T05:36:12.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 24.37 MB/sec warmup 87 sec latency 8816.211 ms 2024-09-19T05:36:13.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 24.09 MB/sec warmup 88 sec latency 9816.252 ms 2024-09-19T05:36:14.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:13 smithi001 ceph-mon[30968]: pgmap v802: 129 pgs: 129 active+clean; 464 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 310 op/s 2024-09-19T05:36:14.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:13 smithi060 ceph-mon[35058]: pgmap v802: 129 pgs: 129 active+clean; 464 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 310 op/s 2024-09-19T05:36:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:13 smithi082 ceph-mon[35195]: pgmap v802: 129 pgs: 129 active+clean; 464 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.5 MiB/s wr, 310 op/s 2024-09-19T05:36:14.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 23.82 MB/sec warmup 89 sec latency 10816.298 ms 2024-09-19T05:36:15.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 23.55 MB/sec warmup 90 sec latency 11816.341 ms 2024-09-19T05:36:16.079 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:15 smithi001 ceph-mon[30968]: pgmap v803: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 222 op/s 2024-09-19T05:36:16.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:15 smithi060 ceph-mon[35058]: pgmap v803: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 222 op/s 2024-09-19T05:36:16.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:15 smithi082 ceph-mon[35195]: pgmap v803: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 222 op/s 2024-09-19T05:36:16.629 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 23.30 MB/sec warmup 91 sec latency 12816.388 ms 2024-09-19T05:36:17.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:36:17.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:36:17.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:36:17.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:36:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:36:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:36:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:36:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:36:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:36:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:36:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:36:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:36:17.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 23.04 MB/sec warmup 92 sec latency 13816.517 ms 2024-09-19T05:36:18.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:17 smithi001 ceph-mon[30968]: pgmap v804: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-09-19T05:36:18.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:17 smithi060 ceph-mon[35058]: pgmap v804: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-09-19T05:36:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:17 smithi082 ceph-mon[35195]: pgmap v804: 129 pgs: 129 active+clean; 470 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 221 op/s 2024-09-19T05:36:18.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 22.80 MB/sec warmup 93 sec latency 14816.553 ms 2024-09-19T05:36:19.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 22.55 MB/sec warmup 94 sec latency 15816.644 ms 2024-09-19T05:36:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:19 smithi001 ceph-mon[30968]: pgmap v805: 129 pgs: 129 active+clean; 460 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 4.1 MiB/s wr, 178 op/s 2024-09-19T05:36:20.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:19 smithi060 ceph-mon[35058]: pgmap v805: 129 pgs: 129 active+clean; 460 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 4.1 MiB/s wr, 178 op/s 2024-09-19T05:36:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:19 smithi082 ceph-mon[35195]: pgmap v805: 129 pgs: 129 active+clean; 460 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 4.1 MiB/s wr, 178 op/s 2024-09-19T05:36:20.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 22.32 MB/sec warmup 95 sec latency 16816.739 ms 2024-09-19T05:36:21.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 22.08 MB/sec warmup 96 sec latency 17816.794 ms 2024-09-19T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:21 smithi001 ceph-mon[30968]: pgmap v806: 129 pgs: 129 active+clean; 459 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.1 MiB/s wr, 121 op/s 2024-09-19T05:36:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:21 smithi060 ceph-mon[35058]: pgmap v806: 129 pgs: 129 active+clean; 459 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.1 MiB/s wr, 121 op/s 2024-09-19T05:36:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:21 smithi082 ceph-mon[35195]: pgmap v806: 129 pgs: 129 active+clean; 459 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.1 MiB/s wr, 121 op/s 2024-09-19T05:36:22.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 21.85 MB/sec warmup 97 sec latency 18816.889 ms 2024-09-19T05:36:23.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 21.63 MB/sec warmup 98 sec latency 19816.963 ms 2024-09-19T05:36:24.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:23 smithi001 ceph-mon[30968]: pgmap v807: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.4 MiB/s wr, 153 op/s 2024-09-19T05:36:24.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:23 smithi060 ceph-mon[35058]: pgmap v807: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.4 MiB/s wr, 153 op/s 2024-09-19T05:36:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:23 smithi082 ceph-mon[35195]: pgmap v807: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 4.4 MiB/s wr, 153 op/s 2024-09-19T05:36:24.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 21.41 MB/sec warmup 99 sec latency 20817.055 ms 2024-09-19T05:36:25.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 21.20 MB/sec warmup 100 sec latency 21817.190 ms 2024-09-19T05:36:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:25 smithi001 ceph-mon[30968]: pgmap v808: 129 pgs: 129 active+clean; 445 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 3.3 MiB/s wr, 131 op/s 2024-09-19T05:36:26.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:25 smithi060 ceph-mon[35058]: pgmap v808: 129 pgs: 129 active+clean; 445 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 3.3 MiB/s wr, 131 op/s 2024-09-19T05:36:26.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:25 smithi082 ceph-mon[35195]: pgmap v808: 129 pgs: 129 active+clean; 445 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 3.3 MiB/s wr, 131 op/s 2024-09-19T05:36:26.630 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.99 MB/sec warmup 101 sec latency 22817.312 ms 2024-09-19T05:36:27.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.78 MB/sec warmup 102 sec latency 23817.436 ms 2024-09-19T05:36:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:27 smithi001 ceph-mon[30968]: pgmap v809: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2024-09-19T05:36:28.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:27 smithi060 ceph-mon[35058]: pgmap v809: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2024-09-19T05:36:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:27 smithi082 ceph-mon[35195]: pgmap v809: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2024-09-19T05:36:28.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.58 MB/sec warmup 103 sec latency 24817.493 ms 2024-09-19T05:36:29.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.38 MB/sec warmup 104 sec latency 25817.610 ms 2024-09-19T05:36:29.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:36:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:29 smithi001 ceph-mon[30968]: pgmap v810: 129 pgs: 129 active+clean; 457 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-19T05:36:30.096 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:30.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:29 smithi060 ceph-mon[35058]: pgmap v810: 129 pgs: 129 active+clean; 457 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-19T05:36:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:29 smithi082 ceph-mon[35195]: pgmap v810: 129 pgs: 129 active+clean; 457 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.3 MiB/s wr, 134 op/s 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.579+0000 7fe6a4502640 1 -- 172.21.15.1:0/2079245078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 msgr2=0x7fe69c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.579+0000 7fe6a4502640 1 --2- 172.21.15.1:0/2079245078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c10d950 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe694009cd0 tx=0x7fe69402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 -- 172.21.15.1:0/2079245078 shutdown_connections 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 --2- 172.21.15.1:0/2079245078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c10d950 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 --2- 172.21.15.1:0/2079245078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c100a80 0x7fe69c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 --2- 172.21.15.1:0/2079245078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c106a80 0x7fe69c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 -- 172.21.15.1:0/2079245078 >> 172.21.15.1:0/2079245078 conn(0x7fe69c0fc7a0 msgr2=0x7fe69c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:30.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 -- 172.21.15.1:0/2079245078 shutdown_connections 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 -- 172.21.15.1:0/2079245078 wait complete. 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 Processor -- start 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.580+0000 7fe6a4502640 1 -- start start 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c100a80 0x7fe69c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 0x7fe69c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c110ea0 con 0x7fe69c101420 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c110d20 con 0x7fe69c106a80 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c111020 con 0x7fe69c100a80 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56546/0 (socket says 172.21.15.1:56546) 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 -- 172.21.15.1:0/3378885888 learned_addr learned my addr 172.21.15.1:0/3378885888 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a2a9f640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 0x7fe69c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 -- 172.21.15.1:0/3378885888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c100a80 msgr2=0x7fe69c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a229e640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c100a80 0x7fe69c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c100a80 0x7fe69c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 -- 172.21.15.1:0/3378885888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 msgr2=0x7fe69c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 0x7fe69c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 -- 172.21.15.1:0/3378885888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c19d3a0 con 0x7fe69c101420 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a2a9f640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 0x7fe69c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a1a9d640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d950 tx=0x7fe68c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c017070 con 0x7fe69c101420 2024-09-19T05:36:30.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe68c009c30 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69c19d690 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00f6b0 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.581+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69c1a4f70 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.583+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69c100ee0 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.584+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe68c0109d0 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.584+0000 7fe6937fe640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 0x7fe6880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.584+0000 7fe6a229e640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 0x7fe6880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.584+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe68c0cf960 con 0x7fe69c101420 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.585+0000 7fe6a229e640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 0x7fe6880a5780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a810 tx=0x7fe698008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:30.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.589+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe68c009de0 con 0x7fe69c101420 2024-09-19T05:36:30.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.19 MB/sec warmup 105 sec latency 26817.663 ms 2024-09-19T05:36:30.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.801+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe69c1a5200 con 0x7fe69c101420 2024-09-19T05:36:30.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.801+0000 7fe6937fe640 1 -- 172.21.15.1:0/3378885888 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fe68c09c2d0 con 0x7fe69c101420 2024-09-19T05:36:30.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:36:30.803 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:36:30.804 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:36:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 msgr2=0x7fe6880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 0x7fe6880a5780 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe69800a810 tx=0x7fe698008040 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 msgr2=0x7fe69c198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d950 tx=0x7fe68c00de10 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 shutdown_connections 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe6880a32c0 0x7fe6880a5780 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69c106a80 0x7fe69c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe69c101420 0x7fe69c198930 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 --2- 172.21.15.1:0/3378885888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe69c100a80 0x7fe69c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.803+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 >> 172.21.15.1:0/3378885888 conn(0x7fe69c0fc7a0 msgr2=0x7fe69c06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.804+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 shutdown_connections 2024-09-19T05:36:30.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:30.804+0000 7fe6a4502640 1 -- 172.21.15.1:0/3378885888 wait complete. 2024-09-19T05:36:31.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:30 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3378885888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:31.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:30 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3378885888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:31.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:30 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3378885888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:31.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 20.00 MB/sec warmup 106 sec latency 27817.733 ms 2024-09-19T05:36:31.825 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 3bfdf922 --release --await' 2024-09-19T05:36:31.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 3bfdf922 --release --await 2024-09-19T05:36:32.083 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:31 smithi001 ceph-mon[30968]: pgmap v811: 129 pgs: 129 active+clean; 458 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2024-09-19T05:36:32.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:31 smithi060 ceph-mon[35058]: pgmap v811: 129 pgs: 129 active+clean; 458 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2024-09-19T05:36:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:31 smithi082 ceph-mon[35195]: pgmap v811: 129 pgs: 129 active+clean; 458 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 2.6 MiB/s wr, 108 op/s 2024-09-19T05:36:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- 172.21.15.1:0/3385318012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 msgr2=0x7f5584100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 --2- 172.21.15.1:0/3385318012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 0x7f5584100ee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5578009930 tx=0x7f557802a420 comp rx=0 tx=0).stop 2024-09-19T05:36:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- 172.21.15.1:0/3385318012 shutdown_connections 2024-09-19T05:36:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 --2- 172.21.15.1:0/3385318012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584101420 0x7f558410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 --2- 172.21.15.1:0/3385318012 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584100a80 0x7f5584100ee0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 --2- 172.21.15.1:0/3385318012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 0x7f5584106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- 172.21.15.1:0/3385318012 >> 172.21.15.1:0/3385318012 conn(0x7f55840fc7a0 msgr2=0x7f55840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- 172.21.15.1:0/3385318012 shutdown_connections 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- 172.21.15.1:0/3385318012 wait complete. 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 Processor -- start 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.597+0000 7f5589876640 1 -- start start 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 0x7f55841973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 0x7f558419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5584110ea0 con 0x7f5584101420 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5584110d20 con 0x7f5584100a80 2024-09-19T05:36:32.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5589876640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5584111020 con 0x7f5584106a80 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56566/0 (socket says 172.21.15.1:56566) 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 -- 172.21.15.1:0/1934178625 learned_addr learned my addr 172.21.15.1:0/1934178625 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55837fe640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 0x7f558419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5582ffd640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 0x7f55841973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 -- 172.21.15.1:0/1934178625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 msgr2=0x7f558419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 0x7f558419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 -- 172.21.15.1:0/1934178625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 msgr2=0x7f55841973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 0x7f55841973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 -- 172.21.15.1:0/1934178625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558419c390 con 0x7f5584101420 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f5582ffd640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 0x7f55841973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.598+0000 7f55827fc640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5578009a50 tx=0x7f5578004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.599+0000 7f5588874640 1 -- 172.21.15.1:0/1934178625 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557803f030 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.599+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558419c620 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.599+0000 7f5588874640 1 -- 172.21.15.1:0/1934178625 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5578003ce0 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.599+0000 7f5588874640 1 -- 172.21.15.1:0/1934178625 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578035070 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.599+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55841a3f60 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.601+0000 7f5588874640 1 -- 172.21.15.1:0/1934178625 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5578042030 con 0x7f5584101420 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.601+0000 7f558bc4f740 1 Processor -- start 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.601+0000 7f558bc4f740 1 -- start start 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db28870650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db2887d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db287d3620 con 0x55db28870b90 2024-09-19T05:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55db2877ae50 con 0x55db28870270 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f558bc4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55db287cf5e0 con 0x55db2887b450 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56568/0 (socket says 172.21.15.1:56568) 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 -- 172.21.15.1:0/249322912 learned_addr learned my addr 172.21.15.1:0/249322912 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5588874640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 0x7f556c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f55837fe640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db28870650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f55837fe640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 0x7f556c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5588874640 1 -- 172.21.15.1:0/1934178625 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f55780f02c0 con 0x7f5584101420 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f55827fc640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db2887d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 -- 172.21.15.1:0/249322912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 msgr2=0x55db2887d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db2887d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 -- 172.21.15.1:0/249322912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 msgr2=0x55db28870650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db28870650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 -- 172.21.15.1:0/249322912 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2876bd40 con 0x55db28870b90 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f55837fe640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db28870650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f55827fc640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db2887d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.602+0000 7f5582ffd640 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5574007850 tx=0x7f5574007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c089dfce35647188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f5569ffb640 1 -- 172.21.15.1:0/249322912 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557400d950 con 0x55db28870b90 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f55837fe640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 0x7f556c0a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f557c00a780 tx=0x7f557c00a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f5569ffb640 1 -- 172.21.15.1:0/249322912 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5574018070 con 0x55db28870b90 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f5569ffb640 1 -- 172.21.15.1:0/249322912 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55740123e0 con 0x55db28870b90 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 -- 172.21.15.1:0/249322912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 msgr2=0x55db2887af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5574007850 tx=0x7f5574007d10 comp rx=0 tx=0).stop 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 -- 172.21.15.1:0/249322912 shutdown_connections 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db2887d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870b90 0x55db2887af10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 --2- 172.21.15.1:0/249322912 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db28870650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 -- 172.21.15.1:0/249322912 >> 172.21.15.1:0/249322912 conn(0x55db2886c800 msgr2=0x55db2886cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 -- 172.21.15.1:0/249322912 shutdown_connections 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.603+0000 7f558bc4f740 1 -- 172.21.15.1:0/249322912 wait complete. 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 -- start start 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 Processor -- start 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28878820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db28878d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db2887e020 con 0x55db28870270 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55db2875bf10 con 0x55db28870b90 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55db2887e1a0 con 0x55db2887b450 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f558bc4f740 10 client.0 _ll_register_callbacks cb 0x55db2877fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:32.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f5582ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56576/0 (socket says 172.21.15.1:56576) 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.604+0000 7f5582ffd640 1 -- 172.21.15.1:0/3214264607 learned_addr learned my addr 172.21.15.1:0/3214264607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f55827fc640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28878820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f55837fe640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db28878d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 -- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 msgr2=0x55db28878d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db28878d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 -- 172.21.15.1:0/3214264607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 msgr2=0x55db28878820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28878820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 -- 172.21.15.1:0/3214264607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db284e2580 con 0x55db28870270 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f55837fe640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db28878d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f55827fc640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28878820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5582ffd640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5574013a80 tx=0x7f55740136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916b0357cba76025 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:36:32.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557400de20 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f557401c3f0 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5574018070 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f557401c610 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f558bc4f740 10 client.15816 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db285ac960 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.605+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5574018070 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5574023800 con 0x55db28870270 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 10 client.15816 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 10 client.15816 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 20 client.15816 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db2888ae60 0x55db2888d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 4 client.15816 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:32.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db287e0b90 con 0x55db2888ae60 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f55827fc640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db2888ae60 0x55db2888d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f55827fc640 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db2888ae60 0x55db2888d250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995b0cb36bd3ef3c server_cookie=22a989c6c6834f7 in_seq=0 out_seq=0 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.606+0000 7f5562ffd640 10 client.15816 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f5562ffd640 1 -- 172.21.15.1:0/3214264607 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db287e0b90 con 0x55db2888ae60 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f5562ffd640 10 client.15816 handle_command_reply: tid=0 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 client.15816 shutdown 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 msgr2=0x55db288782e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5574013a80 tx=0x7f55740136b0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 shutdown_connections 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db2888ae60 0x55db2888d250 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db2887b450 0x55db28878d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28878820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 --2- 172.21.15.1:0/3214264607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db28870270 0x55db288782e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f5562ffd640 0 client.15816 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:32.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 >> 172.21.15.1:0/3214264607 conn(0x55db2886c800 msgr2=0x55db28869750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 shutdown_connections 2024-09-19T05:36:32.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.607+0000 7f558bc4f740 1 -- 172.21.15.1:0/3214264607 wait complete. 2024-09-19T05:36:32.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.608+0000 7f558bc4f740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T05:36:32.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 Processor -- start 2024-09-19T05:36:32.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 -- start start 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870270 0x55db288771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28892990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55841aab70 con 0x55db2887b450 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55841ad3f0 con 0x55db28870b90 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f558bc4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55841ab1e0 con 0x55db28870270 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56586/0 (socket says 172.21.15.1:56586) 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 -- 172.21.15.1:0/2973835550 learned_addr learned my addr 172.21.15.1:0/2973835550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870270 0x55db288771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55827fc640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28892990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 -- 172.21.15.1:0/2973835550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870270 msgr2=0x55db288771b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870270 0x55db288771b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 -- 172.21.15.1:0/2973835550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 msgr2=0x55db28892990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28892990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55837fe640 1 -- 172.21.15.1:0/2973835550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2886c630 con 0x55db2887b450 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.625+0000 7f55827fc640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28892990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f55837fe640 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f557c011a70 tx=0x7f557c00a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f8763f3c57c9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f55697fa640 1 -- 172.21.15.1:0/2973835550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c01d040 con 0x55db2887b450 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f55697fa640 1 -- 172.21.15.1:0/2973835550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f557c028070 con 0x55db2887b450 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f55697fa640 1 -- 172.21.15.1:0/2973835550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c00e610 con 0x55db2887b450 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 -- 172.21.15.1:0/2973835550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 msgr2=0x55db28892ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f557c011a70 tx=0x7f557c00a910 comp rx=0 tx=0).stop 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 -- 172.21.15.1:0/2973835550 shutdown_connections 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db28892ed0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870b90 0x55db28892990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2973835550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870270 0x55db288771b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 -- 172.21.15.1:0/2973835550 >> 172.21.15.1:0/2973835550 conn(0x55db2886c800 msgr2=0x55db28876aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 -- 172.21.15.1:0/2973835550 shutdown_connections 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.626+0000 7f558bc4f740 1 -- 172.21.15.1:0/2973835550 wait complete. 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 -- start start 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 Processor -- start 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db288833f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 0x55db28883930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55841ab8b0 con 0x55db2887b450 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55841acd20 con 0x55db28870270 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55841abf80 con 0x55db28870b90 2024-09-19T05:36:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f558bc4f740 10 client.0 _ll_register_callbacks cb 0x7f55740138a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f55837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f55837fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56590/0 (socket says 172.21.15.1:56590) 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f55827fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 0x55db28883930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.627+0000 7f55837fe640 1 -- 172.21.15.1:0/2865428960 learned_addr learned my addr 172.21.15.1:0/2865428960 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db288833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 -- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 msgr2=0x55db28883930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 0x55db28883930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 -- 172.21.15.1:0/2865428960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 msgr2=0x55db288833f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db288833f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 -- 172.21.15.1:0/2865428960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db288730e0 con 0x55db2887b450 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55827fc640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 0x55db28883930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db288833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f55837fe640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f557c00f820 tx=0x7f557c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df0471ffbdb45cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c018050 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f557c028070 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f557c023470 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f557c03f050 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f558bc4f740 10 client.15822 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.628+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db288f5e30 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f557c028070 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f557c005780 con 0x55db2887b450 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 10 client.15822 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 10 client.15822 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:32.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 20 client.15822 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db288f6520 0x55db288f8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 4 client.15822 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3bfdf922", "release": true, "await": true}] 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3bfdf922", "release": true, "await": true}) -- 0x55db287db0a0 con 0x55db288f6520 2024-09-19T05:36:32.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 35937 19.81 MB/sec warmup 107 sec latency 28817.770 ms 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db288f6520 0x55db288f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f5582ffd640 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db288f6520 0x55db288f8940 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=204743a3cc36dc2b server_cookie=3e2710ef74f636c8 in_seq=0 out_seq=0 2024-09-19T05:36:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.629+0000 7f5562ffd640 10 client.15822 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.724+0000 7f5562ffd640 1 -- 172.21.15.1:0/2865428960 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55db287db0a0 con 0x55db288f6520 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.724+0000 7f5562ffd640 10 client.15822 handle_command_reply: tid=0 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.724+0000 7f558bc4f740 1 client.15822 shutdown 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 msgr2=0x55db288803c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f557c00f820 tx=0x7f557c00ff70 comp rx=0 tx=0).stop 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 shutdown_connections 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db2887b450 0x55db288803c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55db288f6520 0x55db288f8940 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55db28870b90 0x55db28883930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 --2- 172.21.15.1:0/2865428960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55db28870270 0x55db288833f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 >> 172.21.15.1:0/2865428960 conn(0x55db2886c800 msgr2=0x55db288772c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f5562ffd640 0 client.15822 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 shutdown_connections 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 1 -- 172.21.15.1:0/2865428960 wait complete. 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.725+0000 7f558bc4f740 20 client.15822 trim_cache size 0 max 16384 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:36:32.728 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 52, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "3bfdf922": { 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 52, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.4, 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:36:32.729 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:32.730 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 msgr2=0x7f556c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 0x7f556c0a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f557c00a780 tx=0x7f557c00a4d0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 msgr2=0x7f5584197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5578009a50 tx=0x7f5578004270 comp rx=0 tx=0).stop 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 shutdown_connections 2024-09-19T05:36:32.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f556c0a3240 0x7f556c0a5700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5584106a80 0x7f558419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5584101420 0x7f5584197920 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 --2- 172.21.15.1:0/1934178625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5584100a80 0x7f55841973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 >> 172.21.15.1:0/1934178625 conn(0x7f55840fc7a0 msgr2=0x7f55840fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 shutdown_connections 2024-09-19T05:36:32.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:32.726+0000 7f5589876640 1 -- 172.21.15.1:0/1934178625 wait complete. 2024-09-19T05:36:33.552 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3bfdf922', total seconds elapsed: 33.2 2024-09-19T05:36:33.552 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T05:36:33.553 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:36:33.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 36172 19.68 MB/sec warmup 108 sec latency 28869.066 ms 2024-09-19T05:36:33.970 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:34.108 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:33 smithi001 ceph-mon[30968]: pgmap v812: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2024-09-19T05:36:34.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:33 smithi060 ceph-mon[35058]: pgmap v812: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2024-09-19T05:36:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:33 smithi082 ceph-mon[35195]: pgmap v812: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.8 MiB/s wr, 137 op/s 2024-09-19T05:36:34.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 -- 172.21.15.1:0/3536114117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 msgr2=0x7f71f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 --2- 172.21.15.1:0/3536114117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f41029b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009930 tx=0x7f71e802a4d0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 -- 172.21.15.1:0/3536114117 shutdown_connections 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 --2- 172.21.15.1:0/3536114117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 0x7f71f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 --2- 172.21.15.1:0/3536114117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f41029b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 --2- 172.21.15.1:0/3536114117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 -- 172.21.15.1:0/3536114117 >> 172.21.15.1:0/3536114117 conn(0x7f71f40fc7d0 msgr2=0x7f71f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 -- 172.21.15.1:0/3536114117 shutdown_connections 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.499+0000 7f71fc4de640 1 -- 172.21.15.1:0/3536114117 wait complete. 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 Processor -- start 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 -- start start 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 0x7f71f40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71f4110f80 con 0x7f71f4100e20 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71f4110e00 con 0x7f71f4102570 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fc4de640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71f4111100 con 0x7f71f4102ef0 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fa27a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fa27a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45982/0 (socket says 172.21.15.1:45982) 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71f9a79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71fa27a640 1 -- 172.21.15.1:0/2567486738 learned_addr learned my addr 172.21.15.1:0/2567486738 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.500+0000 7f71faa7b640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 0x7f71f40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 -- 172.21.15.1:0/2567486738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 msgr2=0x7f71f40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 0x7f71f40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 -- 172.21.15.1:0/2567486738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 msgr2=0x7f71f40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 -- 172.21.15.1:0/2567486738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f41a6ad0 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.501+0000 7f71fa27a640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00e9f0 tx=0x7f71ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.502+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00cd80 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.502+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f41a6dc0 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.502+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ec010910 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.502+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0188f0 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.502+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f41a7220 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.503+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f4101200 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.505+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f71ec010ac0 con 0x7f71f4100e20 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.506+0000 7f71f37fe640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 0x7f71dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:34.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.506+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f71ec0d0070 con 0x7f71f4100e20 2024-09-19T05:36:34.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.506+0000 7f71f9a79640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 0x7f71dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:34.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.507+0000 7f71f9a79640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 0x7f71dc0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009900 tx=0x7f71e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:34.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.511+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71ec09c390 con 0x7f71f4100e20 2024-09-19T05:36:34.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 36468 19.60 MB/sec warmup 109 sec latency 79.291 ms 2024-09-19T05:36:34.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.810+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71f40fe1b0 con 0x7f71f4100e20 2024-09-19T05:36:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.811+0000 7f71f37fe640 1 -- 172.21.15.1:0/2567486738 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f71ec0a0690 con 0x7f71f4100e20 2024-09-19T05:36:34.813 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:36:34.813 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:36:34.813 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:36:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 msgr2=0x7f71dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 0x7f71dc0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009900 tx=0x7f71e80058d0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 msgr2=0x7f71f40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00e9f0 tx=0x7f71ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 shutdown_connections 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f71dc0a3240 0x7f71dc0a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71f4102ef0 0x7f71f40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71f4102570 0x7f71f40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 --2- 172.21.15.1:0/2567486738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71f4100e20 0x7f71f40fcc80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.813+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 >> 172.21.15.1:0/2567486738 conn(0x7f71f40fc7d0 msgr2=0x7f71f406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.814+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 shutdown_connections 2024-09-19T05:36:34.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:34.814+0000 7f71fc4de640 1 -- 172.21.15.1:0/2567486738 wait complete. 2024-09-19T05:36:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:34 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2567486738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:35.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:34 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2567486738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:34 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2567486738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:36:35.551 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T05:36:35.551 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T05:36:35.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37015 19.65 MB/sec warmup 110 sec latency 80.529 ms 2024-09-19T05:36:35.839 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:36:36.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:35 smithi001 ceph-mon[30968]: pgmap v813: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.7 MiB/s wr, 108 op/s 2024-09-19T05:36:36.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:35 smithi060 ceph-mon[35058]: pgmap v813: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.7 MiB/s wr, 108 op/s 2024-09-19T05:36:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:35 smithi082 ceph-mon[35195]: pgmap v813: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 3.7 MiB/s wr, 108 op/s 2024-09-19T05:36:36.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 -- 172.21.15.1:0/2049555715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 msgr2=0x7fa394100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/2049555715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394100530 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa384009900 tx=0x7fa38402a410 comp rx=0 tx=0).stop 2024-09-19T05:36:36.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 -- 172.21.15.1:0/2049555715 shutdown_connections 2024-09-19T05:36:36.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/2049555715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394100a70 0x7fa39410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/2049555715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394100530 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/2049555715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394106ba0 0x7fa394106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 -- 172.21.15.1:0/2049555715 >> 172.21.15.1:0/2049555715 conn(0x7fa394077210 msgr2=0x7fa3940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 -- 172.21.15.1:0/2049555715 shutdown_connections 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.477+0000 7fa39c2ed640 1 -- 172.21.15.1:0/2049555715 wait complete. 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 Processor -- start 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 -- start start 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 0x7fa394198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 0x7fa39419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa394112050 con 0x7fa3941000d0 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39c2ed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa394111ed0 con 0x7fa394106ba0 2024-09-19T05:36:36.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.478+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45990/0 (socket says 172.21.15.1:45990) 2024-09-19T05:36:36.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a089640 1 -- 172.21.15.1:0/1789269373 learned_addr learned my addr 172.21.15.1:0/1789269373 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:36.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941121d0 con 0x7fa394100a70 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 0x7fa39419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa399888640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 0x7fa394198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 -- 172.21.15.1:0/1789269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 msgr2=0x7fa394198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 0x7fa394198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 -- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 msgr2=0x7fa394198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa39a88a640 1 -- 172.21.15.1:0/1789269373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39419d500 con 0x7fa394106ba0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.479+0000 7fa399888640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 0x7fa394198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa39a88a640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 0x7fa39419ce20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009fd0 tx=0x7fa38c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa38b7fe640 1 -- 172.21.15.1:0/1789269373 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00ce20 con 0x7fa394106ba0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39419d7f0 con 0x7fa394106ba0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941011e0 con 0x7fa394106ba0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa38b7fe640 1 -- 172.21.15.1:0/1789269373 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa38c005020 con 0x7fa394106ba0 2024-09-19T05:36:36.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.480+0000 7fa38b7fe640 1 -- 172.21.15.1:0/1789269373 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c010720 con 0x7fa394106ba0 2024-09-19T05:36:36.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.483+0000 7fa39e6c6740 1 Processor -- start 2024-09-19T05:36:36.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.483+0000 7fa38b7fe640 1 -- 172.21.15.1:0/1789269373 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa38c0109c0 con 0x7fa394106ba0 2024-09-19T05:36:36.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 -- start start 2024-09-19T05:36:36.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c339274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33929e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561c33881160 con 0x561c3391c850 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c33828720 con 0x561c3391d170 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c3387d120 con 0x561c33927a30 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa399888640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa399888640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45992/0 (socket says 172.21.15.1:45992) 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa399888640 1 -- 172.21.15.1:0/3718935632 learned_addr learned my addr 172.21.15.1:0/3718935632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa39a089640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c339274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.484+0000 7fa399888640 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33929e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 -- 172.21.15.1:0/3718935632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 msgr2=0x561c33929e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33929e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 -- 172.21.15.1:0/3718935632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 msgr2=0x561c3391cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 -- 172.21.15.1:0/3718935632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c335f2ba0 con 0x561c3391d170 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa399888640 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa38b7fe640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 0x7fa3800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa399888640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 0x7fa3800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa39a089640 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c339274f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa390009c30 tx=0x7fa390011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9fb18b08074978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa38b7fe640 1 -- 172.21.15.1:0/1789269373 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa38c0d03e0 con 0x7fa394106ba0 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa388dea640 1 -- 172.21.15.1:0/3718935632 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390004230 con 0x561c3391d170 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa388dea640 1 -- 172.21.15.1:0/3718935632 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3900043d0 con 0x561c3391d170 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.485+0000 7fa388dea640 1 -- 172.21.15.1:0/3718935632 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390004d10 con 0x561c3391d170 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- 172.21.15.1:0/3718935632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 msgr2=0x561c339274f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa399888640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 0x7fa3800a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3840096c0 tx=0x7fa384040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c339274f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa390009c30 tx=0x7fa390011810 comp rx=0 tx=0).stop 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- 172.21.15.1:0/3718935632 shutdown_connections 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33929e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c339274f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/3718935632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- 172.21.15.1:0/3718935632 >> 172.21.15.1:0/3718935632 conn(0x561c33918de0 msgr2=0x561c339191c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- 172.21.15.1:0/3718935632 shutdown_connections 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- 172.21.15.1:0/3718935632 wait complete. 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.486+0000 7fa39e6c6740 1 -- start start 2024-09-19T05:36:36.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 Processor -- start 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391c850 0x561c339248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391d170 0x561c33924df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561c3392a600 con 0x561c3391d170 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c33809900 con 0x561c3391c850 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c3392a780 con 0x561c33927a30 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39e6c6740 10 client.0 _ll_register_callbacks cb 0x561c33807780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa399888640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391d170 0x561c33924df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:37272/0 (socket says 172.21.15.1:37272) 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 -- 172.21.15.1:0/323652135 learned_addr learned my addr 172.21.15.1:0/323652135 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:36.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a089640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391c850 0x561c339248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 -- 172.21.15.1:0/323652135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391c850 msgr2=0x561c339248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391c850 0x561c339248b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 -- 172.21.15.1:0/323652135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391d170 msgr2=0x561c33924df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391d170 0x561c33924df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.487+0000 7fa39a88a640 1 -- 172.21.15.1:0/323652135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c33849c50 con 0x561c33927a30 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39a88a640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa38c099020 tx=0x7fa38c09cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4026f8587c5a19d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0b4020 con 0x561c33927a30 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3900043d0 con 0x561c33927a30 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa38c0d00d0 con 0x561c33927a30 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa38c0a52c0 con 0x561c33927a30 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 10 client.25417 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:36.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c33936320 con 0x561c33927a30 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3900043d0 con 0x561c33927a30 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa38c0b0b70 con 0x561c33927a30 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 10 client.25417 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 10 client.25417 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 20 client.25417 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.488+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c33937730 0x561c33939b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.489+0000 7fa39e6c6740 4 client.25417 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.489+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c3388e890 con 0x561c33937730 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.489+0000 7fa39a089640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c33937730 0x561c33939b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.489+0000 7fa37dffb640 10 client.25417 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.489+0000 7fa39a089640 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c33937730 0x561c33939b20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50e349b6306cca2d server_cookie=6960ee560ffc9b32 in_seq=0 out_seq=0 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa37dffb640 1 -- 172.21.15.1:0/323652135 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c3388e890 con 0x561c33937730 2024-09-19T05:36:36.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa37dffb640 10 client.25417 handle_command_reply: tid=0 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 client.25417 shutdown 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 msgr2=0x561c33925330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa38c099020 tx=0x7fa38c09cd50 comp rx=0 tx=0).stop 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 shutdown_connections 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c33937730 0x561c33939b20 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c33925330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391d170 0x561c33924df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/323652135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391c850 0x561c339248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 >> 172.21.15.1:0/323652135 conn(0x561c33918de0 msgr2=0x561c3391eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.490+0000 7fa37dffb640 0 client.25417 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.491+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 shutdown_connections 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.491+0000 7fa39e6c6740 1 -- 172.21.15.1:0/323652135 wait complete. 2024-09-19T05:36:36.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.491+0000 7fa39e6c6740 20 client.25417 trim_cache size 0 max 16384 2024-09-19T05:36:36.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 Processor -- start 2024-09-19T05:36:36.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 -- start start 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c3393f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c3393f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941aeec0 con 0x561c3391c850 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b1740 con 0x561c3391d170 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.510+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941af530 con 0x561c33927a30 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46010/0 (socket says 172.21.15.1:46010) 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 -- 172.21.15.1:0/980429655 learned_addr learned my addr 172.21.15.1:0/980429655 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa399888640 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c3393f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a88a640 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c3393f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 -- 172.21.15.1:0/980429655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 msgr2=0x561c3393f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c3393f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 -- 172.21.15.1:0/980429655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 msgr2=0x561c3393f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c3393f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 -- 172.21.15.1:0/980429655 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c33919f70 con 0x561c3391c850 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa39a089640 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa390011d10 tx=0x7fa390009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779c0f06eeceaff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa37ffff640 1 -- 172.21.15.1:0/980429655 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39001e040 con 0x561c3391c850 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa37ffff640 1 -- 172.21.15.1:0/980429655 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39001f040 con 0x561c3391c850 2024-09-19T05:36:36.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.511+0000 7fa37ffff640 1 -- 172.21.15.1:0/980429655 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390026440 con 0x561c3391c850 2024-09-19T05:36:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 -- 172.21.15.1:0/980429655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 msgr2=0x561c3391ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa390011d10 tx=0x7fa390009ec0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 -- 172.21.15.1:0/980429655 shutdown_connections 2024-09-19T05:36:36.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c33927a30 0x561c3393f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c3391d170 0x561c3393f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/980429655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3391ea00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 -- 172.21.15.1:0/980429655 >> 172.21.15.1:0/980429655 conn(0x561c33918de0 msgr2=0x561c3391e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 -- 172.21.15.1:0/980429655 shutdown_connections 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.512+0000 7fa39e6c6740 1 -- 172.21.15.1:0/980429655 wait complete. 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 -- start start 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 Processor -- start 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c3391d170 0x561c3392ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c33927a30 0x561c3392c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941afc00 con 0x561c3391c850 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b1070 con 0x561c33927a30 2024-09-19T05:36:36.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3941b02d0 con 0x561c3391d170 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39e6c6740 10 client.0 _ll_register_callbacks cb 0x7fa38c098230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46018/0 (socket says 172.21.15.1:46018) 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 -- 172.21.15.1:0/1288994736 learned_addr learned my addr 172.21.15.1:0/1288994736 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa399888640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c3391d170 0x561c3392ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a88a640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c33927a30 0x561c3392c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 -- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c3391d170 msgr2=0x561c3392ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c3391d170 0x561c3392ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 -- 172.21.15.1:0/1288994736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c33927a30 msgr2=0x561c3392c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c33927a30 0x561c3392c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.513+0000 7fa39a089640 1 -- 172.21.15.1:0/1288994736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3392cf10 con 0x561c3391c850 2024-09-19T05:36:36.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa39a089640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa390011850 tx=0x7fa390003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5236170b71a68c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa37dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900037f0 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa3900050c0 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa39001f040 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa390041050 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa39e6c6740 10 client.15846 fetch_fsmap learned FSMap version 21 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561c339a2b00 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.514+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39001f040 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa390024040 con 0x561c3391c850 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 10 client.15846 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 10 client.15846 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:36:36.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 20 client.15846 populate_metadata read hostname 'smithi001' 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c339a3030 0x561c339a5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 4 client.15846 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x561c33888be0 con 0x561c339a3030 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa399888640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c339a3030 0x561c339a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa399888640 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c339a3030 0x561c339a5420 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df8448cd4d8aa36 server_cookie=66af393c58f1f0ea in_seq=0 out_seq=0 2024-09-19T05:36:36.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:36.515+0000 7fa37dffb640 10 client.15846 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:36.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37541 19.66 MB/sec warmup 111 sec latency 118.472 ms 2024-09-19T05:36:37.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa37dffb640 1 -- 172.21.15.1:0/1288994736 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561c33888be0 con 0x561c339a3030 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa37dffb640 10 client.15846 handle_command_reply: tid=0 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 client.15846 shutdown 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 msgr2=0x561c3392fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa390011850 tx=0x7fa390003f80 comp rx=0 tx=0).stop 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 shutdown_connections 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c33927a30 0x561c3392c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561c339a3030 0x561c339a5420 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c3391d170 0x561c3392ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 --2- 172.21.15.1:0/1288994736 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561c3391c850 0x561c3392fa00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa37dffb640 0 client.15846 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:36:37.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 >> 172.21.15.1:0/1288994736 conn(0x561c33918de0 msgr2=0x561c3391eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 shutdown_connections 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 1 -- 172.21.15.1:0/1288994736 wait complete. 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.335+0000 7fa39e6c6740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 54, 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "6940ea39": { 2024-09-19T05:36:37.339 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 54, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.4, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:36:37.340 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 msgr2=0x7fa3800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 0x7fa3800a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3840096c0 tx=0x7fa384040040 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 msgr2=0x7fa39419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 0x7fa39419ce20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009fd0 tx=0x7fa38c00ef10 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 shutdown_connections 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa3800a32c0 0x7fa3800a5780 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa394106ba0 0x7fa39419ce20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa394100a70 0x7fa394198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 --2- 172.21.15.1:0/1789269373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3941000d0 0x7fa394198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 >> 172.21.15.1:0/1789269373 conn(0x7fa394077210 msgr2=0x7fa394104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 shutdown_connections 2024-09-19T05:36:37.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:36:37.336+0000 7fa39c2ed640 1 -- 172.21.15.1:0/1789269373 wait complete. 2024-09-19T05:36:37.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 19.48 MB/sec warmup 112 sec latency 938.380 ms 2024-09-19T05:36:37.986 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:37 smithi001 ceph-mon[30968]: pgmap v814: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.0 MiB/s wr, 156 op/s 2024-09-19T05:36:38.018 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6940ea39', quiesce took 4.5 seconds. Will release after: 24.95 2024-09-19T05:36:38.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:37 smithi060 ceph-mon[35058]: pgmap v814: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.0 MiB/s wr, 156 op/s 2024-09-19T05:36:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:37 smithi082 ceph-mon[35195]: pgmap v814: 129 pgs: 129 active+clean; 448 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 5.0 MiB/s wr, 156 op/s 2024-09-19T05:36:38.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 19.31 MB/sec warmup 113 sec latency 1938.469 ms 2024-09-19T05:36:39.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 19.14 MB/sec warmup 114 sec latency 2938.595 ms 2024-09-19T05:36:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:39 smithi060 ceph-mon[35058]: pgmap v815: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.4 MiB/s wr, 217 op/s 2024-09-19T05:36:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:39 smithi082 ceph-mon[35195]: pgmap v815: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.4 MiB/s wr, 217 op/s 2024-09-19T05:36:40.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:39 smithi001 ceph-mon[30968]: pgmap v815: 129 pgs: 129 active+clean; 449 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.4 MiB/s wr, 217 op/s 2024-09-19T05:36:40.631 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 18.98 MB/sec warmup 115 sec latency 3938.721 ms 2024-09-19T05:36:41.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 18.81 MB/sec warmup 116 sec latency 4938.840 ms 2024-09-19T05:36:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:41 smithi060 ceph-mon[35058]: pgmap v816: 129 pgs: 129 active+clean; 451 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 241 op/s 2024-09-19T05:36:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:41 smithi082 ceph-mon[35195]: pgmap v816: 129 pgs: 129 active+clean; 451 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 241 op/s 2024-09-19T05:36:42.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:41 smithi001 ceph-mon[30968]: pgmap v816: 129 pgs: 129 active+clean; 451 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.9 MiB/s wr, 241 op/s 2024-09-19T05:36:42.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 18.65 MB/sec warmup 117 sec latency 5938.975 ms 2024-09-19T05:36:43.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 18.49 MB/sec warmup 118 sec latency 6939.094 ms 2024-09-19T05:36:44.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:43 smithi060 ceph-mon[35058]: pgmap v817: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2024-09-19T05:36:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:43 smithi082 ceph-mon[35195]: pgmap v817: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2024-09-19T05:36:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:43 smithi001 ceph-mon[30968]: pgmap v817: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 245 op/s 2024-09-19T05:36:44.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 18.34 MB/sec warmup 119 sec latency 7939.195 ms 2024-09-19T05:36:46.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:45 smithi060 ceph-mon[35058]: pgmap v818: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 203 op/s 2024-09-19T05:36:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:45 smithi082 ceph-mon[35195]: pgmap v818: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 203 op/s 2024-09-19T05:36:46.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:45 smithi001 ceph-mon[30968]: pgmap v818: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 203 op/s 2024-09-19T05:36:46.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 1 sec latency 9939.413 ms 2024-09-19T05:36:47.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 2 sec latency 10939.528 ms 2024-09-19T05:36:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:47 smithi060 ceph-mon[35058]: pgmap v819: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 193 op/s 2024-09-19T05:36:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:47 smithi082 ceph-mon[35195]: pgmap v819: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 193 op/s 2024-09-19T05:36:48.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:47 smithi001 ceph-mon[30968]: pgmap v819: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 193 op/s 2024-09-19T05:36:48.632 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 3 sec latency 11939.643 ms 2024-09-19T05:36:49.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 4 sec latency 12939.753 ms 2024-09-19T05:36:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:49 smithi060 ceph-mon[35058]: pgmap v820: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-09-19T05:36:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:49 smithi082 ceph-mon[35195]: pgmap v820: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-09-19T05:36:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:49 smithi001 ceph-mon[30968]: pgmap v820: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 1.6 MiB/s wr, 138 op/s 2024-09-19T05:36:50.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 5 sec latency 13939.854 ms 2024-09-19T05:36:51.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 6 sec latency 14939.953 ms 2024-09-19T05:36:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:51 smithi060 ceph-mon[35058]: pgmap v821: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 559 KiB/s wr, 58 op/s 2024-09-19T05:36:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:51 smithi082 ceph-mon[35195]: pgmap v821: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 559 KiB/s wr, 58 op/s 2024-09-19T05:36:52.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:51 smithi001 ceph-mon[30968]: pgmap v821: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 559 KiB/s wr, 58 op/s 2024-09-19T05:36:52.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 7 sec latency 15940.067 ms 2024-09-19T05:36:53.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 8 sec latency 16940.164 ms 2024-09-19T05:36:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:53 smithi060 ceph-mon[35058]: pgmap v822: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 232 KiB/s wr, 16 op/s 2024-09-19T05:36:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:53 smithi082 ceph-mon[35195]: pgmap v822: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 232 KiB/s wr, 16 op/s 2024-09-19T05:36:54.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:53 smithi001 ceph-mon[30968]: pgmap v822: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 232 KiB/s wr, 16 op/s 2024-09-19T05:36:54.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 9 sec latency 17940.274 ms 2024-09-19T05:36:55.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 10 sec latency 18940.403 ms 2024-09-19T05:36:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:55 smithi060 ceph-mon[35058]: pgmap v823: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T05:36:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:55 smithi082 ceph-mon[35195]: pgmap v823: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T05:36:56.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:55 smithi001 ceph-mon[30968]: pgmap v823: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T05:36:56.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 11 sec latency 19940.551 ms 2024-09-19T05:36:57.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 12 sec latency 20940.676 ms 2024-09-19T05:36:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:57 smithi060 ceph-mon[35058]: pgmap v824: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T05:36:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:57 smithi082 ceph-mon[35195]: pgmap v824: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T05:36:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:57 smithi001 ceph-mon[30968]: pgmap v824: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T05:36:58.633 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 13 sec latency 21940.788 ms 2024-09-19T05:36:59.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 14 sec latency 22940.912 ms 2024-09-19T05:37:00.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:36:59 smithi060 ceph-mon[35058]: pgmap v825: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-19T05:37:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:36:59 smithi082 ceph-mon[35195]: pgmap v825: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-19T05:37:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:36:59 smithi001 ceph-mon[30968]: pgmap v825: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-19T05:37:00.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 15 sec latency 23941.042 ms 2024-09-19T05:37:01.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 16 sec latency 24941.170 ms 2024-09-19T05:37:02.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:01 smithi060 ceph-mon[35058]: pgmap v826: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-09-19T05:37:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:01 smithi082 ceph-mon[35195]: pgmap v826: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-09-19T05:37:02.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:01 smithi001 ceph-mon[30968]: pgmap v826: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 2 op/s 2024-09-19T05:37:02.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 17 sec latency 25941.285 ms 2024-09-19T05:37:02.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:37:03.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 18 sec latency 26941.346 ms 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 -- 172.21.15.1:0/2757606330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102ef0 msgr2=0x7ff6fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 --2- 172.21.15.1:0/2757606330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc10da40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009ca0 tx=0x7ff6f402a950 comp rx=0 tx=0).stop 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 -- 172.21.15.1:0/2757606330 shutdown_connections 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 --2- 172.21.15.1:0/2757606330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc10da40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 --2- 172.21.15.1:0/2757606330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc102570 0x7ff6fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 --2- 172.21.15.1:0/2757606330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc100e20 0x7ff6fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 -- 172.21.15.1:0/2757606330 >> 172.21.15.1:0/2757606330 conn(0x7ff6fc0fc7d0 msgr2=0x7ff6fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 -- 172.21.15.1:0/2757606330 shutdown_connections 2024-09-19T05:37:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.899+0000 7ff703309640 1 -- 172.21.15.1:0/2757606330 wait complete. 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 Processor -- start 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 -- start start 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 0x7ff6fc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc110f80 con 0x7ff6fc102570 2024-09-19T05:37:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc110e00 con 0x7ff6fc100e20 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff703309640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc111100 con 0x7ff6fc102ef0 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff7008a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 0x7ff6fc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff7010a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff7008a4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 0x7ff6fc1997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47320/0 (socket says 172.21.15.1:47320) 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff7008a4640 1 -- 172.21.15.1:0/332977172 learned_addr learned my addr 172.21.15.1:0/332977172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.900+0000 7ff7010a5640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:37616/0 (socket says 172.21.15.1:37616) 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7018a6640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 -- 172.21.15.1:0/332977172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc102ef0 msgr2=0x7ff6fc1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 -- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 msgr2=0x7ff6fc1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 0x7ff6fc1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 -- 172.21.15.1:0/332977172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc1a4870 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff7010a5640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800e9f0 tx=0x7ff6f800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.901+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800ccc0 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.902+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6f8010910 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.902+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8018960 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.902+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc1970a0 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.902+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc197590 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.903+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6fc101200 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.904+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff6f8010ac0 con 0x7ff6fc100e20 2024-09-19T05:37:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.904+0000 7ff6f27fc640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 0x7ff6e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.904+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff6f80d0060 con 0x7ff6fc100e20 2024-09-19T05:37:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.904+0000 7ff7008a4640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 0x7ff6e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.905+0000 7ff7008a4640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 0x7ff6e80a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc06aac0 tx=0x7ff6ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:03.909+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6f809c9d0 con 0x7ff6fc100e20 2024-09-19T05:37:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:03 smithi001 ceph-mon[30968]: pgmap v827: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T05:37:04.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.147+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6fc1977f0 con 0x7ff6fc100e20 2024-09-19T05:37:04.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.148+0000 7ff6f27fc640 1 -- 172.21.15.1:0/332977172 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7ff6f809c2d0 con 0x7ff6fc100e20 2024-09-19T05:37:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:37:04.150 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:37:04.150 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 msgr2=0x7ff6e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 0x7ff6e80a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc06aac0 tx=0x7ff6ec005f90 comp rx=0 tx=0).stop 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 msgr2=0x7ff6fc1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800e9f0 tx=0x7ff6f800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 shutdown_connections 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff6e80a32c0 0x7ff6e80a5780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6fc102ef0 0x7ff6fc1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:04.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff6fc102570 0x7ff6fc1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 --2- 172.21.15.1:0/332977172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc100e20 0x7ff6fc1992b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 >> 172.21.15.1:0/332977172 conn(0x7ff6fc0fc7d0 msgr2=0x7ff6fc106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 shutdown_connections 2024-09-19T05:37:04.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:04.150+0000 7ff703309640 1 -- 172.21.15.1:0/332977172 wait complete. 2024-09-19T05:37:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:03 smithi060 ceph-mon[35058]: pgmap v827: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T05:37:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:03 smithi082 ceph-mon[35195]: pgmap v827: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T05:37:04.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 19 sec latency 27941.401 ms 2024-09-19T05:37:05.172 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:04 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/332977172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:37:05.200 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 6940ea39 --release --await' 2024-09-19T05:37:05.201 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 6940ea39 --release --await 2024-09-19T05:37:05.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:04 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/332977172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:37:05.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:04 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/332977172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:37:05.460 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:37:05.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37551 0.00 MB/sec execute 20 sec latency 28941.470 ms 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 -- 172.21.15.1:0/2113861949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4106f30 msgr2=0x7f57b410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 --2- 172.21.15.1:0/2113861949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4106f30 0x7f57b410eab0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009ca0 tx=0x7f57ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 -- 172.21.15.1:0/2113861949 shutdown_connections 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 --2- 172.21.15.1:0/2113861949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4106f30 0x7f57b410eab0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 --2- 172.21.15.1:0/2113861949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4100cc0 0x7f57b4106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 --2- 172.21.15.1:0/2113861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 0x7f57b41006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 -- 172.21.15.1:0/2113861949 >> 172.21.15.1:0/2113861949 conn(0x7f57b4077210 msgr2=0x7f57b40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 -- 172.21.15.1:0/2113861949 shutdown_connections 2024-09-19T05:37:05.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.958+0000 7f57bb049640 1 -- 172.21.15.1:0/2113861949 wait complete. 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 Processor -- start 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 -- start start 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 0x7f57b41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 0x7f57b419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b4111f90 con 0x7f57b4100cc0 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57b4111e10 con 0x7f57b4106f30 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57bb049640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57b4112110 con 0x7f57b4100310 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57b3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57b3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41808/0 (socket says 172.21.15.1:41808) 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.959+0000 7f57b3fff640 1 -- 172.21.15.1:0/3732986623 learned_addr learned my addr 172.21.15.1:0/3732986623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:05.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b8de5640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 0x7f57b41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b95e6640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 0x7f57b419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 -- 172.21.15.1:0/3732986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 msgr2=0x7f57b41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 0x7f57b41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 -- 172.21.15.1:0/3732986623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 msgr2=0x7f57b419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 0x7f57b419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 -- 172.21.15.1:0/3732986623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b419d3a0 con 0x7f57b4100cc0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b95e6640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 0x7f57b419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b3fff640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d950 tx=0x7f57a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b1ffb640 1 -- 172.21.15.1:0/3732986623 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0017070 con 0x7f57b4100cc0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b419d690 con 0x7f57b4100cc0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b1ffb640 1 -- 172.21.15.1:0/3732986623 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a0009c30 con 0x7f57b4100cc0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57b1ffb640 1 -- 172.21.15.1:0/3732986623 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a000f6b0 con 0x7f57b4100cc0 2024-09-19T05:37:05.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.960+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b41a4f70 con 0x7f57b4100cc0 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57b1ffb640 1 -- 172.21.15.1:0/3732986623 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f57a00109d0 con 0x7f57b4100cc0 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 Processor -- start 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 -- start start 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c1558440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c1565630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584c14bd620 con 0x5584c1558980 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584c1464e50 con 0x5584c1563240 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57bd422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584c14b95e0 con 0x5584c1558060 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57b8de5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57b8de5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41822/0 (socket says 172.21.15.1:41822) 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57b8de5640 1 -- 172.21.15.1:0/2920262528 learned_addr learned my addr 172.21.15.1:0/2920262528 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.963+0000 7f57b95e6640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c1558440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b3fff640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c1565630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b1ffb640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 0x7f57a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 -- 172.21.15.1:0/2920262528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 msgr2=0x5584c1558440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c1558440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 -- 172.21.15.1:0/2920262528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 msgr2=0x5584c1565630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c1565630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 -- 172.21.15.1:0/2920262528 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c1455d40 con 0x5584c1558980 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b3fff640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c1565630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b95e6640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 0x7f57a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b1ffb640 1 -- 172.21.15.1:0/3732986623 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f57a00cf8c0 con 0x7f57b4100cc0 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f57b8de5640 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009d20 tx=0x7f57a8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3934e1189ac871 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f579effd640 1 -- 172.21.15.1:0/2920262528 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a801e070 con 0x5584c1558980 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f579effd640 1 -- 172.21.15.1:0/2920262528 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8019b10 con 0x5584c1558980 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.964+0000 7f579effd640 1 -- 172.21.15.1:0/2920262528 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a800ebf0 con 0x5584c1558980 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- 172.21.15.1:0/2920262528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 msgr2=0x5584c1562d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009d20 tx=0x7f57a8011810 comp rx=0 tx=0).stop 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57b95e6640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 0x7f57a40a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57ac005fe0 tx=0x7f57ac0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- 172.21.15.1:0/2920262528 shutdown_connections 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c1565630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558980 0x5584c1562d00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 --2- 172.21.15.1:0/2920262528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c1558440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- 172.21.15.1:0/2920262528 >> 172.21.15.1:0/2920262528 conn(0x5584c15545f0 msgr2=0x5584c15549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- 172.21.15.1:0/2920262528 shutdown_connections 2024-09-19T05:37:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- 172.21.15.1:0/2920262528 wait complete. 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 -- start start 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.965+0000 7f57bd422740 1 Processor -- start 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c15601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1560730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584c1565e10 con 0x5584c1563240 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584c1445f10 con 0x5584c1558980 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584c1565f90 con 0x5584c1558060 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57bd422740 10 client.0 _ll_register_callbacks cb 0x5584c1469db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b95e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b95e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41840/0 (socket says 172.21.15.1:41840) 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b95e6640 1 -- 172.21.15.1:0/1830325226 learned_addr learned my addr 172.21.15.1:0/1830325226 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c15601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b3fff640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1560730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 -- 172.21.15.1:0/1830325226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 msgr2=0x5584c1560730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1560730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 -- 172.21.15.1:0/1830325226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 msgr2=0x5584c1560c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 -- 172.21.15.1:0/1830325226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c11cc580 con 0x5584c1558060 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b95e6640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c15601f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011d10 tx=0x7f57a8019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e4261d49757ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.966+0000 7f5793fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8027020 con 0x5584c1558060 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f57a800eaf0 con 0x5584c1558060 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a8019b10 con 0x5584c1558060 2024-09-19T05:37:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57a802f050 con 0x5584c1558060 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 10 client.25441 fetch_fsmap learned FSMap version 21 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584c1296960 con 0x5584c1558060 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8019b10 con 0x5584c1558060 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f57a8023a40 con 0x5584c1558060 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 10 client.25441 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 10 client.25441 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 20 client.25441 populate_metadata read hostname 'smithi001' 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c1572de0 0x5584c15751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 4 client.25441 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.967+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c14cab90 con 0x5584c1572de0 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.968+0000 7f57b3fff640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c1572de0 0x5584c15751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.968+0000 7f57b3fff640 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c1572de0 0x5584c15751d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd3a2ad596bf0537 server_cookie=ee41c8100867cb27 in_seq=0 out_seq=0 2024-09-19T05:37:05.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.968+0000 7f5793fff640 10 client.25441 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f5793fff640 1 -- 172.21.15.1:0/1830325226 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584c14cab90 con 0x5584c1572de0 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f5793fff640 10 client.25441 handle_command_reply: tid=0 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 client.25441 shutdown 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 msgr2=0x5584c15601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c15601f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011d10 tx=0x7f57a8019660 comp rx=0 tx=0).stop 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 shutdown_connections 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c1560c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1560730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c1572de0 0x5584c15751d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 --2- 172.21.15.1:0/1830325226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c15601f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f5793fff640 0 client.25441 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 >> 172.21.15.1:0/1830325226 conn(0x5584c15545f0 msgr2=0x5584c155a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 shutdown_connections 2024-09-19T05:37:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 1 -- 172.21.15.1:0/1830325226 wait complete. 2024-09-19T05:37:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.969+0000 7f57bd422740 20 client.25441 trim_cache size 0 max 16384 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.986+0000 7f57bd422740 1 Processor -- start 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.986+0000 7f57bd422740 1 -- start start 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 0x5584c157a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c157ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41acdc0 con 0x5584c1558060 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41af640 con 0x5584c1563240 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57bd422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41ad430 con 0x5584c1558980 2024-09-19T05:37:05.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41844/0 (socket says 172.21.15.1:41844) 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 -- 172.21.15.1:0/1196951105 learned_addr learned my addr 172.21.15.1:0/1196951105 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b3fff640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 0x5584c157a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b95e6640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c157ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 -- 172.21.15.1:0/1196951105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 msgr2=0x5584c157a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 0x5584c157a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 -- 172.21.15.1:0/1196951105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 msgr2=0x5584c157ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c157ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 -- 172.21.15.1:0/1196951105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c1552bb0 con 0x5584c1558060 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b3fff640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 0x5584c157a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f57b8de5640 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011eb0 tx=0x7f57a8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8839f24107f2d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f579e7fc640 1 -- 172.21.15.1:0/1196951105 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8015070 con 0x5584c1558060 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f579e7fc640 1 -- 172.21.15.1:0/1196951105 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a801f040 con 0x5584c1558060 2024-09-19T05:37:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.987+0000 7f579e7fc640 1 -- 172.21.15.1:0/1196951105 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8027070 con 0x5584c1558060 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- 172.21.15.1:0/1196951105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 msgr2=0x5584c15608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011eb0 tx=0x7f57a8005bd0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- 172.21.15.1:0/1196951105 shutdown_connections 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1563240 0x5584c157ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558980 0x5584c157a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 --2- 172.21.15.1:0/1196951105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1558060 0x5584c15608c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- 172.21.15.1:0/1196951105 >> 172.21.15.1:0/1196951105 conn(0x5584c15545f0 msgr2=0x5584c15601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- 172.21.15.1:0/1196951105 shutdown_connections 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- 172.21.15.1:0/1196951105 wait complete. 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.988+0000 7f57bd422740 1 -- start start 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 Processor -- start 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c156ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1566dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41adb00 con 0x5584c1563240 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41aef70 con 0x5584c1558980 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41ae1d0 con 0x5584c1558060 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57bd422740 10 client.0 _ll_register_callbacks cb 0x7f57a8009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57b95e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57b95e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41856/0 (socket says 172.21.15.1:41856) 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57b95e6640 1 -- 172.21.15.1:0/23936317 learned_addr learned my addr 172.21.15.1:0/23936317 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57b8de5640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c156ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.989+0000 7f57b3fff640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1566dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 -- 172.21.15.1:0/23936317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 msgr2=0x5584c1566dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1566dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 -- 172.21.15.1:0/23936317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 msgr2=0x5584c15673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:37:05.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 -- 172.21.15.1:0/23936317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c1567be0 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b95e6640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57b8de5640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c156ba40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011eb0 tx=0x7f57a80092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42285d3d47627517 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f5793fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8027070 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f57a8019df0 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a801f040 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57a8015040 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57bd422740 10 client.25447 fetch_fsmap learned FSMap version 21 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584c15dda30 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.990+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a801f040 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f57a800e930 con 0x5584c1558060 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 10 client.25447 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:37:05.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 10 client.25447 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 20 client.25447 populate_metadata read hostname 'smithi001' 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c15de030 0x5584c15e0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 4 client.25447 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6940ea39", "release": true, "await": true}] 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6940ea39", "release": true, "await": true}) -- 0x5584c14c50a0 con 0x5584c15de030 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57b3fff640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c15de030 0x5584c15e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f57b3fff640 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c15de030 0x5584c15e0420 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ff02253bd39abb server_cookie=f396c60c10f12f77 in_seq=0 out_seq=0 2024-09-19T05:37:05.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:05.991+0000 7f5793fff640 10 client.25447 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f5793fff640 1 -- 172.21.15.1:0/23936317 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5584c14c50a0 con 0x5584c15de030 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f5793fff640 10 client.25447 handle_command_reply: tid=0 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 client.25447 shutdown 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 msgr2=0x5584c156ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c156ba40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57a8011eb0 tx=0x7f57a80092d0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 shutdown_connections 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584c1563240 0x5584c15673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584c1558980 0x5584c1566dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584c15de030 0x5584c15e0420 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 --2- 172.21.15.1:0/23936317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584c1558060 0x5584c156ba40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f5793fff640 0 client.25447 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 >> 172.21.15.1:0/23936317 conn(0x5584c15545f0 msgr2=0x5584c155a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 shutdown_connections 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 1 -- 172.21.15.1:0/23936317 wait complete. 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.048+0000 7f57bd422740 20 client.25447 trim_cache size 0 max 16384 2024-09-19T05:37:06.051 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 56, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "6940ea39": { 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 56, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:37:06.052 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.4, 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:37:06.053 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 msgr2=0x7f57a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 0x7f57a40a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57ac005fe0 tx=0x7f57ac0095c0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 msgr2=0x7f57b4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f57a000d950 tx=0x7f57a000de10 comp rx=0 tx=0).stop 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 shutdown_connections 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f57a40a3240 0x7f57a40a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b4106f30 0x7f57b419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57b4100cc0 0x7f57b4198930 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 --2- 172.21.15.1:0/3732986623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b4100310 0x7f57b41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:37:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 >> 172.21.15.1:0/3732986623 conn(0x7f57b4077210 msgr2=0x7f57b4105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:37:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 shutdown_connections 2024-09-19T05:37:06.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:37:06.049+0000 7f57bb049640 1 -- 172.21.15.1:0/3732986623 wait complete. 2024-09-19T05:37:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:05 smithi060 ceph-mon[35058]: pgmap v828: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 194 KiB/s wr, 8 op/s 2024-09-19T05:37:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:05 smithi082 ceph-mon[35195]: pgmap v828: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 194 KiB/s wr, 8 op/s 2024-09-19T05:37:06.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:05 smithi001 ceph-mon[30968]: pgmap v828: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 194 KiB/s wr, 8 op/s 2024-09-19T05:37:06.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 37898 1.13 MB/sec execute 21 sec latency 29360.233 ms 2024-09-19T05:37:06.871 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6940ea39', total seconds elapsed: 33.3 2024-09-19T05:37:07.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 38511 3.14 MB/sec execute 22 sec latency 72.375 ms 2024-09-19T05:37:08.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:07 smithi060 ceph-mon[35058]: pgmap v829: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-09-19T05:37:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:07 smithi082 ceph-mon[35195]: pgmap v829: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-09-19T05:37:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:07 smithi001 ceph-mon[30968]: pgmap v829: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-09-19T05:37:08.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 38989 4.39 MB/sec execute 23 sec latency 58.319 ms 2024-09-19T05:37:09.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 39307 5.03 MB/sec execute 24 sec latency 58.190 ms 2024-09-19T05:37:10.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:09 smithi060 ceph-mon[35058]: pgmap v830: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T05:37:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:09 smithi082 ceph-mon[35195]: pgmap v830: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T05:37:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:09 smithi001 ceph-mon[30968]: pgmap v830: 129 pgs: 129 active+clean; 446 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 55 op/s 2024-09-19T05:37:10.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 39556 5.22 MB/sec execute 25 sec latency 97.088 ms 2024-09-19T05:37:11.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 39862 5.38 MB/sec execute 26 sec latency 126.998 ms 2024-09-19T05:37:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:11 smithi060 ceph-mon[35058]: pgmap v831: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 118 op/s 2024-09-19T05:37:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:11 smithi082 ceph-mon[35195]: pgmap v831: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 118 op/s 2024-09-19T05:37:12.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:11 smithi001 ceph-mon[30968]: pgmap v831: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.8 MiB/s wr, 118 op/s 2024-09-19T05:37:12.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 40306 6.00 MB/sec execute 27 sec latency 76.674 ms 2024-09-19T05:37:13.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 40923 6.52 MB/sec execute 28 sec latency 112.207 ms 2024-09-19T05:37:14.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:13 smithi060 ceph-mon[35058]: pgmap v832: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-09-19T05:37:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:13 smithi082 ceph-mon[35195]: pgmap v832: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-09-19T05:37:14.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:13 smithi001 ceph-mon[30968]: pgmap v832: 129 pgs: 129 active+clean; 452 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 2.0 MiB/s wr, 147 op/s 2024-09-19T05:37:14.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 41629 7.81 MB/sec execute 29 sec latency 56.115 ms 2024-09-19T05:37:15.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 42312 9.28 MB/sec execute 30 sec latency 36.109 ms 2024-09-19T05:37:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:15 smithi060 ceph-mon[35058]: pgmap v833: 129 pgs: 129 active+clean; 453 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.1 MiB/s wr, 160 op/s 2024-09-19T05:37:16.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:15 smithi082 ceph-mon[35195]: pgmap v833: 129 pgs: 129 active+clean; 453 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.1 MiB/s wr, 160 op/s 2024-09-19T05:37:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:15 smithi001 ceph-mon[30968]: pgmap v833: 129 pgs: 129 active+clean; 453 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.1 MiB/s wr, 160 op/s 2024-09-19T05:37:16.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 42691 9.74 MB/sec execute 31 sec latency 73.020 ms 2024-09-19T05:37:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:37:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:37:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:37:17.252 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:16 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:37:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:37:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:37:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:37:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:16 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:37:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:37:17.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:37:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:37:17.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:16 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:37:17.634 INFO:tasks.workunit.client.0.smithi001.stdout: 10 42951 9.86 MB/sec execute 32 sec latency 63.382 ms 2024-09-19T05:37:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:17 smithi060 ceph-mon[35058]: pgmap v834: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-09-19T05:37:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:17 smithi082 ceph-mon[35195]: pgmap v834: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-09-19T05:37:18.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:17 smithi001 ceph-mon[30968]: pgmap v834: 129 pgs: 129 active+clean; 447 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 229 op/s 2024-09-19T05:37:18.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 43238 9.84 MB/sec execute 33 sec latency 72.080 ms 2024-09-19T05:37:19.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 43606 10.04 MB/sec execute 34 sec latency 101.983 ms 2024-09-19T05:37:20.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:19 smithi060 ceph-mon[35058]: pgmap v835: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-19T05:37:20.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:19 smithi082 ceph-mon[35195]: pgmap v835: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-19T05:37:20.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:19 smithi001 ceph-mon[30968]: pgmap v835: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2024-09-19T05:37:20.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 44178 10.41 MB/sec execute 35 sec latency 80.994 ms 2024-09-19T05:37:21.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 44859 10.99 MB/sec execute 36 sec latency 36.631 ms 2024-09-19T05:37:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:21 smithi060 ceph-mon[35058]: pgmap v836: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:37:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:21 smithi082 ceph-mon[35195]: pgmap v836: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:37:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:21 smithi001 ceph-mon[30968]: pgmap v836: 129 pgs: 129 active+clean; 441 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 260 op/s 2024-09-19T05:37:22.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 45607 12.12 MB/sec execute 37 sec latency 47.372 ms 2024-09-19T05:37:23.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 46120 12.80 MB/sec execute 38 sec latency 45.820 ms 2024-09-19T05:37:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:23 smithi060 ceph-mon[35058]: pgmap v837: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 279 op/s 2024-09-19T05:37:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:23 smithi082 ceph-mon[35195]: pgmap v837: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 279 op/s 2024-09-19T05:37:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:23 smithi001 ceph-mon[30968]: pgmap v837: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.7 MiB/s wr, 279 op/s 2024-09-19T05:37:24.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 46430 12.89 MB/sec execute 39 sec latency 74.712 ms 2024-09-19T05:37:25.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 46713 12.79 MB/sec execute 40 sec latency 77.806 ms 2024-09-19T05:37:26.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:25 smithi060 ceph-mon[35058]: pgmap v838: 129 pgs: 129 active+clean; 454 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.8 MiB/s wr, 286 op/s 2024-09-19T05:37:26.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:25 smithi082 ceph-mon[35195]: pgmap v838: 129 pgs: 129 active+clean; 454 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.8 MiB/s wr, 286 op/s 2024-09-19T05:37:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:25 smithi001 ceph-mon[30968]: pgmap v838: 129 pgs: 129 active+clean; 454 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.8 MiB/s wr, 286 op/s 2024-09-19T05:37:26.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 47119 12.98 MB/sec execute 41 sec latency 107.026 ms 2024-09-19T05:37:27.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 47731 13.25 MB/sec execute 42 sec latency 53.538 ms 2024-09-19T05:37:28.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:27 smithi060 ceph-mon[35058]: pgmap v839: 129 pgs: 129 active+clean; 457 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.0 MiB/s wr, 301 op/s 2024-09-19T05:37:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:27 smithi082 ceph-mon[35195]: pgmap v839: 129 pgs: 129 active+clean; 457 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.0 MiB/s wr, 301 op/s 2024-09-19T05:37:28.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:27 smithi001 ceph-mon[30968]: pgmap v839: 129 pgs: 129 active+clean; 457 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.0 MiB/s wr, 301 op/s 2024-09-19T05:37:28.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 48392 13.76 MB/sec execute 43 sec latency 58.823 ms 2024-09-19T05:37:29.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 49091 14.44 MB/sec execute 44 sec latency 47.311 ms 2024-09-19T05:37:30.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:29 smithi060 ceph-mon[35058]: pgmap v840: 129 pgs: 129 active+clean; 466 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.2 MiB/s wr, 309 op/s 2024-09-19T05:37:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:29 smithi082 ceph-mon[35195]: pgmap v840: 129 pgs: 129 active+clean; 466 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.2 MiB/s wr, 309 op/s 2024-09-19T05:37:30.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:29 smithi001 ceph-mon[30968]: pgmap v840: 129 pgs: 129 active+clean; 466 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.2 MiB/s wr, 309 op/s 2024-09-19T05:37:30.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 49558 14.97 MB/sec execute 45 sec latency 48.802 ms 2024-09-19T05:37:31.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 49885 14.99 MB/sec execute 46 sec latency 118.286 ms 2024-09-19T05:37:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:31 smithi060 ceph-mon[35058]: pgmap v841: 129 pgs: 129 active+clean; 467 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 243 op/s 2024-09-19T05:37:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:31 smithi082 ceph-mon[35195]: pgmap v841: 129 pgs: 129 active+clean; 467 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 243 op/s 2024-09-19T05:37:32.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:31 smithi001 ceph-mon[30968]: pgmap v841: 129 pgs: 129 active+clean; 467 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.7 MiB/s wr, 243 op/s 2024-09-19T05:37:32.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 50141 14.87 MB/sec execute 47 sec latency 92.116 ms 2024-09-19T05:37:33.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 50493 14.89 MB/sec execute 48 sec latency 101.532 ms 2024-09-19T05:37:34.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:33 smithi060 ceph-mon[35058]: pgmap v842: 129 pgs: 129 active+clean; 473 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-09-19T05:37:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:33 smithi082 ceph-mon[35195]: pgmap v842: 129 pgs: 129 active+clean; 473 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-09-19T05:37:34.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:33 smithi001 ceph-mon[30968]: pgmap v842: 129 pgs: 129 active+clean; 473 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-09-19T05:37:34.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 51049 15.16 MB/sec execute 49 sec latency 44.863 ms 2024-09-19T05:37:35.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 51720 15.28 MB/sec execute 50 sec latency 63.615 ms 2024-09-19T05:37:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:35 smithi060 ceph-mon[35058]: pgmap v843: 129 pgs: 129 active+clean; 475 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:37:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:35 smithi082 ceph-mon[35195]: pgmap v843: 129 pgs: 129 active+clean; 475 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:37:36.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:35 smithi001 ceph-mon[30968]: pgmap v843: 129 pgs: 129 active+clean; 475 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:37:36.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 52414 15.94 MB/sec execute 51 sec latency 37.781 ms 2024-09-19T05:37:37.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 52884 16.30 MB/sec execute 52 sec latency 91.165 ms 2024-09-19T05:37:38.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:37 smithi060 ceph-mon[35058]: pgmap v844: 129 pgs: 129 active+clean; 462 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 209 op/s 2024-09-19T05:37:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:37 smithi082 ceph-mon[35195]: pgmap v844: 129 pgs: 129 active+clean; 462 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 209 op/s 2024-09-19T05:37:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:37 smithi001 ceph-mon[30968]: pgmap v844: 129 pgs: 129 active+clean; 462 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.5 MiB/s wr, 209 op/s 2024-09-19T05:37:38.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 53270 16.45 MB/sec execute 53 sec latency 67.230 ms 2024-09-19T05:37:39.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 53584 16.38 MB/sec execute 54 sec latency 105.951 ms 2024-09-19T05:37:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:39 smithi060 ceph-mon[35058]: pgmap v845: 129 pgs: 129 active+clean; 464 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-19T05:37:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:39 smithi082 ceph-mon[35195]: pgmap v845: 129 pgs: 129 active+clean; 464 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-19T05:37:40.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:39 smithi001 ceph-mon[30968]: pgmap v845: 129 pgs: 129 active+clean; 464 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-19T05:37:40.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 53880 16.31 MB/sec execute 55 sec latency 102.552 ms 2024-09-19T05:37:41.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 54356 16.41 MB/sec execute 56 sec latency 90.567 ms 2024-09-19T05:37:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:41 smithi060 ceph-mon[35058]: pgmap v846: 129 pgs: 129 active+clean; 464 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 196 op/s 2024-09-19T05:37:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:41 smithi082 ceph-mon[35195]: pgmap v846: 129 pgs: 129 active+clean; 464 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 196 op/s 2024-09-19T05:37:42.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:41 smithi001 ceph-mon[30968]: pgmap v846: 129 pgs: 129 active+clean; 464 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 196 op/s 2024-09-19T05:37:42.635 INFO:tasks.workunit.client.0.smithi001.stdout: 10 54693 16.37 MB/sec execute 57 sec latency 193.061 ms 2024-09-19T05:37:43.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 55214 16.46 MB/sec execute 58 sec latency 140.149 ms 2024-09-19T05:37:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:43 smithi060 ceph-mon[35058]: pgmap v847: 129 pgs: 129 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-19T05:37:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:43 smithi082 ceph-mon[35195]: pgmap v847: 129 pgs: 129 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-19T05:37:44.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:43 smithi001 ceph-mon[30968]: pgmap v847: 129 pgs: 129 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 284 op/s 2024-09-19T05:37:44.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 55869 16.95 MB/sec execute 59 sec latency 79.015 ms 2024-09-19T05:37:45.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 56418 17.29 MB/sec execute 60 sec latency 73.690 ms 2024-09-19T05:37:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:45 smithi001 ceph-mon[30968]: pgmap v848: 129 pgs: 129 active+clean; 474 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 248 op/s 2024-09-19T05:37:46.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:45 smithi060 ceph-mon[35058]: pgmap v848: 129 pgs: 129 active+clean; 474 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 248 op/s 2024-09-19T05:37:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:45 smithi082 ceph-mon[35195]: pgmap v848: 129 pgs: 129 active+clean; 474 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 248 op/s 2024-09-19T05:37:46.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 56814 17.41 MB/sec execute 61 sec latency 65.396 ms 2024-09-19T05:37:47.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 57023 17.29 MB/sec execute 62 sec latency 286.017 ms 2024-09-19T05:37:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:47 smithi060 ceph-mon[35058]: pgmap v849: 129 pgs: 129 active+clean; 479 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-09-19T05:37:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:47 smithi082 ceph-mon[35195]: pgmap v849: 129 pgs: 129 active+clean; 479 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-09-19T05:37:48.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:47 smithi001 ceph-mon[30968]: pgmap v849: 129 pgs: 129 active+clean; 479 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 295 op/s 2024-09-19T05:37:48.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 57232 17.12 MB/sec execute 63 sec latency 288.247 ms 2024-09-19T05:37:49.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 57595 17.11 MB/sec execute 64 sec latency 72.046 ms 2024-09-19T05:37:50.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:49 smithi060 ceph-mon[35058]: pgmap v850: 129 pgs: 129 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.0 MiB/s wr, 337 op/s 2024-09-19T05:37:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:49 smithi082 ceph-mon[35195]: pgmap v850: 129 pgs: 129 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.0 MiB/s wr, 337 op/s 2024-09-19T05:37:50.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:49 smithi001 ceph-mon[30968]: pgmap v850: 129 pgs: 129 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.0 MiB/s wr, 337 op/s 2024-09-19T05:37:50.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 58185 17.27 MB/sec execute 65 sec latency 63.671 ms 2024-09-19T05:37:51.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 58767 17.41 MB/sec execute 66 sec latency 50.605 ms 2024-09-19T05:37:52.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:51 smithi060 ceph-mon[35058]: pgmap v851: 129 pgs: 129 active+clean; 483 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.5 MiB/s wr, 277 op/s 2024-09-19T05:37:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:51 smithi082 ceph-mon[35195]: pgmap v851: 129 pgs: 129 active+clean; 483 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.5 MiB/s wr, 277 op/s 2024-09-19T05:37:52.343 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:51 smithi001 ceph-mon[30968]: pgmap v851: 129 pgs: 129 active+clean; 483 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.5 MiB/s wr, 277 op/s 2024-09-19T05:37:52.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 59311 17.72 MB/sec execute 67 sec latency 253.722 ms 2024-09-19T05:37:53.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 59693 17.72 MB/sec execute 68 sec latency 172.454 ms 2024-09-19T05:37:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:53 smithi060 ceph-mon[35058]: pgmap v852: 129 pgs: 129 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.4 MiB/s wr, 376 op/s 2024-09-19T05:37:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:53 smithi082 ceph-mon[35195]: pgmap v852: 129 pgs: 129 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.4 MiB/s wr, 376 op/s 2024-09-19T05:37:54.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:53 smithi001 ceph-mon[30968]: pgmap v852: 129 pgs: 129 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 7.4 MiB/s wr, 376 op/s 2024-09-19T05:37:54.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 60164 18.03 MB/sec execute 69 sec latency 45.255 ms 2024-09-19T05:37:55.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 60543 18.00 MB/sec execute 70 sec latency 59.666 ms 2024-09-19T05:37:56.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:55 smithi060 ceph-mon[35058]: pgmap v853: 129 pgs: 129 active+clean; 462 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 302 op/s 2024-09-19T05:37:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:55 smithi082 ceph-mon[35195]: pgmap v853: 129 pgs: 129 active+clean; 462 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 302 op/s 2024-09-19T05:37:56.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:55 smithi001 ceph-mon[30968]: pgmap v853: 129 pgs: 129 active+clean; 462 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 302 op/s 2024-09-19T05:37:56.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 60854 17.94 MB/sec execute 71 sec latency 115.374 ms 2024-09-19T05:37:57.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 61237 17.97 MB/sec execute 72 sec latency 189.625 ms 2024-09-19T05:37:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:57 smithi060 ceph-mon[35058]: pgmap v854: 129 pgs: 129 active+clean; 464 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 393 op/s 2024-09-19T05:37:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:57 smithi082 ceph-mon[35195]: pgmap v854: 129 pgs: 129 active+clean; 464 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 393 op/s 2024-09-19T05:37:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:57 smithi001 ceph-mon[30968]: pgmap v854: 129 pgs: 129 active+clean; 464 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.3 MiB/s wr, 393 op/s 2024-09-19T05:37:58.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 61690 17.93 MB/sec execute 73 sec latency 221.003 ms 2024-09-19T05:37:59.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 62273 18.07 MB/sec execute 74 sec latency 73.109 ms 2024-09-19T05:38:00.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:37:59 smithi060 ceph-mon[35058]: pgmap v855: 129 pgs: 129 active+clean; 465 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 381 op/s 2024-09-19T05:38:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:37:59 smithi082 ceph-mon[35195]: pgmap v855: 129 pgs: 129 active+clean; 465 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 381 op/s 2024-09-19T05:38:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:37:59 smithi001 ceph-mon[30968]: pgmap v855: 129 pgs: 129 active+clean; 465 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.0 MiB/s wr, 381 op/s 2024-09-19T05:38:00.636 INFO:tasks.workunit.client.0.smithi001.stdout: 10 62990 18.43 MB/sec execute 75 sec latency 39.520 ms 2024-09-19T05:38:01.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 63525 18.72 MB/sec execute 76 sec latency 53.487 ms 2024-09-19T05:38:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:01 smithi060 ceph-mon[35058]: pgmap v856: 129 pgs: 129 active+clean; 468 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-19T05:38:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:01 smithi082 ceph-mon[35195]: pgmap v856: 129 pgs: 129 active+clean; 468 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-19T05:38:02.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:01 smithi001 ceph-mon[30968]: pgmap v856: 129 pgs: 129 active+clean; 468 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-19T05:38:02.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 63928 18.78 MB/sec execute 77 sec latency 66.912 ms 2024-09-19T05:38:03.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:03 smithi001 ceph-mon[30968]: pgmap v857: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.2 MiB/s wr, 426 op/s 2024-09-19T05:38:03.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:03 smithi060 ceph-mon[35058]: pgmap v857: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.2 MiB/s wr, 426 op/s 2024-09-19T05:38:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:03 smithi082 ceph-mon[35195]: pgmap v857: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.2 MiB/s wr, 426 op/s 2024-09-19T05:38:03.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 64145 18.66 MB/sec execute 78 sec latency 187.983 ms 2024-09-19T05:38:04.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 64377 18.54 MB/sec execute 79 sec latency 80.903 ms 2024-09-19T05:38:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:05 smithi060 ceph-mon[35058]: pgmap v858: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-09-19T05:38:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:05 smithi082 ceph-mon[35195]: pgmap v858: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-09-19T05:38:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:05 smithi001 ceph-mon[30968]: pgmap v858: 129 pgs: 129 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 332 op/s 2024-09-19T05:38:05.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 64798 18.59 MB/sec execute 80 sec latency 58.678 ms 2024-09-19T05:38:06.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 65276 18.59 MB/sec execute 81 sec latency 97.085 ms 2024-09-19T05:38:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:07 smithi060 ceph-mon[35058]: pgmap v859: 129 pgs: 129 active+clean; 470 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:38:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:07 smithi082 ceph-mon[35195]: pgmap v859: 129 pgs: 129 active+clean; 470 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:38:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:07 smithi001 ceph-mon[30968]: pgmap v859: 129 pgs: 129 active+clean; 470 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:38:07.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 65866 18.67 MB/sec execute 82 sec latency 82.546 ms 2024-09-19T05:38:08.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 66262 18.74 MB/sec execute 83 sec latency 239.480 ms 2024-09-19T05:38:09.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:09 smithi060 ceph-mon[35058]: pgmap v860: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 359 op/s 2024-09-19T05:38:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:09 smithi082 ceph-mon[35195]: pgmap v860: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 359 op/s 2024-09-19T05:38:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:09 smithi001 ceph-mon[30968]: pgmap v860: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 359 op/s 2024-09-19T05:38:09.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 66695 18.90 MB/sec execute 84 sec latency 66.972 ms 2024-09-19T05:38:10.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 67194 19.04 MB/sec execute 85 sec latency 50.662 ms 2024-09-19T05:38:11.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:11 smithi060 ceph-mon[35058]: pgmap v861: 129 pgs: 129 active+clean; 468 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 366 op/s 2024-09-19T05:38:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:11 smithi082 ceph-mon[35195]: pgmap v861: 129 pgs: 129 active+clean; 468 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 366 op/s 2024-09-19T05:38:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:11 smithi001 ceph-mon[30968]: pgmap v861: 129 pgs: 129 active+clean; 468 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 366 op/s 2024-09-19T05:38:11.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 67513 19.05 MB/sec execute 86 sec latency 117.304 ms 2024-09-19T05:38:12.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 67835 18.98 MB/sec execute 87 sec latency 116.994 ms 2024-09-19T05:38:13.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:13 smithi060 ceph-mon[35058]: pgmap v862: 129 pgs: 129 active+clean; 459 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.2 MiB/s wr, 393 op/s 2024-09-19T05:38:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:13 smithi082 ceph-mon[35195]: pgmap v862: 129 pgs: 129 active+clean; 459 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.2 MiB/s wr, 393 op/s 2024-09-19T05:38:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:13 smithi001 ceph-mon[30968]: pgmap v862: 129 pgs: 129 active+clean; 459 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.2 MiB/s wr, 393 op/s 2024-09-19T05:38:13.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 68097 18.93 MB/sec execute 88 sec latency 391.634 ms 2024-09-19T05:38:14.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 68318 18.80 MB/sec execute 89 sec latency 373.932 ms 2024-09-19T05:38:15.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:15 smithi060 ceph-mon[35058]: pgmap v863: 129 pgs: 129 active+clean; 462 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 338 op/s 2024-09-19T05:38:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:15 smithi082 ceph-mon[35195]: pgmap v863: 129 pgs: 129 active+clean; 462 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 338 op/s 2024-09-19T05:38:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:15 smithi001 ceph-mon[30968]: pgmap v863: 129 pgs: 129 active+clean; 462 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.3 MiB/s wr, 338 op/s 2024-09-19T05:38:15.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 68897 18.87 MB/sec execute 90 sec latency 71.213 ms 2024-09-19T05:38:16.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 69514 19.05 MB/sec execute 91 sec latency 76.831 ms 2024-09-19T05:38:17.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:17 smithi060 ceph-mon[35058]: pgmap v864: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 478 op/s 2024-09-19T05:38:17.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:17 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:38:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:17 smithi082 ceph-mon[35195]: pgmap v864: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 478 op/s 2024-09-19T05:38:17.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:17 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:38:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:17 smithi001 ceph-mon[30968]: pgmap v864: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.0 MiB/s wr, 478 op/s 2024-09-19T05:38:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:17 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:38:17.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 70120 19.24 MB/sec execute 92 sec latency 100.687 ms 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:38:18.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:38:18.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:38:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:38:18.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi060 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi001 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:38:18.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:38:18.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 70431 19.29 MB/sec execute 93 sec latency 310.579 ms 2024-09-19T05:38:19.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 70757 19.27 MB/sec execute 94 sec latency 69.336 ms 2024-09-19T05:38:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:19 smithi001 ceph-mon[30968]: pgmap v865: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 534 op/s 2024-09-19T05:38:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:19 smithi060 ceph-mon[35058]: pgmap v865: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 534 op/s 2024-09-19T05:38:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:19 smithi082 ceph-mon[35195]: pgmap v865: 129 pgs: 129 active+clean; 464 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 534 op/s 2024-09-19T05:38:20.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 71086 19.27 MB/sec execute 95 sec latency 80.564 ms 2024-09-19T05:38:21.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 71410 19.19 MB/sec execute 96 sec latency 106.188 ms 2024-09-19T05:38:21.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:21 smithi001 ceph-mon[30968]: pgmap v866: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 504 op/s 2024-09-19T05:38:22.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:21 smithi060 ceph-mon[35058]: pgmap v866: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 504 op/s 2024-09-19T05:38:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:21 smithi082 ceph-mon[35195]: pgmap v866: 129 pgs: 129 active+clean; 471 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.6 MiB/s wr, 504 op/s 2024-09-19T05:38:22.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 71841 19.20 MB/sec execute 97 sec latency 62.071 ms 2024-09-19T05:38:23.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 72146 19.16 MB/sec execute 98 sec latency 287.766 ms 2024-09-19T05:38:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:23 smithi001 ceph-mon[30968]: pgmap v867: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.9 MiB/s wr, 528 op/s 2024-09-19T05:38:24.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:23 smithi060 ceph-mon[35058]: pgmap v867: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.9 MiB/s wr, 528 op/s 2024-09-19T05:38:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:23 smithi082 ceph-mon[35195]: pgmap v867: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.9 MiB/s wr, 528 op/s 2024-09-19T05:38:24.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 72647 19.17 MB/sec execute 99 sec latency 82.405 ms 2024-09-19T05:38:25.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 73260 19.40 MB/sec execute 100 sec latency 45.709 ms 2024-09-19T05:38:25.802 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:25 smithi060 ceph-mon[35058]: pgmap v868: 129 pgs: 129 active+clean; 461 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 477 op/s 2024-09-19T05:38:25.809 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:25 smithi082 ceph-mon[35195]: pgmap v868: 129 pgs: 129 active+clean; 461 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 477 op/s 2024-09-19T05:38:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:25 smithi001 ceph-mon[30968]: pgmap v868: 129 pgs: 129 active+clean; 461 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 477 op/s 2024-09-19T05:38:26.637 INFO:tasks.workunit.client.0.smithi001.stdout: 10 73873 19.56 MB/sec execute 101 sec latency 59.297 ms 2024-09-19T05:38:27.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 74317 19.63 MB/sec execute 102 sec latency 64.776 ms 2024-09-19T05:38:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:27 smithi001 ceph-mon[30968]: pgmap v869: 129 pgs: 129 active+clean; 454 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.6 MiB/s wr, 534 op/s 2024-09-19T05:38:28.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:27 smithi060 ceph-mon[35058]: pgmap v869: 129 pgs: 129 active+clean; 454 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.6 MiB/s wr, 534 op/s 2024-09-19T05:38:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:27 smithi082 ceph-mon[35195]: pgmap v869: 129 pgs: 129 active+clean; 454 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.6 MiB/s wr, 534 op/s 2024-09-19T05:38:28.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 74589 19.62 MB/sec execute 103 sec latency 171.961 ms 2024-09-19T05:38:29.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 74913 19.54 MB/sec execute 104 sec latency 128.636 ms 2024-09-19T05:38:29.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:29 smithi001 ceph-mon[30968]: pgmap v870: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.9 MiB/s wr, 459 op/s 2024-09-19T05:38:30.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:29 smithi060 ceph-mon[35058]: pgmap v870: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.9 MiB/s wr, 459 op/s 2024-09-19T05:38:30.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:29 smithi082 ceph-mon[35195]: pgmap v870: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.9 MiB/s wr, 459 op/s 2024-09-19T05:38:30.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 75288 19.52 MB/sec execute 105 sec latency 97.826 ms 2024-09-19T05:38:31.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 75826 19.56 MB/sec execute 106 sec latency 60.215 ms 2024-09-19T05:38:31.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:31 smithi001 ceph-mon[30968]: pgmap v871: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 363 op/s 2024-09-19T05:38:32.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:31 smithi060 ceph-mon[35058]: pgmap v871: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 363 op/s 2024-09-19T05:38:32.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:31 smithi082 ceph-mon[35195]: pgmap v871: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.5 MiB/s wr, 363 op/s 2024-09-19T05:38:32.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 76321 19.58 MB/sec execute 107 sec latency 165.260 ms 2024-09-19T05:38:33.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 76756 19.73 MB/sec execute 108 sec latency 302.863 ms 2024-09-19T05:38:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:33 smithi001 ceph-mon[30968]: pgmap v872: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.5 MiB/s wr, 410 op/s 2024-09-19T05:38:34.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:33 smithi060 ceph-mon[35058]: pgmap v872: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.5 MiB/s wr, 410 op/s 2024-09-19T05:38:34.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:33 smithi082 ceph-mon[35195]: pgmap v872: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 7.5 MiB/s wr, 410 op/s 2024-09-19T05:38:34.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 77170 19.73 MB/sec execute 109 sec latency 328.218 ms 2024-09-19T05:38:35.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 77673 19.82 MB/sec execute 110 sec latency 59.918 ms 2024-09-19T05:38:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:35 smithi001 ceph-mon[30968]: pgmap v873: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:38:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:35 smithi060 ceph-mon[35058]: pgmap v873: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:38:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:35 smithi082 ceph-mon[35195]: pgmap v873: 129 pgs: 129 active+clean; 466 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.4 MiB/s wr, 334 op/s 2024-09-19T05:38:36.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 78102 19.87 MB/sec execute 111 sec latency 60.914 ms 2024-09-19T05:38:37.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 78453 19.85 MB/sec execute 112 sec latency 112.245 ms 2024-09-19T05:38:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:37 smithi001 ceph-mon[30968]: pgmap v874: 129 pgs: 129 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 390 op/s 2024-09-19T05:38:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:37 smithi060 ceph-mon[35058]: pgmap v874: 129 pgs: 129 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 390 op/s 2024-09-19T05:38:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:37 smithi082 ceph-mon[35195]: pgmap v874: 129 pgs: 129 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 390 op/s 2024-09-19T05:38:38.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 78757 19.81 MB/sec execute 113 sec latency 199.565 ms 2024-09-19T05:38:39.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 79143 19.84 MB/sec execute 114 sec latency 216.491 ms 2024-09-19T05:38:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:39 smithi001 ceph-mon[30968]: pgmap v875: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 365 op/s 2024-09-19T05:38:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:39 smithi060 ceph-mon[35058]: pgmap v875: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 365 op/s 2024-09-19T05:38:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:39 smithi082 ceph-mon[35195]: pgmap v875: 129 pgs: 129 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 365 op/s 2024-09-19T05:38:40.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 79721 19.83 MB/sec execute 115 sec latency 71.025 ms 2024-09-19T05:38:41.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 80293 19.99 MB/sec execute 116 sec latency 60.390 ms 2024-09-19T05:38:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:41 smithi001 ceph-mon[30968]: pgmap v876: 129 pgs: 129 active+clean; 475 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.9 MiB/s wr, 333 op/s 2024-09-19T05:38:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:41 smithi060 ceph-mon[35058]: pgmap v876: 129 pgs: 129 active+clean; 475 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.9 MiB/s wr, 333 op/s 2024-09-19T05:38:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:41 smithi082 ceph-mon[35195]: pgmap v876: 129 pgs: 129 active+clean; 475 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.9 MiB/s wr, 333 op/s 2024-09-19T05:38:42.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 80913 20.14 MB/sec execute 117 sec latency 76.759 ms 2024-09-19T05:38:43.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 81323 20.17 MB/sec execute 118 sec latency 111.865 ms 2024-09-19T05:38:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:43 smithi001 ceph-mon[30968]: pgmap v877: 129 pgs: 129 active+clean; 462 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 403 op/s 2024-09-19T05:38:44.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:43 smithi060 ceph-mon[35058]: pgmap v877: 129 pgs: 129 active+clean; 462 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 403 op/s 2024-09-19T05:38:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:43 smithi082 ceph-mon[35195]: pgmap v877: 129 pgs: 129 active+clean; 462 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 403 op/s 2024-09-19T05:38:44.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 81572 20.12 MB/sec execute 119 sec latency 190.571 ms 2024-09-19T05:38:45.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 81929 20.09 MB/sec execute 120 sec latency 88.352 ms 2024-09-19T05:38:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:45 smithi001 ceph-mon[30968]: pgmap v878: 129 pgs: 129 active+clean; 450 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-19T05:38:46.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:45 smithi060 ceph-mon[35058]: pgmap v878: 129 pgs: 129 active+clean; 450 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-19T05:38:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:45 smithi082 ceph-mon[35195]: pgmap v878: 129 pgs: 129 active+clean; 450 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-19T05:38:46.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 82271 20.07 MB/sec execute 121 sec latency 83.394 ms 2024-09-19T05:38:47.638 INFO:tasks.workunit.client.0.smithi001.stdout: 10 82751 20.09 MB/sec execute 122 sec latency 77.983 ms 2024-09-19T05:38:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:47 smithi001 ceph-mon[30968]: pgmap v879: 129 pgs: 129 active+clean; 453 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-09-19T05:38:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:47 smithi060 ceph-mon[35058]: pgmap v879: 129 pgs: 129 active+clean; 453 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-09-19T05:38:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:47 smithi082 ceph-mon[35195]: pgmap v879: 129 pgs: 129 active+clean; 453 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-09-19T05:38:48.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 83323 20.11 MB/sec execute 123 sec latency 79.087 ms 2024-09-19T05:38:49.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 83568 20.03 MB/sec execute 124 sec latency 361.254 ms 2024-09-19T05:38:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:49 smithi001 ceph-mon[30968]: pgmap v880: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.4 MiB/s wr, 363 op/s 2024-09-19T05:38:50.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:49 smithi060 ceph-mon[35058]: pgmap v880: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.4 MiB/s wr, 363 op/s 2024-09-19T05:38:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:49 smithi082 ceph-mon[35195]: pgmap v880: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.4 MiB/s wr, 363 op/s 2024-09-19T05:38:50.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 84169 20.21 MB/sec execute 125 sec latency 52.461 ms 2024-09-19T05:38:51.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 84672 20.29 MB/sec execute 126 sec latency 114.058 ms 2024-09-19T05:38:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:51 smithi001 ceph-mon[30968]: pgmap v881: 129 pgs: 129 active+clean; 458 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-09-19T05:38:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:51 smithi060 ceph-mon[35058]: pgmap v881: 129 pgs: 129 active+clean; 458 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-09-19T05:38:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:51 smithi082 ceph-mon[35195]: pgmap v881: 129 pgs: 129 active+clean; 458 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.3 MiB/s wr, 310 op/s 2024-09-19T05:38:52.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 85081 20.35 MB/sec execute 127 sec latency 72.613 ms 2024-09-19T05:38:53.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 85439 20.32 MB/sec execute 128 sec latency 79.034 ms 2024-09-19T05:38:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:53 smithi001 ceph-mon[30968]: pgmap v882: 129 pgs: 129 active+clean; 465 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.7 MiB/s wr, 384 op/s 2024-09-19T05:38:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:53 smithi060 ceph-mon[35058]: pgmap v882: 129 pgs: 129 active+clean; 465 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.7 MiB/s wr, 384 op/s 2024-09-19T05:38:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:53 smithi082 ceph-mon[35195]: pgmap v882: 129 pgs: 129 active+clean; 465 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.7 MiB/s wr, 384 op/s 2024-09-19T05:38:54.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 85611 20.21 MB/sec execute 129 sec latency 226.124 ms 2024-09-19T05:38:55.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 86043 20.21 MB/sec execute 130 sec latency 65.094 ms 2024-09-19T05:38:55.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:55 smithi001 ceph-mon[30968]: pgmap v883: 129 pgs: 129 active+clean; 461 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 316 op/s 2024-09-19T05:38:56.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:55 smithi060 ceph-mon[35058]: pgmap v883: 129 pgs: 129 active+clean; 461 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 316 op/s 2024-09-19T05:38:56.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:55 smithi082 ceph-mon[35195]: pgmap v883: 129 pgs: 129 active+clean; 461 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 316 op/s 2024-09-19T05:38:56.258 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.1 2024-09-19T05:38:56.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:38:56.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:38:56.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 86627 20.25 MB/sec execute 131 sec latency 60.248 ms 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 -- 172.21.15.1:0/672359389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2718102d30 msgr2=0x7f2718103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 --2- 172.21.15.1:0/672359389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2718102d30 0x7f2718103110 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2708009930 tx=0x7f270802a420 comp rx=0 tx=0).stop 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 -- 172.21.15.1:0/672359389 shutdown_connections 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 --2- 172.21.15.1:0/672359389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 --2- 172.21.15.1:0/672359389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27181036e0 0x7f2718107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 --2- 172.21.15.1:0/672359389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2718102d30 0x7f2718103110 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 -- 172.21.15.1:0/672359389 >> 172.21.15.1:0/672359389 conn(0x7f27180fc7d0 msgr2=0x7f27180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 -- 172.21.15.1:0/672359389 shutdown_connections 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.324+0000 7f271e8cd640 1 -- 172.21.15.1:0/672359389 wait complete. 2024-09-19T05:38:57.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 Processor -- start 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 -- start start 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 0x7f27181985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27181036e0 0x7f2718198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f27181120a0 con 0x7f27181036e0 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2718111f20 con 0x7f2718102d30 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271e8cd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2718112220 con 0x7f27181082a0 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f27177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27181036e0 0x7f2718198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f2717fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 0x7f27181985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f2717fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 0x7f27181985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:50932/0 (socket says 172.21.15.1:50932) 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f271ce6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.325+0000 7f2717fff640 1 -- 172.21.15.1:0/2673595747 learned_addr learned my addr 172.21.15.1:0/2673595747 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 -- 172.21.15.1:0/2673595747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 msgr2=0x7f27181985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 0x7f27181985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 -- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27181036e0 msgr2=0x7f2718198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27181036e0 0x7f2718198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 -- 172.21.15.1:0/2673595747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271819d550 con 0x7f27181082a0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271ce6a640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271819ce70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2710009fd0 tx=0x7f271000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271000ce20 con 0x7f27181082a0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27100137d0 con 0x7f27181082a0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27100055e0 con 0x7f27181082a0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271819d840 con 0x7f27181082a0 2024-09-19T05:38:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.326+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27181008c0 con 0x7f27181082a0 2024-09-19T05:38:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.328+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271806a850 con 0x7f27181082a0 2024-09-19T05:38:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.329+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2710013980 con 0x7f27181082a0 2024-09-19T05:38:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.330+0000 7f27157fa640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 0x7f27000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:38:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.330+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f27100d4560 con 0x7f27181082a0 2024-09-19T05:38:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.330+0000 7f2717fff640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 0x7f27000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:38:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.331+0000 7f2717fff640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 0x7f27000a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2708000c00 tx=0x7f2708009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:38:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.333+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27100a0ed0 con 0x7f27181082a0 2024-09-19T05:38:57.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.583+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2718103110 con 0x7f27181082a0 2024-09-19T05:38:57.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.584+0000 7f27157fa640 1 -- 172.21.15.1:0/2673595747 <== mon.1 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f2718103110 con 0x7f27181082a0 2024-09-19T05:38:57.586 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:38:57.586 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:38:57.586 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 msgr2=0x7f27000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 0x7f27000a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2708000c00 tx=0x7f2708009560 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 msgr2=0x7f271819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271819ce70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2710009fd0 tx=0x7f271000ef10 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 shutdown_connections 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f27000a32c0 0x7f27000a5780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27181082a0 0x7f271819ce70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f27181036e0 0x7f2718198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 --2- 172.21.15.1:0/2673595747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2718102d30 0x7f27181985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:38:57.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 >> 172.21.15.1:0/2673595747 conn(0x7f27180fc7d0 msgr2=0x7f2718105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:38:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 shutdown_connections 2024-09-19T05:38:57.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:38:57.586+0000 7f271e8cd640 1 -- 172.21.15.1:0/2673595747 wait complete. 2024-09-19T05:38:57.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 87200 20.34 MB/sec execute 132 sec latency 71.530 ms 2024-09-19T05:38:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:57 smithi001 ceph-mon[30968]: pgmap v884: 129 pgs: 129 active+clean; 468 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.8 MiB/s wr, 390 op/s 2024-09-19T05:38:58.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:57 smithi060 ceph-mon[35058]: pgmap v884: 129 pgs: 129 active+clean; 468 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.8 MiB/s wr, 390 op/s 2024-09-19T05:38:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:57 smithi082 ceph-mon[35195]: pgmap v884: 129 pgs: 129 active+clean; 468 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.8 MiB/s wr, 390 op/s 2024-09-19T05:38:58.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 87830 20.47 MB/sec execute 133 sec latency 50.015 ms 2024-09-19T05:38:58.768 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0' 2024-09-19T05:38:58.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 137.1 --await-for 45.0 2024-09-19T05:38:58.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:58 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2673595747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:38:59.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:58 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2673595747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:38:59.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:58 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2673595747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:38:59.250 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:38:59.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88118 20.47 MB/sec execute 134 sec latency 376.672 ms 2024-09-19T05:38:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:38:59 smithi001 ceph-mon[30968]: pgmap v885: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 375 op/s 2024-09-19T05:39:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:38:59 smithi060 ceph-mon[35058]: pgmap v885: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 375 op/s 2024-09-19T05:39:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:38:59 smithi082 ceph-mon[35195]: pgmap v885: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 375 op/s 2024-09-19T05:39:00.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.592+0000 7fd04f7fe640 1 -- 172.21.15.1:0/4210636965 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400429b0 con 0x7fd050102570 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 -- 172.21.15.1:0/4210636965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102570 msgr2=0x7fd0501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 --2- 172.21.15.1:0/4210636965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102570 0x7fd0501029b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd040009930 tx=0x7fd04003b500 comp rx=0 tx=0).stop 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 -- 172.21.15.1:0/4210636965 shutdown_connections 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 --2- 172.21.15.1:0/4210636965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050102ef0 0x7fd05010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 --2- 172.21.15.1:0/4210636965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102570 0x7fd0501029b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 --2- 172.21.15.1:0/4210636965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050100e20 0x7fd050101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 -- 172.21.15.1:0/4210636965 >> 172.21.15.1:0/4210636965 conn(0x7fd0500fc7d0 msgr2=0x7fd0500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.593+0000 7fd056ab7640 1 -- 172.21.15.1:0/4210636965 shutdown_connections 2024-09-19T05:39:00.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.594+0000 7fd056ab7640 1 -- 172.21.15.1:0/4210636965 wait complete. 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 Processor -- start 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 -- start start 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 0x7fd050073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 0x7fd05006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102ef0 0x7fd05006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd05006d440 con 0x7fd050102570 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd05006d2c0 con 0x7fd050100e20 2024-09-19T05:39:00.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.595+0000 7fd056ab7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd05006d5c0 con 0x7fd050102ef0 2024-09-19T05:39:00.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.598+0000 7fd054853640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 0x7fd050073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.598+0000 7fd055054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102ef0 0x7fd05006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.598+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 0x7fd05006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.598+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 0x7fd05006eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37054/0 (socket says 172.21.15.1:37054) 2024-09-19T05:39:00.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.598+0000 7fd04ffff640 1 -- 172.21.15.1:0/3711219076 learned_addr learned my addr 172.21.15.1:0/3711219076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:00.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 -- 172.21.15.1:0/3711219076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102ef0 msgr2=0x7fd05006f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102ef0 0x7fd05006f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 -- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 msgr2=0x7fd05006eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 0x7fd05006eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 -- 172.21.15.1:0/3711219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05006f5c0 con 0x7fd050100e20 2024-09-19T05:39:00.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.600+0000 7fd054853640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 0x7fd050073a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e9f0 tx=0x7fd04800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.602+0000 7fd04dffb640 1 -- 172.21.15.1:0/3711219076 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04800cd80 con 0x7fd050100e20 2024-09-19T05:39:00.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.602+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05006f8b0 con 0x7fd050100e20 2024-09-19T05:39:00.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.602+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd050115990 con 0x7fd050100e20 2024-09-19T05:39:00.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.602+0000 7fd04dffb640 1 -- 172.21.15.1:0/3711219076 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048011950 con 0x7fd050100e20 2024-09-19T05:39:00.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.602+0000 7fd04dffb640 1 -- 172.21.15.1:0/3711219076 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480109e0 con 0x7fd050100e20 2024-09-19T05:39:00.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.606+0000 7fd058e90740 1 Processor -- start 2024-09-19T05:39:00.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd04dffb640 1 -- 172.21.15.1:0/3711219076 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd048010cc0 con 0x7fd050100e20 2024-09-19T05:39:00.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 -- start start 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d13400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d15d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ad3c6e2a0 con 0x559ad3d13940 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559ad3c15b10 con 0x559ad3d09080 2024-09-19T05:39:00.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd058e90740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559ad3c6a260 con 0x559ad3d08760 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.610+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d15d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:48980/0 (socket says 172.21.15.1:48980) 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 -- 172.21.15.1:0/1535442242 learned_addr learned my addr 172.21.15.1:0/1535442242 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd054853640 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d13400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 -- 172.21.15.1:0/1535442242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 msgr2=0x559ad3d13400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d13400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 -- 172.21.15.1:0/1535442242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 msgr2=0x559ad3d15d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d15d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.611+0000 7fd055054640 1 -- 172.21.15.1:0/1535442242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ad39dfb90 con 0x559ad3d08760 2024-09-19T05:39:00.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.612+0000 7fd055054640 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd044009c20 tx=0x7fd044011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f41347146b09534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.612+0000 7fd036ffd640 1 -- 172.21.15.1:0/1535442242 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04401e070 con 0x559ad3d08760 2024-09-19T05:39:00.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.612+0000 7fd036ffd640 1 -- 172.21.15.1:0/1535442242 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd044019b10 con 0x559ad3d08760 2024-09-19T05:39:00.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.612+0000 7fd036ffd640 1 -- 172.21.15.1:0/1535442242 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400ea10 con 0x559ad3d08760 2024-09-19T05:39:00.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.614+0000 7fd058e90740 1 -- 172.21.15.1:0/1535442242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 msgr2=0x559ad3d08b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.614+0000 7fd058e90740 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd044009c20 tx=0x7fd044011810 comp rx=0 tx=0).stop 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.614+0000 7fd04dffb640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 0x7fd0380a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.614+0000 7fd04dffb640 1 -- 172.21.15.1:0/3711219076 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd0480cfce0 con 0x7fd050100e20 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.614+0000 7fd055054640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 0x7fd0380a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd058e90740 1 -- 172.21.15.1:0/1535442242 shutdown_connections 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd058e90740 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d15d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd058e90740 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd058e90740 1 --2- 172.21.15.1:0/1535442242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d08b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd058e90740 1 -- 172.21.15.1:0/1535442242 >> 172.21.15.1:0/1535442242 conn(0x559ad3d04cf0 msgr2=0x559ad3d050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.615+0000 7fd055054640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 0x7fd0380a5910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd044009bf0 tx=0x7fd0440099d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.616+0000 7fd058e90740 1 -- 172.21.15.1:0/1535442242 shutdown_connections 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.616+0000 7fd058e90740 1 -- 172.21.15.1:0/1535442242 wait complete. 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 -- start start 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 Processor -- start 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d107a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559ad3d16510 con 0x559ad3d13940 2024-09-19T05:39:00.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559ad3bf66e0 con 0x559ad3d09080 2024-09-19T05:39:00.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559ad3d16690 con 0x559ad3d08760 2024-09-19T05:39:00.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.617+0000 7fd058e90740 10 client.0 _ll_register_callbacks cb 0x559ad3c1aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.619+0000 7fd055054640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.619+0000 7fd055054640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37076/0 (socket says 172.21.15.1:37076) 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.619+0000 7fd055054640 1 -- 172.21.15.1:0/3579029838 learned_addr learned my addr 172.21.15.1:0/3579029838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 -- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 msgr2=0x559ad3d107a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d107a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 -- 172.21.15.1:0/3579029838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 msgr2=0x559ad3d10ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:39:00.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d10ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 -- 172.21.15.1:0/3579029838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ad3d1fa10 con 0x559ad3d13940 2024-09-19T05:39:00.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.620+0000 7fd055054640 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd04401b000 tx=0x7fd044011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3000c1b4c35851dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.621+0000 7fd02ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.622+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04401e050 con 0x559ad3d13940 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.622+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd044019b10 con 0x559ad3d13940 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.622+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd044005500 con 0x559ad3d13940 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.622+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd04402c040 con 0x559ad3d13940 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.623+0000 7fd058e90740 10 client.15888 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:00.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.623+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559ad3d223f0 con 0x559ad3d13940 2024-09-19T05:39:00.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.624+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd044019b10 con 0x559ad3d13940 2024-09-19T05:39:00.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd044038030 con 0x559ad3d13940 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 10 client.15888 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 10 client.15888 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 20 client.15888 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d23bc0 0x559ad3d26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 4 client.15888 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:00.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.626+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ad3c7b9d0 con 0x559ad3d23bc0 2024-09-19T05:39:00.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.628+0000 7fd054853640 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d23bc0 0x559ad3d26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.629+0000 7fd054853640 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d23bc0 0x559ad3d26080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c6b9b4527c86d5 server_cookie=2672c5e1d870426b in_seq=0 out_seq=0 2024-09-19T05:39:00.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.629+0000 7fd02ffff640 10 client.15888 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:00.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.636+0000 7fd02ffff640 1 -- 172.21.15.1:0/3579029838 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ad3c7b9d0 con 0x559ad3d23bc0 2024-09-19T05:39:00.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.636+0000 7fd02ffff640 10 client.15888 handle_command_reply: tid=0 2024-09-19T05:39:00.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.636+0000 7fd058e90740 1 client.15888 shutdown 2024-09-19T05:39:00.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88481 20.48 MB/sec execute 135 sec latency 80.348 ms 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 msgr2=0x559ad3d11220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd04401b000 tx=0x7fd044011810 comp rx=0 tx=0).stop 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 shutdown_connections 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d11220 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d23bc0 0x559ad3d26080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 --2- 172.21.15.1:0/3579029838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 >> 172.21.15.1:0/3579029838 conn(0x559ad3d04cf0 msgr2=0x559ad3d03e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.638+0000 7fd02ffff640 0 client.15888 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.639+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 shutdown_connections 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.639+0000 7fd058e90740 1 -- 172.21.15.1:0/3579029838 wait complete. 2024-09-19T05:39:00.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.639+0000 7fd058e90740 20 client.15888 trim_cache size 0 max 16384 2024-09-19T05:39:00.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.681+0000 7fd058e90740 1 Processor -- start 2024-09-19T05:39:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 -- start start 2024-09-19T05:39:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d12710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d2bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00dc40 con 0x559ad3d13940 2024-09-19T05:39:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c010410 con 0x559ad3d09080 2024-09-19T05:39:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.682+0000 7fd058e90740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00e200 con 0x559ad3d08760 2024-09-19T05:39:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.683+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.683+0000 7fd04ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:50966/0 (socket says 172.21.15.1:50966) 2024-09-19T05:39:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.683+0000 7fd04ffff640 1 -- 172.21.15.1:0/3336218388 learned_addr learned my addr 172.21.15.1:0/3336218388 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd054853640 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd04ffff640 1 -- 172.21.15.1:0/3336218388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 msgr2=0x559ad3d12710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd04ffff640 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d12710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd04ffff640 1 -- 172.21.15.1:0/3336218388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 msgr2=0x559ad3d2bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd04ffff640 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d2bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.684+0000 7fd04ffff640 1 -- 172.21.15.1:0/3336218388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ad3d0f750 con 0x559ad3d09080 2024-09-19T05:39:00.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.685+0000 7fd04ffff640 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd040006010 tx=0x7fd0400040b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fad328fd8f076532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.688+0000 7fd0367fc640 1 -- 172.21.15.1:0/3336218388 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040046030 con 0x559ad3d09080 2024-09-19T05:39:00.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.688+0000 7fd0367fc640 1 -- 172.21.15.1:0/3336218388 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd040050070 con 0x559ad3d09080 2024-09-19T05:39:00.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.688+0000 7fd0367fc640 1 -- 172.21.15.1:0/3336218388 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040004d90 con 0x559ad3d09080 2024-09-19T05:39:00.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.690+0000 7fd058e90740 1 -- 172.21.15.1:0/3336218388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 msgr2=0x559ad3d2b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:00.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.690+0000 7fd058e90740 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd040006010 tx=0x7fd0400040b0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.694+0000 7fd058e90740 1 -- 172.21.15.1:0/3336218388 shutdown_connections 2024-09-19T05:39:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.694+0000 7fd058e90740 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d2bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.694+0000 7fd058e90740 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d2b990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.694+0000 7fd058e90740 1 --2- 172.21.15.1:0/3336218388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d12710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.694+0000 7fd058e90740 1 -- 172.21.15.1:0/3336218388 >> 172.21.15.1:0/3336218388 conn(0x559ad3d04cf0 msgr2=0x559ad3d12000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.697+0000 7fd058e90740 1 -- 172.21.15.1:0/3336218388 shutdown_connections 2024-09-19T05:39:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.699+0000 7fd058e90740 1 -- 172.21.15.1:0/3336218388 wait complete. 2024-09-19T05:39:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.700+0000 7fd058e90740 1 -- start start 2024-09-19T05:39:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.700+0000 7fd058e90740 1 Processor -- start 2024-09-19T05:39:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d17760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d17ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00e8d0 con 0x559ad3d13940 2024-09-19T05:39:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00fd40 con 0x559ad3d09080 2024-09-19T05:39:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c00efa0 con 0x559ad3d08760 2024-09-19T05:39:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd058e90740 10 client.0 _ll_register_callbacks cb 0x7fd044009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd055054640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd055054640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37090/0 (socket says 172.21.15.1:37090) 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.701+0000 7fd055054640 1 -- 172.21.15.1:0/4054554827 learned_addr learned my addr 172.21.15.1:0/4054554827 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.702+0000 7fd055054640 1 -- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 msgr2=0x559ad3d17760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.702+0000 7fd055054640 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d17760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.702+0000 7fd055054640 1 -- 172.21.15.1:0/4054554827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 msgr2=0x559ad3d17ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.702+0000 7fd055054640 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d17ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.702+0000 7fd055054640 1 -- 172.21.15.1:0/4054554827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ad3d08eb0 con 0x559ad3d13940 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.703+0000 7fd055054640 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd04400e730 tx=0x7fd044005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2530e9e6c80cdf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:00.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.704+0000 7fd02ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.704+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04401e040 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.704+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd040050070 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.705+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd0440198c0 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd044019ac0 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 10 client.15891 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559ad3d8ea50 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd040050070 con 0x559ad3d13940 2024-09-19T05:39:00.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd044038070 con 0x559ad3d13940 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 10 client.15891 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 10 client.15891 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 20 client.15891 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d8efa0 0x559ad3d91420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 4 client.15891 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}] 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.706+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.1, "await_for": 45.0}) -- 0x559ad3c75d20 con 0x559ad3d8efa0 2024-09-19T05:39:00.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.708+0000 7fd054853640 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d8efa0 0x559ad3d91420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:00.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.712+0000 7fd02ffff640 10 client.15891 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:00.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:00.712+0000 7fd054853640 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d8efa0 0x559ad3d91420 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1b3e490ebf90862 server_cookie=3634ab699ef143e5 in_seq=0 out_seq=0 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.612+0000 7fd02ffff640 1 -- 172.21.15.1:0/4054554827 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559ad3c75d20 con 0x559ad3d8efa0 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.612+0000 7fd02ffff640 10 client.15891 handle_command_reply: tid=0 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.612+0000 7fd058e90740 1 client.15891 shutdown 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.612+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 msgr2=0x559ad3d181e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.612+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd04400e730 tx=0x7fd044005990 comp rx=0 tx=0).stop 2024-09-19T05:39:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 shutdown_connections 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559ad3d13940 0x559ad3d181e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559ad3d09080 0x559ad3d17ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x559ad3d8efa0 0x559ad3d91420 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 --2- 172.21.15.1:0/4054554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ad3d08760 0x559ad3d17760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 >> 172.21.15.1:0/4054554827 conn(0x559ad3d04cf0 msgr2=0x559ad3d03e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd02ffff640 0 client.15891 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 shutdown_connections 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 1 -- 172.21.15.1:0/4054554827 wait complete. 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.613+0000 7fd058e90740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T05:39:01.616 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 58, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "e05e6b7e": { 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 58, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:39:01.617 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 137.1, 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:01.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:01.619 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:39:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 msgr2=0x7fd0380a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 0x7fd0380a5910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd044009bf0 tx=0x7fd0440099d0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 msgr2=0x7fd050073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 0x7fd050073a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e9f0 tx=0x7fd04800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 shutdown_connections 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd0380a3450 0x7fd0380a5910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd050102ef0 0x7fd05006f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd050102570 0x7fd05006eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 --2- 172.21.15.1:0/3711219076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd050100e20 0x7fd050073a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.614+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 >> 172.21.15.1:0/3711219076 conn(0x7fd0500fc7d0 msgr2=0x7fd0501048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.615+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 shutdown_connections 2024-09-19T05:39:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:01.615+0000 7fd056ab7640 1 -- 172.21.15.1:0/3711219076 wait complete. 2024-09-19T05:39:01.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 20.33 MB/sec execute 136 sec latency 950.823 ms 2024-09-19T05:39:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:01 smithi001 ceph-mon[30968]: pgmap v886: 129 pgs: 129 active+clean; 456 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 307 op/s 2024-09-19T05:39:02.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:01 smithi060 ceph-mon[35058]: pgmap v886: 129 pgs: 129 active+clean; 456 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 307 op/s 2024-09-19T05:39:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:01 smithi082 ceph-mon[35195]: pgmap v886: 129 pgs: 129 active+clean; 456 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 307 op/s 2024-09-19T05:39:02.541 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e05e6b7e', quiesce took 6.3 seconds. Will release after: 10.8 2024-09-19T05:39:02.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 20.18 MB/sec execute 137 sec latency 1950.923 ms 2024-09-19T05:39:03.639 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 20.04 MB/sec execute 138 sec latency 2951.066 ms 2024-09-19T05:39:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:03 smithi001 ceph-mon[30968]: pgmap v887: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 361 op/s 2024-09-19T05:39:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:03 smithi060 ceph-mon[35058]: pgmap v887: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 361 op/s 2024-09-19T05:39:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:03 smithi082 ceph-mon[35195]: pgmap v887: 129 pgs: 129 active+clean; 459 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 7.2 MiB/s wr, 361 op/s 2024-09-19T05:39:04.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.89 MB/sec execute 139 sec latency 3951.175 ms 2024-09-19T05:39:05.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.75 MB/sec execute 140 sec latency 4951.266 ms 2024-09-19T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:05 smithi060 ceph-mon[35058]: pgmap v888: 129 pgs: 129 active+clean; 464 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.8 MiB/s wr, 320 op/s 2024-09-19T05:39:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:05 smithi082 ceph-mon[35195]: pgmap v888: 129 pgs: 129 active+clean; 464 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.8 MiB/s wr, 320 op/s 2024-09-19T05:39:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:05 smithi001 ceph-mon[30968]: pgmap v888: 129 pgs: 129 active+clean; 464 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.8 MiB/s wr, 320 op/s 2024-09-19T05:39:06.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.61 MB/sec execute 141 sec latency 5951.393 ms 2024-09-19T05:39:07.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.47 MB/sec execute 142 sec latency 6951.456 ms 2024-09-19T05:39:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:07 smithi060 ceph-mon[35058]: pgmap v889: 129 pgs: 129 active+clean; 460 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 331 op/s 2024-09-19T05:39:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:07 smithi082 ceph-mon[35195]: pgmap v889: 129 pgs: 129 active+clean; 460 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 331 op/s 2024-09-19T05:39:08.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:07 smithi001 ceph-mon[30968]: pgmap v889: 129 pgs: 129 active+clean; 460 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 331 op/s 2024-09-19T05:39:08.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.34 MB/sec execute 143 sec latency 7951.558 ms 2024-09-19T05:39:09.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.20 MB/sec execute 144 sec latency 8951.663 ms 2024-09-19T05:39:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:09 smithi060 ceph-mon[35058]: pgmap v890: 129 pgs: 129 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 252 op/s 2024-09-19T05:39:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:09 smithi082 ceph-mon[35195]: pgmap v890: 129 pgs: 129 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 252 op/s 2024-09-19T05:39:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:09 smithi001 ceph-mon[30968]: pgmap v890: 129 pgs: 129 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 252 op/s 2024-09-19T05:39:10.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 19.07 MB/sec execute 145 sec latency 9951.773 ms 2024-09-19T05:39:11.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 18.94 MB/sec execute 146 sec latency 10951.899 ms 2024-09-19T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:11 smithi060 ceph-mon[35058]: pgmap v891: 129 pgs: 129 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-09-19T05:39:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:11 smithi082 ceph-mon[35195]: pgmap v891: 129 pgs: 129 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-09-19T05:39:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:11 smithi001 ceph-mon[30968]: pgmap v891: 129 pgs: 129 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-09-19T05:39:12.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 18.81 MB/sec execute 147 sec latency 11951.997 ms 2024-09-19T05:39:13.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:39:13.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 18.68 MB/sec execute 148 sec latency 12952.034 ms 2024-09-19T05:39:13.657 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:39:13.779 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:13 smithi001 ceph-mon[30968]: pgmap v892: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 239 op/s 2024-09-19T05:39:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:13 smithi060 ceph-mon[35058]: pgmap v892: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 239 op/s 2024-09-19T05:39:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:13 smithi082 ceph-mon[35195]: pgmap v892: 129 pgs: 129 active+clean; 462 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 239 op/s 2024-09-19T05:39:14.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.197+0000 7f9100d09640 1 -- 172.21.15.1:0/4070927410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 msgr2=0x7f90fc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:14.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.197+0000 7f9100d09640 1 --2- 172.21.15.1:0/4070927410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc1067f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009900 tx=0x7f90f002a410 comp rx=0 tx=0).stop 2024-09-19T05:39:14.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 -- 172.21.15.1:0/4070927410 shutdown_connections 2024-09-19T05:39:14.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 --2- 172.21.15.1:0/4070927410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 --2- 172.21.15.1:0/4070927410 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc1067f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 --2- 172.21.15.1:0/4070927410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 0x7f90fc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 -- 172.21.15.1:0/4070927410 >> 172.21.15.1:0/4070927410 conn(0x7f90fc0fd8b0 msgr2=0x7f90fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 -- 172.21.15.1:0/4070927410 shutdown_connections 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 -- 172.21.15.1:0/4070927410 wait complete. 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 Processor -- start 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.198+0000 7f9100d09640 1 -- start start 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 0x7f90fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc111f40 con 0x7f90fc1027a0 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc111dc0 con 0x7f90fc106f20 2024-09-19T05:39:14.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f9100d09640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1120c0 con 0x7f90fc101df0 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47032/0 (socket says 172.21.15.1:47032) 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 -- 172.21.15.1:0/4292446515 learned_addr learned my addr 172.21.15.1:0/4292446515 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90fa59c640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 0x7f90fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90fad9d640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 -- 172.21.15.1:0/4292446515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 msgr2=0x7f90fc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 0x7f90fc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 -- 172.21.15.1:0/4292446515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 msgr2=0x7f90fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 -- 172.21.15.1:0/4292446515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc1a6970 con 0x7f90fc1027a0 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90fad9d640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:14.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90f9d9b640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006010 tx=0x7f90f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.199+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f003f030 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.200+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f0003ce0 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.200+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc1a6c00 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.200+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0035070 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.200+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc1a70e0 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.201+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc1021d0 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.202+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f90f0042030 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.202+0000 7f90eb7fe640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.202+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f90f00f01d0 con 0x7f90fc1027a0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.202+0000 7f90fa59c640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.203+0000 7f90fa59c640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 0x7f90e40a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005d00 tx=0x7f90ec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:14.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.207+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f90f00bcc00 con 0x7f90fc1027a0 2024-09-19T05:39:14.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.587+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90fc10a100 con 0x7f90fc1027a0 2024-09-19T05:39:14.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.589+0000 7f90eb7fe640 1 -- 172.21.15.1:0/4292446515 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f90f00bc500 con 0x7f90fc1027a0 2024-09-19T05:39:14.591 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:39:14.591 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:39:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:39:14.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 msgr2=0x7f90e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:14.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 0x7f90e40a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f90ec005d00 tx=0x7f90ec00b410 comp rx=0 tx=0).stop 2024-09-19T05:39:14.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 msgr2=0x7f90fc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:14.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006010 tx=0x7f90f00042f0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 shutdown_connections 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc106f20 0x7f90fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90fc1027a0 0x7f90fc074a30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 --2- 172.21.15.1:0/4292446515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90fc101df0 0x7f90fc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.591+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 >> 172.21.15.1:0/4292446515 conn(0x7f90fc0fd8b0 msgr2=0x7f90fc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.592+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 shutdown_connections 2024-09-19T05:39:14.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:14.592+0000 7f9100d09640 1 -- 172.21.15.1:0/4292446515 wait complete. 2024-09-19T05:39:14.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 18.56 MB/sec execute 149 sec latency 13952.063 ms 2024-09-19T05:39:14.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:14 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4292446515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:15.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:14 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4292446515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:15.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:14 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4292446515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:15.482 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e05e6b7e --release --await' 2024-09-19T05:39:15.483 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e05e6b7e --release --await 2024-09-19T05:39:15.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88499 18.43 MB/sec execute 150 sec latency 14952.117 ms 2024-09-19T05:39:15.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:15 smithi001 ceph-mon[30968]: pgmap v893: 129 pgs: 129 active+clean; 463 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2024-09-19T05:39:15.759 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:39:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:15 smithi060 ceph-mon[35058]: pgmap v893: 129 pgs: 129 active+clean; 463 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2024-09-19T05:39:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:15 smithi082 ceph-mon[35195]: pgmap v893: 129 pgs: 129 active+clean; 463 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2024-09-19T05:39:16.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- 172.21.15.1:0/1051884394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 msgr2=0x7fdc08112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 --2- 172.21.15.1:0/1051884394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc08112650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009900 tx=0x7fdbf802a480 comp rx=0 tx=0).stop 2024-09-19T05:39:16.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- 172.21.15.1:0/1051884394 shutdown_connections 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 --2- 172.21.15.1:0/1051884394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08112b90 0x7fdc08114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 --2- 172.21.15.1:0/1051884394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc08112650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 --2- 172.21.15.1:0/1051884394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08074590 0x7fdc08074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- 172.21.15.1:0/1051884394 >> 172.21.15.1:0/1051884394 conn(0x7fdc080fd8c0 msgr2=0x7fdc080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- 172.21.15.1:0/1051884394 shutdown_connections 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- 172.21.15.1:0/1051884394 wait complete. 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 Processor -- start 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.248+0000 7fdc0f873640 1 -- start start 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08074590 0x7fdc081a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08112b90 0x7fdc0819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc08118540 con 0x7fdc08074eb0 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081183c0 con 0x7fdc08074590 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081186c0 con 0x7fdc08112b90 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47048/0 (socket says 172.21.15.1:47048) 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 -- 172.21.15.1:0/4094532659 learned_addr learned my addr 172.21.15.1:0/4094532659 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0de10640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08112b90 0x7fdc0819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08074590 0x7fdc081a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 -- 172.21.15.1:0/4094532659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08112b90 msgr2=0x7fdc0819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08112b90 0x7fdc0819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 -- 172.21.15.1:0/4094532659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08074590 msgr2=0x7fdc081a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08074590 0x7fdc081a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 -- 172.21.15.1:0/4094532659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0819f070 con 0x7fdc08074eb0 2024-09-19T05:39:16.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8005ab0 tx=0x7fdbf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdbfe7fc640 1 -- 172.21.15.1:0/4094532659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf803f030 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0819f300 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.249+0000 7fdbfe7fc640 1 -- 172.21.15.1:0/4094532659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf8003ce0 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.250+0000 7fdbfe7fc640 1 -- 172.21.15.1:0/4094532659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8035070 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.250+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc081ab650 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdbfe7fc640 1 -- 172.21.15.1:0/4094532659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fdbf8042030 con 0x7fdc08074eb0 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 Processor -- start 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 -- start start 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 0x564a4eba1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564a4eaf9620 con 0x564a4eb94060 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564a4eaa0e50 con 0x564a4eb9f240 2024-09-19T05:39:16.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564a4eaf55e0 con 0x564a4eb94980 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47060/0 (socket says 172.21.15.1:47060) 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc0de10640 1 -- 172.21.15.1:0/3322423531 learned_addr learned my addr 172.21.15.1:0/3322423531 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.253+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 0x564a4eba1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 -- 172.21.15.1:0/3322423531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 msgr2=0x564a4eb9ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 -- 172.21.15.1:0/3322423531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 msgr2=0x564a4eba1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 0x564a4eba1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 -- 172.21.15.1:0/3322423531 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4ea91d40 con 0x564a4eb94060 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 0x564a4eba1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:16.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdbfe7fc640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 0x7fdbf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000ae00 tx=0x7fdc0000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908bbb6cc94f5452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 0x7fdbf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdbfe7fc640 1 -- 172.21.15.1:0/4094532659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fdbf80f05b0 con 0x7fdc08074eb0 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdbf37fe640 1 -- 172.21.15.1:0/3322423531 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0001d070 con 0x564a4eb94060 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdbf37fe640 1 -- 172.21.15.1:0/3322423531 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc00010d20 con 0x564a4eb94060 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.254+0000 7fdbf37fe640 1 -- 172.21.15.1:0/3322423531 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00018da0 con 0x564a4eb94060 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3322423531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 msgr2=0x564a4eb94440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 0x7fdbf40a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x564a4eb91450 tx=0x7fdc0400c480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000ae00 tx=0x7fdc0000f790 comp rx=0 tx=0).stop 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3322423531 shutdown_connections 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb9f240 0x564a4eba1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3322423531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb94060 0x564a4eb94440 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3322423531 >> 172.21.15.1:0/3322423531 conn(0x564a4eb905f0 msgr2=0x564a4eb909d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3322423531 shutdown_connections 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3322423531 wait complete. 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 -- start start 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.255+0000 7fdc11c4c740 1 Processor -- start 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94060 0x564a4eb9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x564a4eba1e10 con 0x564a4eb9f240 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564a4ea81f10 con 0x564a4eb94060 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564a4eba1f90 con 0x564a4eb94980 2024-09-19T05:39:16.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc11c4c740 10 client.0 _ll_register_callbacks cb 0x564a4eaa5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47064/0 (socket says 172.21.15.1:47064) 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 -- 172.21.15.1:0/591707206 learned_addr learned my addr 172.21.15.1:0/591707206 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94060 0x564a4eb9c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 -- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 msgr2=0x564a4eb9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 -- 172.21.15.1:0/591707206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94060 msgr2=0x564a4eb9c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94060 0x564a4eb9c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0de10640 1 -- 172.21.15.1:0/591707206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4e808580 con 0x564a4eb9f240 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.256+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc0de10640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdc00018a20 tx=0x7fdc0000ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d118b7da17594f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00026020 con 0x564a4eb9f240 2024-09-19T05:39:16.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc00010d20 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fdc00003970 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc00031050 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 10 client.15909 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a4e8d2960 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc00010d20 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdc00004200 con 0x564a4eb9f240 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 10 client.15909 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 10 client.15909 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 20 client.15909 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ebaecd0 0x564a4ebb10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 4 client.15909 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.257+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a4eb06b90 con 0x564a4ebaecd0 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.258+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ebaecd0 0x564a4ebb10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.258+0000 7fdbf0ff9640 10 client.15909 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.258+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ebaecd0 0x564a4ebb10c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58661ad1cd679fc server_cookie=f7e7a44eb20dbc43 in_seq=0 out_seq=0 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.259+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/591707206 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a4eb06b90 con 0x564a4ebaecd0 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.259+0000 7fdbf0ff9640 10 client.15909 handle_command_reply: tid=0 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.259+0000 7fdc11c4c740 1 client.15909 shutdown 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.259+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 msgr2=0x564a4eb9cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.259+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdc00018a20 tx=0x7fdc0000ab20 comp rx=0 tx=0).stop 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 shutdown_connections 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb9cac0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ebaecd0 0x564a4ebb10c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94980 0x564a4eb9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/591707206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94060 0x564a4eb9c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 >> 172.21.15.1:0/591707206 conn(0x564a4eb905f0 msgr2=0x564a4eb962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdbf0ff9640 0 client.15909 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 shutdown_connections 2024-09-19T05:39:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 1 -- 172.21.15.1:0/591707206 wait complete. 2024-09-19T05:39:16.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.260+0000 7fdc11c4c740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T05:39:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 Processor -- start 2024-09-19T05:39:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 -- start start 2024-09-19T05:39:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4ebb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4ebb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b33e0 con 0x564a4eb9f240 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b5c60 con 0x564a4eb94980 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b3a50 con 0x564a4eb94060 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47068/0 (socket says 172.21.15.1:47068) 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.277+0000 7fdc0de10640 1 -- 172.21.15.1:0/3652167608 learned_addr learned my addr 172.21.15.1:0/3652167608 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4ebb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4ebb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 -- 172.21.15.1:0/3652167608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 msgr2=0x564a4ebb6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4ebb6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 -- 172.21.15.1:0/3652167608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 msgr2=0x564a4ebb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4ebb6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 -- 172.21.15.1:0/3652167608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4eb916a0 con 0x564a4eb9f240 2024-09-19T05:39:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4ebb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdc0de10640 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000a530 tx=0x7fdc00018a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e5f27b358fae7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdbf2ffd640 1 -- 172.21.15.1:0/3652167608 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0003a070 con 0x564a4eb9f240 2024-09-19T05:39:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdbf2ffd640 1 -- 172.21.15.1:0/3652167608 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc0001e040 con 0x564a4eb9f240 2024-09-19T05:39:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.278+0000 7fdbf2ffd640 1 -- 172.21.15.1:0/3652167608 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00026040 con 0x564a4eb9f240 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3652167608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 msgr2=0x564a4eb992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000a530 tx=0x7fdc00018a50 comp rx=0 tx=0).stop 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3652167608 shutdown_connections 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb992a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4ebb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/3652167608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4ebb6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3652167608 >> 172.21.15.1:0/3652167608 conn(0x564a4eb905f0 msgr2=0x564a4eb9b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3652167608 shutdown_connections 2024-09-19T05:39:16.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.279+0000 7fdc11c4c740 1 -- 172.21.15.1:0/3652167608 wait complete. 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 -- start start 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 Processor -- start 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4eb99180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4eb996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b4120 con 0x564a4eb9f240 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b5590 con 0x564a4eb94980 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc081b47f0 con 0x564a4eb94060 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc11c4c740 10 client.0 _ll_register_callbacks cb 0x7fdc0400c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc0de10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47082/0 (socket says 172.21.15.1:47082) 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc0de10640 1 -- 172.21.15.1:0/184339887 learned_addr learned my addr 172.21.15.1:0/184339887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:16.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.280+0000 7fdc0d60f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4eb99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4eb996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 -- 172.21.15.1:0/184339887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 msgr2=0x564a4eb996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4eb996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 -- 172.21.15.1:0/184339887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 msgr2=0x564a4eb99c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 -- 172.21.15.1:0/184339887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4eba5980 con 0x564a4eb94060 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0de10640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:16.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdbf0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc0d60f640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4eb99180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x564a4eba20b0 tx=0x7fdc040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977bc2e69e84b10e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04027830 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc0001e040 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fdc040279d0 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc04037050 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc11c4c740 10 client.25480 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.281+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564a4ec19a80 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc0001e040 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdc04018040 con 0x564a4eb94060 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 10 client.25480 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 10 client.25480 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 20 client.25480 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:16.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ec1a150 0x564a4ec1c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:16.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 4 client.25480 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e05e6b7e", "release": true, "await": true}] 2024-09-19T05:39:16.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e05e6b7e", "release": true, "await": true}) -- 0x564a4eb010a0 con 0x564a4ec1a150 2024-09-19T05:39:16.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.282+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ec1a150 0x564a4ec1c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:16.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.283+0000 7fdbf0ff9640 10 client.25480 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:16.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.283+0000 7fdc0ce0e640 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ec1a150 0x564a4ec1c540 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e85c7a847d857c3 server_cookie=a97c08cc765deba7 in_seq=0 out_seq=0 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdbf0ff9640 1 -- 172.21.15.1:0/184339887 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564a4eb010a0 con 0x564a4ec1a150 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdbf0ff9640 10 client.25480 handle_command_reply: tid=0 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 client.25480 shutdown 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 msgr2=0x564a4eb99180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4eb99180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x564a4eba20b0 tx=0x7fdc040046c0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 shutdown_connections 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x564a4eb9f240 0x564a4eb99c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564a4eb94980 0x564a4eb996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x564a4ec1a150 0x564a4ec1c540 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 --2- 172.21.15.1:0/184339887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564a4eb94060 0x564a4eb99180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdbf0ff9640 0 client.25480 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 >> 172.21.15.1:0/184339887 conn(0x564a4eb905f0 msgr2=0x564a4eb9a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 shutdown_connections 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 1 -- 172.21.15.1:0/184339887 wait complete. 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.361+0000 7fdc11c4c740 20 client.25480 trim_cache size 0 max 16384 2024-09-19T05:39:16.364 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 60, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "e05e6b7e": { 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 60, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 137.1, 2024-09-19T05:39:16.365 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:16.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 msgr2=0x7fdbf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 0x7fdbf40a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x564a4eb91450 tx=0x7fdc0400c480 comp rx=0 tx=0).stop 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 msgr2=0x7fdc081a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8005ab0 tx=0x7fdbf80042f0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 shutdown_connections 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fdbf40a3240 0x7fdbf40a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc08112b90 0x7fdc0819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc08074eb0 0x7fdc081a4cc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 --2- 172.21.15.1:0/4094532659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc08074590 0x7fdc081a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 >> 172.21.15.1:0/4094532659 conn(0x7fdc080fd8c0 msgr2=0x7fdc080ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 shutdown_connections 2024-09-19T05:39:16.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:16.362+0000 7fdc0f873640 1 -- 172.21.15.1:0/4094532659 wait complete. 2024-09-19T05:39:16.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88584 18.33 MB/sec execute 151 sec latency 15630.536 ms 2024-09-19T05:39:17.289 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e05e6b7e', total seconds elapsed: 21.0 2024-09-19T05:39:17.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 88922 18.34 MB/sec execute 152 sec latency 129.464 ms 2024-09-19T05:39:18.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:17 smithi060 ceph-mon[35058]: pgmap v894: 129 pgs: 129 active+clean; 461 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-19T05:39:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:17 smithi082 ceph-mon[35195]: pgmap v894: 129 pgs: 129 active+clean; 461 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-19T05:39:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:17 smithi001 ceph-mon[30968]: pgmap v894: 129 pgs: 129 active+clean; 461 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.6 MiB/s wr, 124 op/s 2024-09-19T05:39:18.640 INFO:tasks.workunit.client.0.smithi001.stdout: 10 89207 18.29 MB/sec execute 153 sec latency 138.426 ms 2024-09-19T05:39:19.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:39:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:18 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:39:19.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:39:19.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:39:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:39:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:18 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:39:19.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:39:19.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:39:19.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:18 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:39:19.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 89571 18.30 MB/sec execute 154 sec latency 188.143 ms 2024-09-19T05:39:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:19 smithi060 ceph-mon[35058]: pgmap v895: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 3.8 MiB/s wr, 124 op/s 2024-09-19T05:39:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:19 smithi060 ceph-mon[35058]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:39:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:19 smithi060 ceph-mon[35058]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:39:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:19 smithi082 ceph-mon[35195]: pgmap v895: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 3.8 MiB/s wr, 124 op/s 2024-09-19T05:39:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:19 smithi082 ceph-mon[35195]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:39:20.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:19 smithi082 ceph-mon[35195]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:39:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:19 smithi001 ceph-mon[30968]: pgmap v895: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 3.8 MiB/s wr, 124 op/s 2024-09-19T05:39:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:19 smithi001 ceph-mon[30968]: Adjusting osd_memory_target on smithi082 to 176.0M 2024-09-19T05:39:20.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:19 smithi001 ceph-mon[30968]: Unable to set osd_memory_target on smithi082 to 184568115: error parsing value: Value '184568115' is below minimum 939524096 2024-09-19T05:39:20.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 89936 18.28 MB/sec execute 155 sec latency 114.173 ms 2024-09-19T05:39:21.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 90500 18.34 MB/sec execute 156 sec latency 60.864 ms 2024-09-19T05:39:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:21 smithi060 ceph-mon[35058]: pgmap v896: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 158 op/s 2024-09-19T05:39:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:21 smithi082 ceph-mon[35195]: pgmap v896: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 158 op/s 2024-09-19T05:39:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:21 smithi001 ceph-mon[30968]: pgmap v896: 129 pgs: 129 active+clean; 465 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 158 op/s 2024-09-19T05:39:22.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 91011 18.44 MB/sec execute 157 sec latency 69.861 ms 2024-09-19T05:39:23.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:23 smithi060 ceph-mon[35058]: pgmap v897: 129 pgs: 129 active+clean; 454 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 238 op/s 2024-09-19T05:39:23.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:23 smithi082 ceph-mon[35195]: pgmap v897: 129 pgs: 129 active+clean; 454 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 238 op/s 2024-09-19T05:39:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:23 smithi001 ceph-mon[30968]: pgmap v897: 129 pgs: 129 active+clean; 454 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 238 op/s 2024-09-19T05:39:23.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 91517 18.52 MB/sec execute 158 sec latency 111.561 ms 2024-09-19T05:39:24.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 91865 18.54 MB/sec execute 159 sec latency 148.944 ms 2024-09-19T05:39:25.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:25 smithi060 ceph-mon[35058]: pgmap v898: 129 pgs: 129 active+clean; 452 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-09-19T05:39:25.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:25 smithi082 ceph-mon[35195]: pgmap v898: 129 pgs: 129 active+clean; 452 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-09-19T05:39:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:25 smithi001 ceph-mon[30968]: pgmap v898: 129 pgs: 129 active+clean; 452 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-09-19T05:39:25.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 92172 18.54 MB/sec execute 160 sec latency 191.675 ms 2024-09-19T05:39:26.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 92488 18.51 MB/sec execute 161 sec latency 74.921 ms 2024-09-19T05:39:27.514 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:27 smithi060 ceph-mon[35058]: pgmap v899: 129 pgs: 129 active+clean; 458 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.0 MiB/s wr, 343 op/s 2024-09-19T05:39:27.515 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:27 smithi082 ceph-mon[35195]: pgmap v899: 129 pgs: 129 active+clean; 458 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.0 MiB/s wr, 343 op/s 2024-09-19T05:39:27.598 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:27 smithi001 ceph-mon[30968]: pgmap v899: 129 pgs: 129 active+clean; 458 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.0 MiB/s wr, 343 op/s 2024-09-19T05:39:27.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 92860 18.50 MB/sec execute 162 sec latency 59.393 ms 2024-09-19T05:39:28.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 93262 18.52 MB/sec execute 163 sec latency 134.190 ms 2024-09-19T05:39:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:29 smithi060 ceph-mon[35058]: pgmap v900: 129 pgs: 129 active+clean; 450 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-19T05:39:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:29 smithi082 ceph-mon[35195]: pgmap v900: 129 pgs: 129 active+clean; 450 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-19T05:39:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:29 smithi001 ceph-mon[30968]: pgmap v900: 129 pgs: 129 active+clean; 450 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-19T05:39:29.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 93795 18.53 MB/sec execute 164 sec latency 73.710 ms 2024-09-19T05:39:30.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 94056 18.50 MB/sec execute 165 sec latency 325.338 ms 2024-09-19T05:39:31.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:31 smithi060 ceph-mon[35058]: pgmap v901: 129 pgs: 129 active+clean; 445 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-19T05:39:31.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:31 smithi082 ceph-mon[35195]: pgmap v901: 129 pgs: 129 active+clean; 445 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-19T05:39:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:31 smithi001 ceph-mon[30968]: pgmap v901: 129 pgs: 129 active+clean; 445 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-19T05:39:31.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 94582 18.59 MB/sec execute 166 sec latency 70.771 ms 2024-09-19T05:39:32.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 95129 18.70 MB/sec execute 167 sec latency 79.394 ms 2024-09-19T05:39:33.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:33 smithi060 ceph-mon[35058]: pgmap v902: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 6.9 MiB/s wr, 416 op/s 2024-09-19T05:39:33.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:33 smithi082 ceph-mon[35195]: pgmap v902: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 6.9 MiB/s wr, 416 op/s 2024-09-19T05:39:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:33 smithi001 ceph-mon[30968]: pgmap v902: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 6.9 MiB/s wr, 416 op/s 2024-09-19T05:39:33.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 95574 18.74 MB/sec execute 168 sec latency 46.520 ms 2024-09-19T05:39:34.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 95911 18.75 MB/sec execute 169 sec latency 86.662 ms 2024-09-19T05:39:35.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:35 smithi060 ceph-mon[35058]: pgmap v903: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 339 op/s 2024-09-19T05:39:35.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:35 smithi082 ceph-mon[35195]: pgmap v903: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 339 op/s 2024-09-19T05:39:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:35 smithi001 ceph-mon[30968]: pgmap v903: 129 pgs: 129 active+clean; 446 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 339 op/s 2024-09-19T05:39:35.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 96219 18.69 MB/sec execute 170 sec latency 103.041 ms 2024-09-19T05:39:36.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 96684 18.73 MB/sec execute 171 sec latency 66.415 ms 2024-09-19T05:39:37.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:37 smithi001 ceph-mon[30968]: pgmap v904: 129 pgs: 129 active+clean; 445 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 384 op/s 2024-09-19T05:39:37.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:37 smithi060 ceph-mon[35058]: pgmap v904: 129 pgs: 129 active+clean; 445 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 384 op/s 2024-09-19T05:39:37.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:37 smithi082 ceph-mon[35195]: pgmap v904: 129 pgs: 129 active+clean; 445 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 384 op/s 2024-09-19T05:39:37.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 97205 18.76 MB/sec execute 172 sec latency 62.100 ms 2024-09-19T05:39:38.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 97723 18.80 MB/sec execute 173 sec latency 68.562 ms 2024-09-19T05:39:39.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:39 smithi060 ceph-mon[35058]: pgmap v905: 129 pgs: 129 active+clean; 450 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 312 op/s 2024-09-19T05:39:39.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:39 smithi082 ceph-mon[35195]: pgmap v905: 129 pgs: 129 active+clean; 450 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 312 op/s 2024-09-19T05:39:39.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:39 smithi001 ceph-mon[30968]: pgmap v905: 129 pgs: 129 active+clean; 450 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 312 op/s 2024-09-19T05:39:39.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 98447 18.94 MB/sec execute 174 sec latency 41.544 ms 2024-09-19T05:39:40.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 98946 19.03 MB/sec execute 175 sec latency 67.317 ms 2024-09-19T05:39:41.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:41 smithi060 ceph-mon[35058]: pgmap v906: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-09-19T05:39:41.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:41 smithi082 ceph-mon[35195]: pgmap v906: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-09-19T05:39:41.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:41 smithi001 ceph-mon[30968]: pgmap v906: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-09-19T05:39:41.641 INFO:tasks.workunit.client.0.smithi001.stdout: 10 99325 19.05 MB/sec execute 176 sec latency 83.569 ms 2024-09-19T05:39:42.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 99699 19.03 MB/sec execute 177 sec latency 65.755 ms 2024-09-19T05:39:43.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:43 smithi060 ceph-mon[35058]: pgmap v907: 129 pgs: 129 active+clean; 459 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 289 op/s 2024-09-19T05:39:43.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:43 smithi082 ceph-mon[35195]: pgmap v907: 129 pgs: 129 active+clean; 459 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 289 op/s 2024-09-19T05:39:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:43 smithi001 ceph-mon[30968]: pgmap v907: 129 pgs: 129 active+clean; 459 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 289 op/s 2024-09-19T05:39:43.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 100093 19.03 MB/sec execute 178 sec latency 70.086 ms 2024-09-19T05:39:44.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 100624 19.05 MB/sec execute 179 sec latency 95.699 ms 2024-09-19T05:39:45.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:45 smithi060 ceph-mon[35058]: pgmap v908: 129 pgs: 129 active+clean; 463 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 276 op/s 2024-09-19T05:39:45.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:45 smithi082 ceph-mon[35195]: pgmap v908: 129 pgs: 129 active+clean; 463 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 276 op/s 2024-09-19T05:39:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:45 smithi001 ceph-mon[30968]: pgmap v908: 129 pgs: 129 active+clean; 463 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 276 op/s 2024-09-19T05:39:45.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 101167 19.10 MB/sec execute 180 sec latency 55.957 ms 2024-09-19T05:39:46.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 101773 19.19 MB/sec execute 181 sec latency 58.551 ms 2024-09-19T05:39:47.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:47 smithi060 ceph-mon[35058]: pgmap v909: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.3 MiB/s wr, 282 op/s 2024-09-19T05:39:47.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:47 smithi082 ceph-mon[35195]: pgmap v909: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.3 MiB/s wr, 282 op/s 2024-09-19T05:39:47.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:47 smithi001 ceph-mon[30968]: pgmap v909: 129 pgs: 129 active+clean; 453 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.3 MiB/s wr, 282 op/s 2024-09-19T05:39:47.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 102289 19.28 MB/sec execute 182 sec latency 73.740 ms 2024-09-19T05:39:48.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 102729 19.31 MB/sec execute 183 sec latency 72.515 ms 2024-09-19T05:39:49.047 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-19T05:39:49.048 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:39:49.328 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:39:49.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:49 smithi001 ceph-mon[30968]: pgmap v910: 129 pgs: 129 active+clean; 452 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-09-19T05:39:49.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:49 smithi060 ceph-mon[35058]: pgmap v910: 129 pgs: 129 active+clean; 452 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-09-19T05:39:49.509 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:49 smithi082 ceph-mon[35195]: pgmap v910: 129 pgs: 129 active+clean; 452 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-09-19T05:39:49.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 103042 19.30 MB/sec execute 184 sec latency 199.996 ms 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 -- 172.21.15.1:0/541630199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 msgr2=0x7f1c48107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 --2- 172.21.15.1:0/541630199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48107b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009930 tx=0x7f1c3c02a420 comp rx=0 tx=0).stop 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 -- 172.21.15.1:0/541630199 shutdown_connections 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 --2- 172.21.15.1:0/541630199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c481082a0 0x7f1c4810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 --2- 172.21.15.1:0/541630199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48107b90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 --2- 172.21.15.1:0/541630199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c48102d30 0x7f1c48103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 -- 172.21.15.1:0/541630199 >> 172.21.15.1:0/541630199 conn(0x7f1c480fc7d0 msgr2=0x7f1c480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 -- 172.21.15.1:0/541630199 shutdown_connections 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.847+0000 7f1c4d769640 1 -- 172.21.15.1:0/541630199 wait complete. 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.848+0000 7f1c4d769640 1 Processor -- start 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.848+0000 7f1c4d769640 1 -- start start 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 0x7f1c48101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48112060 con 0x7f1c48102d30 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1c48111ee0 con 0x7f1c481036e0 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c4d769640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c481121e0 con 0x7f1c481082a0 2024-09-19T05:39:49.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57962/0 (socket says 172.21.15.1:57962) 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 -- 172.21.15.1:0/3108440608 learned_addr learned my addr 172.21.15.1:0/3108440608 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c477fe640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 0x7f1c48101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c467fc640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 -- 172.21.15.1:0/3108440608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 msgr2=0x7f1c48101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 0x7f1c48101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 -- 172.21.15.1:0/3108440608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 msgr2=0x7f1c48100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c46ffd640 1 -- 172.21.15.1:0/3108440608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c481a6b00 con 0x7f1c48102d30 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.849+0000 7f1c477fe640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 0x7f1c48101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c46ffd640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800ebc0 tx=0x7f1c3800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38010630 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c481a6df0 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c38010cb0 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c481a72a0 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.850+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38018bd0 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.851+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c48103110 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.853+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1c380107d0 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.854+0000 7f1c2ffff640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 0x7f1c300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.854+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1c380d0350 con 0x7f1c48102d30 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.855+0000 7f1c467fc640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 0x7f1c300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.855+0000 7f1c467fc640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 0x7f1c300a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005940 tx=0x7f1c3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:49.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:49.860+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c3809ccc0 con 0x7f1c48102d30 2024-09-19T05:39:50.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.139+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c4810a230 con 0x7f1c48102d30 2024-09-19T05:39:50.146 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:39:50.146 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:39:50.146 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:39:50.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.143+0000 7f1c2ffff640 1 -- 172.21.15.1:0/3108440608 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f1c3809c5c0 con 0x7f1c48102d30 2024-09-19T05:39:50.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.150+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 msgr2=0x7f1c300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.150+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 0x7f1c300a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c005940 tx=0x7f1c3c0058d0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.150+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 msgr2=0x7f1c48100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:50.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.150+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800ebc0 tx=0x7f1c3800c6a0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 shutdown_connections 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1c300a3240 0x7f1c300a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c481082a0 0x7f1c48101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c481036e0 0x7f1c48100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 --2- 172.21.15.1:0/3108440608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1c48102d30 0x7f1c48100990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:50.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.153+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 >> 172.21.15.1:0/3108440608 conn(0x7f1c480fc7d0 msgr2=0x7f1c48105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:50.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.155+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 shutdown_connections 2024-09-19T05:39:50.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:50.157+0000 7f1c4d769640 1 -- 172.21.15.1:0/3108440608 wait complete. 2024-09-19T05:39:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:50 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3108440608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:50.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:50 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3108440608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:50.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:50 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3108440608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:39:50.642 INFO:tasks.workunit.client.0.smithi001.stdout: 10 103280 19.24 MB/sec execute 185 sec latency 200.500 ms 2024-09-19T05:39:51.174 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-19T05:39:51.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-19T05:39:51.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:51 smithi060 ceph-mon[35058]: pgmap v911: 129 pgs: 129 active+clean; 450 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-09-19T05:39:51.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:51 smithi082 ceph-mon[35195]: pgmap v911: 129 pgs: 129 active+clean; 450 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-09-19T05:39:51.511 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:51 smithi001 ceph-mon[30968]: pgmap v911: 129 pgs: 129 active+clean; 450 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-09-19T05:39:51.546 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:39:51.644 INFO:tasks.workunit.client.0.smithi001.stdout: 10 103653 19.24 MB/sec execute 186 sec latency 139.687 ms 2024-09-19T05:39:52.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.573+0000 7f6fcc111640 1 -- 172.21.15.1:0/1426101471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc4101440 msgr2=0x7f6fc410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.573+0000 7f6fcc111640 1 --2- 172.21.15.1:0/1426101471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc4101440 0x7f6fc410df30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009900 tx=0x7f6fb402a410 comp rx=0 tx=0).stop 2024-09-19T05:39:52.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 -- 172.21.15.1:0/1426101471 shutdown_connections 2024-09-19T05:39:52.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 --2- 172.21.15.1:0/1426101471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc410e500 0x7f6fc4110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 --2- 172.21.15.1:0/1426101471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc4101440 0x7f6fc410df30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 --2- 172.21.15.1:0/1426101471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 0x7f6fc4100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 -- 172.21.15.1:0/1426101471 >> 172.21.15.1:0/1426101471 conn(0x7f6fc40fc7d0 msgr2=0x7f6fc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 -- 172.21.15.1:0/1426101471 shutdown_connections 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.574+0000 7f6fcc111640 1 -- 172.21.15.1:0/1426101471 wait complete. 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 Processor -- start 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 -- start start 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 0x7f6fc4107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc410e500 0x7f6fc4102ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc4114250 con 0x7f6fc410e500 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41140d0 con 0x7f6fc4101440 2024-09-19T05:39:52.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fc96ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fcc111640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41143d0 con 0x7f6fc4100b20 2024-09-19T05:39:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fc96ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:36648/0 (socket says 172.21.15.1:36648) 2024-09-19T05:39:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fc96ac640 1 -- 172.21.15.1:0/356712695 learned_addr learned my addr 172.21.15.1:0/356712695 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.575+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc410e500 0x7f6fc4102ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 0x7f6fc4107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc96ac640 1 -- 172.21.15.1:0/356712695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 msgr2=0x7f6fc4107640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 0x7f6fc4107640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc96ac640 1 -- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc410e500 msgr2=0x7f6fc4102ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc410e500 0x7f6fc4102ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.576+0000 7f6fc96ac640 1 -- 172.21.15.1:0/356712695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc4103390 con 0x7f6fc4101440 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4005940 tx=0x7f6fb40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fbaffd640 1 -- 172.21.15.1:0/356712695 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb403f030 con 0x7f6fc4101440 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fbaffd640 1 -- 172.21.15.1:0/356712695 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb40044c0 con 0x7f6fc4101440 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fbaffd640 1 -- 172.21.15.1:0/356712695 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4035070 con 0x7f6fc4101440 2024-09-19T05:39:52.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc4103620 con 0x7f6fc4101440 2024-09-19T05:39:52.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.577+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc410d360 con 0x7f6fc4101440 2024-09-19T05:39:52.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.580+0000 7f6fbaffd640 1 -- 172.21.15.1:0/356712695 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f6fb4042030 con 0x7f6fc4101440 2024-09-19T05:39:52.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.581+0000 7f6fce4ea740 1 Processor -- start 2024-09-19T05:39:52.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.581+0000 7f6fce4ea740 1 -- start start 2024-09-19T05:39:52.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.581+0000 7f6fbaffd640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 0x7f6fb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.581+0000 7f6fbaffd640 1 -- 172.21.15.1:0/356712695 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6fb40f0080 con 0x7f6fc4101440 2024-09-19T05:39:52.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 0x7f6fb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38c4940 0x55dfd38c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dfd381f2a0 con 0x55dfd38b9760 2024-09-19T05:39:52.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57986/0 (socket says 172.21.15.1:57986) 2024-09-19T05:39:52.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2630801479 learned_addr learned my addr 172.21.15.1:0/2630801479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:52.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55dfd37c6b10 con 0x55dfd38c4940 2024-09-19T05:39:52.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dfd381b260 con 0x55dfd38ba080 2024-09-19T05:39:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.582+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38c4940 0x55dfd38c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2630801479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 msgr2=0x55dfd38c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2630801479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38c4940 msgr2=0x55dfd38c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38c4940 0x55dfd38c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2630801479 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd3590b90 con 0x55dfd38b9760 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 0x7f6fb00a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6fc410e940 tx=0x7f6fbc011b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009cf0 tx=0x7f6fc0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2728f0574a98d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.583+0000 7f6faffff640 1 -- 172.21.15.1:0/2630801479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc001e070 con 0x55dfd38b9760 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.584+0000 7f6faffff640 1 -- 172.21.15.1:0/2630801479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fc0009de0 con 0x55dfd38b9760 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.584+0000 7f6faffff640 1 -- 172.21.15.1:0/2630801479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00196b0 con 0x55dfd38b9760 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 msgr2=0x55dfd38b9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009cf0 tx=0x7f6fc0011810 comp rx=0 tx=0).stop 2024-09-19T05:39:52.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 shutdown_connections 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38c4940 0x55dfd38c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2630801479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38b9b40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 >> 172.21.15.1:0/2630801479 conn(0x55dfd38b5cf0 msgr2=0x55dfd38b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 shutdown_connections 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.585+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2630801479 wait complete. 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.586+0000 7f6fce4ea740 1 -- start start 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.586+0000 7f6fce4ea740 1 Processor -- start 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.586+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.586+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38c4940 0x55dfd38c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57988/0 (socket says 172.21.15.1:57988) 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dfd38c7510 con 0x55dfd38b9760 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55dfd37a76e0 con 0x55dfd38ba080 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dfd38c7690 con 0x55dfd38c4940 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 -- 172.21.15.1:0/3516145870 learned_addr learned my addr 172.21.15.1:0/3516145870 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fce4ea740 10 client.0 _ll_register_callbacks cb 0x55dfd37cba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38c4940 0x55dfd38c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 -- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38c4940 msgr2=0x55dfd38c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38c4940 0x55dfd38c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 -- 172.21.15.1:0/3516145870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 msgr2=0x55dfd38c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38c1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.587+0000 7f6fc9ead640 1 -- 172.21.15.1:0/3516145870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd38d0a00 con 0x55dfd38b9760 2024-09-19T05:39:52.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.588+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00058c0 tx=0x7f6fc00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4474549f8a288 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.588+0000 7f6fad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:39:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.588+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc001e040 con 0x55dfd38b9760 2024-09-19T05:39:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.588+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fc0009de0 con 0x55dfd38b9760 2024-09-19T05:39:52.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.588+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6fc0016070 con 0x55dfd38b9760 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.589+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6fc00054e0 con 0x55dfd38b9760 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.589+0000 7f6fce4ea740 10 client.15933 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.589+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfd38d3350 con 0x55dfd38b9760 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.589+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fc0009de0 con 0x55dfd38b9760 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.589+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6fc0021070 con 0x55dfd38b9760 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 10 client.15933 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 10 client.15933 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 20 client.15933 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd38d6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 4 client.15933 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd382c9d0 con 0x55dfd38d4700 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.590+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd38d6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.591+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd38d6af0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2f963853a118eb server_cookie=bd2b4986d5262541 in_seq=0 out_seq=0 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.591+0000 7f6fad7fa640 10 client.15933 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.593+0000 7f6fad7fa640 1 -- 172.21.15.1:0/3516145870 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd382c9d0 con 0x55dfd38d4700 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.593+0000 7f6fad7fa640 10 client.15933 handle_command_reply: tid=0 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.593+0000 7f6fce4ea740 1 client.15933 shutdown 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 msgr2=0x55dfd38c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00058c0 tx=0x7f6fc00052f0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 shutdown_connections 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd38d6af0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38c4940 0x55dfd38c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fad7fa640 0 client.15933 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38c1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/3516145870 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38b9760 0x55dfd38c1810 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 >> 172.21.15.1:0/3516145870 conn(0x55dfd38b5cf0 msgr2=0x55dfd38b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 shutdown_connections 2024-09-19T05:39:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.594+0000 7f6fce4ea740 1 -- 172.21.15.1:0/3516145870 wait complete. 2024-09-19T05:39:52.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.595+0000 7f6fce4ea740 20 client.15933 trim_cache size 0 max 16384 2024-09-19T05:39:52.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 Processor -- start 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 -- start start 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 0x55dfd38bc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38dc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41bbbe0 con 0x55dfd38c4940 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41be460 con 0x55dfd38ba080 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fce4ea740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41bc250 con 0x55dfd38b9760 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.626+0000 7f6fc96ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 0x55dfd38bc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc9ead640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 0x55dfd38bc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:41264/0 (socket says 172.21.15.1:41264) 2024-09-19T05:39:52.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc9ead640 1 -- 172.21.15.1:0/4120637910 learned_addr learned my addr 172.21.15.1:0/4120637910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:52.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc96ac640 1 -- 172.21.15.1:0/4120637910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 msgr2=0x55dfd38bc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 0x55dfd38bc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc96ac640 1 -- 172.21.15.1:0/4120637910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 msgr2=0x55dfd38dc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38dc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.627+0000 7f6fc96ac640 1 -- 172.21.15.1:0/4120637910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd38c70a0 con 0x55dfd38ba080 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.628+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38b4d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb40ed6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3811114c70c9e26c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.628+0000 7f6faf7fe640 1 -- 172.21.15.1:0/4120637910 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4049040 con 0x55dfd38ba080 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.628+0000 7f6faf7fe640 1 -- 172.21.15.1:0/4120637910 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb40c4f60 con 0x55dfd38ba080 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.628+0000 7f6faf7fe640 1 -- 172.21.15.1:0/4120637910 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40bc600 con 0x55dfd38ba080 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 -- 172.21.15.1:0/4120637910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 msgr2=0x55dfd38b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38b4d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb40ed6a0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 -- 172.21.15.1:0/4120637910 shutdown_connections 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38ba080 0x55dfd38b4d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/4120637910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38b9760 0x55dfd38bc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.629+0000 7f6fce4ea740 1 -- 172.21.15.1:0/4120637910 >> 172.21.15.1:0/4120637910 conn(0x55dfd38b5cf0 msgr2=0x55dfd38b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:52.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.630+0000 7f6fce4ea740 1 -- 172.21.15.1:0/4120637910 shutdown_connections 2024-09-19T05:39:52.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.630+0000 7f6fce4ea740 1 -- 172.21.15.1:0/4120637910 wait complete. 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.630+0000 7f6fce4ea740 1 -- start start 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.631+0000 7f6fce4ea740 1 Processor -- start 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.631+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 0x55dfd38c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fc96ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fc96ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:41280/0 (socket says 172.21.15.1:41280) 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fc96ac640 1 -- 172.21.15.1:0/2316200941 learned_addr learned my addr 172.21.15.1:0/2316200941 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 0x55dfd38c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41bc920 con 0x55dfd38c4940 2024-09-19T05:39:52.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41bdd90 con 0x55dfd38b9760 2024-09-19T05:39:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41bcff0 con 0x55dfd38ba080 2024-09-19T05:39:52.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fce4ea740 10 client.0 _ll_register_callbacks cb 0x7f6fc0009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.632+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 msgr2=0x55dfd38c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2316200941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 msgr2=0x55dfd38c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd393e4a0 con 0x55dfd38b9760 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fca6ae640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fc9ead640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 0x55dfd38c8900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0004a50 tx=0x7f6fc0005360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4313e7141301532f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.633+0000 7f6fad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0015070 con 0x55dfd38b9760 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6fc0019860 con 0x55dfd38b9760 2024-09-19T05:39:52.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb40c4f60 con 0x55dfd38b9760 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6fc001e040 con 0x55dfd38b9760 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fce4ea740 10 client.25517 fetch_fsmap learned FSMap version 21 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfd393f780 con 0x55dfd38b9760 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.634+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fb40c4f60 con 0x55dfd38b9760 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6fc0037030 con 0x55dfd38b9760 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 10 client.25517 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:39:52.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 10 client.25517 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 20 client.25517 populate_metadata read hostname 'smithi001' 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd3941e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 4 client.25517 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.635+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55dfd3826d20 con 0x55dfd38d4700 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.636+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd3941e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.636+0000 7f6fc96ac640 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd3941e10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ee2ee7c4ddc15a server_cookie=f067a54b078ef169 in_seq=0 out_seq=0 2024-09-19T05:39:52.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:52.636+0000 7f6fad7fa640 10 client.25517 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:52.644 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104142 19.24 MB/sec execute 187 sec latency 91.480 ms 2024-09-19T05:39:53.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:53 smithi060 ceph-mon[35058]: pgmap v912: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-09-19T05:39:53.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:53 smithi082 ceph-mon[35195]: pgmap v912: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-09-19T05:39:53.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:53 smithi001 ceph-mon[30968]: pgmap v912: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-09-19T05:39:53.644 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 19.14 MB/sec execute 188 sec latency 1024.644 ms 2024-09-19T05:39:53.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fad7fa640 1 -- 172.21.15.1:0/2316200941 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dfd3826d20 con 0x55dfd38d4700 2024-09-19T05:39:53.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fad7fa640 10 client.25517 handle_command_reply: tid=0 2024-09-19T05:39:53.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 client.25517 shutdown 2024-09-19T05:39:53.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 msgr2=0x55dfd38c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 0x55dfd38c8900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0004a50 tx=0x7f6fc0005360 comp rx=0 tx=0).stop 2024-09-19T05:39:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 shutdown_connections 2024-09-19T05:39:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dfd38c4940 0x55dfd38c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55dfd38d4700 0x55dfd3941e10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fad7fa640 0 client.25517 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dfd38ba080 0x55dfd38c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.666+0000 7f6fce4ea740 1 --2- 172.21.15.1:0/2316200941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dfd38b9760 0x55dfd38c8900 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.667+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 >> 172.21.15.1:0/2316200941 conn(0x55dfd38b5cf0 msgr2=0x55dfd38b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.667+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 shutdown_connections 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.667+0000 7f6fce4ea740 1 -- 172.21.15.1:0/2316200941 wait complete. 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.667+0000 7f6fce4ea740 20 client.25517 trim_cache size 0 max 16384 2024-09-19T05:39:53.670 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 62, 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "9e792ee": { 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 62, 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:53.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 130.0, 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:53.672 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:53.673 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:39:53.673 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:39:53.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 msgr2=0x7f6fb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 0x7f6fb00a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6fc410e940 tx=0x7f6fbc011b40 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 msgr2=0x7f6fc4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4005940 tx=0x7f6fb40040c0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 shutdown_connections 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6fb00a3240 0x7f6fb00a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6fc410e500 0x7f6fc4102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fc4101440 0x7f6fc4107b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 --2- 172.21.15.1:0/356712695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6fc4100b20 0x7f6fc4107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 >> 172.21.15.1:0/356712695 conn(0x7f6fc40fc7d0 msgr2=0x7f6fc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 shutdown_connections 2024-09-19T05:39:53.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:53.668+0000 7f6fcc111640 1 -- 172.21.15.1:0/356712695 wait complete. 2024-09-19T05:39:54.644 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 19.04 MB/sec execute 189 sec latency 2024.682 ms 2024-09-19T05:39:54.668 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9e792ee', quiesce took 5.6 seconds. Will release after: 4.4 2024-09-19T05:39:55.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:55 smithi060 ceph-mon[35058]: pgmap v913: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-09-19T05:39:55.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:55 smithi082 ceph-mon[35195]: pgmap v913: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-09-19T05:39:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:55 smithi001 ceph-mon[30968]: pgmap v913: 129 pgs: 129 active+clean; 460 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-09-19T05:39:55.644 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.94 MB/sec execute 190 sec latency 3024.809 ms 2024-09-19T05:39:56.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.84 MB/sec execute 191 sec latency 4024.910 ms 2024-09-19T05:39:57.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:57 smithi060 ceph-mon[35058]: pgmap v914: 129 pgs: 129 active+clean; 461 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-09-19T05:39:57.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:57 smithi082 ceph-mon[35195]: pgmap v914: 129 pgs: 129 active+clean; 461 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-09-19T05:39:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:57 smithi001 ceph-mon[30968]: pgmap v914: 129 pgs: 129 active+clean; 461 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-09-19T05:39:57.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.74 MB/sec execute 192 sec latency 5025.020 ms 2024-09-19T05:39:58.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.65 MB/sec execute 193 sec latency 6025.072 ms 2024-09-19T05:39:59.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:39:59.331 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:39:59.452 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:39:59 smithi001 ceph-mon[30968]: pgmap v915: 129 pgs: 129 active+clean; 473 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 272 op/s 2024-09-19T05:39:59.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:39:59 smithi060 ceph-mon[35058]: pgmap v915: 129 pgs: 129 active+clean; 473 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 272 op/s 2024-09-19T05:39:59.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:39:59 smithi082 ceph-mon[35195]: pgmap v915: 129 pgs: 129 active+clean; 473 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.1 MiB/s wr, 272 op/s 2024-09-19T05:39:59.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.55 MB/sec execute 194 sec latency 7025.111 ms 2024-09-19T05:39:59.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 -- 172.21.15.1:0/3525480448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428102d90 msgr2=0x7f8428103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 --2- 172.21.15.1:0/3525480448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428102d90 0x7f8428103170 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8418009930 tx=0x7f841802a420 comp rx=0 tx=0).stop 2024-09-19T05:39:59.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 -- 172.21.15.1:0/3525480448 shutdown_connections 2024-09-19T05:39:59.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 --2- 172.21.15.1:0/3525480448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428108290 0x7f842810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 --2- 172.21.15.1:0/3525480448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 --2- 172.21.15.1:0/3525480448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428102d90 0x7f8428103170 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 -- 172.21.15.1:0/3525480448 >> 172.21.15.1:0/3525480448 conn(0x7f84280fc7d0 msgr2=0x7f84280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 -- 172.21.15.1:0/3525480448 shutdown_connections 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.866+0000 7f842de38640 1 -- 172.21.15.1:0/3525480448 wait complete. 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 Processor -- start 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 -- start start 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 0x7f8428198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84281120d0 con 0x7f8428108290 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8428111f50 con 0x7f8428102d90 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f842de38640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8428112250 con 0x7f8428103740 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f8427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f8427fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33412/0 (socket says 172.21.15.1:33412) 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.867+0000 7f8427fff640 1 -- 172.21.15.1:0/1532540826 learned_addr learned my addr 172.21.15.1:0/1532540826 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f84277fe640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 0x7f8428198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f841effd640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 -- 172.21.15.1:0/1532540826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 msgr2=0x7f8428198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 -- 172.21.15.1:0/1532540826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 msgr2=0x7f8428198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 0x7f8428198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 -- 172.21.15.1:0/1532540826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842819d5f0 con 0x7f8428108290 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f84277fe640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 0x7f8428198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f841effd640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f8427fff640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f842000eaa0 tx=0x7f842000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000cdb0 con 0x7f8428108290 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8420005020 con 0x7f8428108290 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842819d8e0 con 0x7f8428108290 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84200116b0 con 0x7f8428108290 2024-09-19T05:39:59.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.868+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84281a51c0 con 0x7f8428108290 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.869+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8428103170 con 0x7f8428108290 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.870+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8420005560 con 0x7f8428108290 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.871+0000 7f84257fa640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 0x7f84140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.871+0000 7f84277fe640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 0x7f84140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.871+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f84200cffc0 con 0x7f8428108290 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.872+0000 7f84277fe640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 0x7f84140a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f8418032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:39:59.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:39:59.875+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8420016030 con 0x7f8428108290 2024-09-19T05:40:00.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.093+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f842810a2a0 con 0x7f8428108290 2024-09-19T05:40:00.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.093+0000 7f84257fa640 1 -- 172.21.15.1:0/1532540826 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f842009c8d0 con 0x7f8428108290 2024-09-19T05:40:00.095 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:40:00.096 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:40:00.096 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:40:00.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.095+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 msgr2=0x7f84140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.095+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 0x7f84140a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f8418032c70 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.095+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 msgr2=0x7f842819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.095+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f842000eaa0 tx=0x7f842000ef60 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 shutdown_connections 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f84140a32c0 0x7f84140a5780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8428108290 0x7f842819cf10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8428103740 0x7f8428198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 --2- 172.21.15.1:0/1532540826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8428102d90 0x7f8428198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 >> 172.21.15.1:0/1532540826 conn(0x7f84280fc7d0 msgr2=0x7f8428105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 shutdown_connections 2024-09-19T05:40:00.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:00.096+0000 7f842de38640 1 -- 172.21.15.1:0/1532540826 wait complete. 2024-09-19T05:40:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:00 smithi060 ceph-mon[35058]: overall HEALTH_OK 2024-09-19T05:40:00.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:00 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1532540826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:00 smithi082 ceph-mon[35195]: overall HEALTH_OK 2024-09-19T05:40:00.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:00 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1532540826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:00.526 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:00 smithi001 ceph-mon[30968]: overall HEALTH_OK 2024-09-19T05:40:00.527 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:00 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1532540826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:00.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.45 MB/sec execute 195 sec latency 8025.219 ms 2024-09-19T05:40:00.853 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 9e792ee --release --await' 2024-09-19T05:40:00.853 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 9e792ee --release --await 2024-09-19T05:40:01.110 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:40:01.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:01 smithi060 ceph-mon[35058]: pgmap v916: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 226 op/s 2024-09-19T05:40:01.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:01 smithi082 ceph-mon[35195]: pgmap v916: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 226 op/s 2024-09-19T05:40:01.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:01 smithi001 ceph-mon[30968]: pgmap v916: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.9 MiB/s wr, 226 op/s 2024-09-19T05:40:01.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104151 18.36 MB/sec execute 196 sec latency 9025.283 ms 2024-09-19T05:40:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 -- 172.21.15.1:0/3428545974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c100a80 msgr2=0x7f2d1c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 --2- 172.21.15.1:0/3428545974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c100a80 0x7f2d1c100ee0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009930 tx=0x7f2d1002a420 comp rx=0 tx=0).stop 2024-09-19T05:40:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 -- 172.21.15.1:0/3428545974 shutdown_connections 2024-09-19T05:40:01.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 --2- 172.21.15.1:0/3428545974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 0x7f2d1c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 --2- 172.21.15.1:0/3428545974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c100a80 0x7f2d1c100ee0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 --2- 172.21.15.1:0/3428545974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c106a80 0x7f2d1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 -- 172.21.15.1:0/3428545974 >> 172.21.15.1:0/3428545974 conn(0x7f2d1c0fc7a0 msgr2=0x7f2d1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 -- 172.21.15.1:0/3428545974 shutdown_connections 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.727+0000 7f2d221a0640 1 -- 172.21.15.1:0/3428545974 wait complete. 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 Processor -- start 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 -- start start 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 0x7f2d1c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 0x7f2d1c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c110e80 con 0x7f2d1c106a80 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c110d00 con 0x7f2d1c100a80 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d221a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c111000 con 0x7f2d1c101420 2024-09-19T05:40:01.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33422/0 (socket says 172.21.15.1:33422) 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d1bfff640 1 -- 172.21.15.1:0/2695239852 learned_addr learned my addr 172.21.15.1:0/2695239852 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.728+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 0x7f2d1c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1affd640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 0x7f2d1c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 -- 172.21.15.1:0/2695239852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 msgr2=0x7f2d1c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 0x7f2d1c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 -- 172.21.15.1:0/2695239852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 msgr2=0x7f2d1c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 0x7f2d1c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 -- 172.21.15.1:0/2695239852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c19d490 con 0x7f2d1c106a80 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 0x7f2d1c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:01.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400eaa0 tx=0x7f2d1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d18ff9640 1 -- 172.21.15.1:0/2695239852 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400cdb0 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d18ff9640 1 -- 172.21.15.1:0/2695239852 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d14005020 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c19d780 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d18ff9640 1 -- 172.21.15.1:0/2695239852 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140116b0 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.729+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c1a5060 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.731+0000 7f2d24579740 1 Processor -- start 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.731+0000 7f2d18ff9640 1 -- 172.21.15.1:0/2695239852 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2d14005560 con 0x7f2d1c106a80 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 -- start start 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd08fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd090240 0x5645dd092630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645dcfea620 con 0x5645dd085060 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5645dcf91e50 con 0x5645dd090240 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d24579740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645dcfe65e0 con 0x5645dd085980 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33424/0 (socket says 172.21.15.1:33424) 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 -- 172.21.15.1:0/1992578213 learned_addr learned my addr 172.21.15.1:0/1992578213 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd090240 0x5645dd092630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd08fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 -- 172.21.15.1:0/1992578213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 msgr2=0x5645dd08fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd08fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 -- 172.21.15.1:0/1992578213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd090240 msgr2=0x5645dd092630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd090240 0x5645dd092630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d18ff9640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 0x7f2d040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 -- 172.21.15.1:0/1992578213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645dcf82d40 con 0x5645dd085060 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 0x7f2d040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.732+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2d1002a940 tx=0x7f2d10005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eb38ea681f1f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d18ff9640 1 -- 172.21.15.1:0/2695239852 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f2d140cfff0 con 0x7f2d1c106a80 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d01ffb640 1 -- 172.21.15.1:0/1992578213 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10035070 con 0x5645dd085060 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d01ffb640 1 -- 172.21.15.1:0/1992578213 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d100035f0 con 0x5645dd085060 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d01ffb640 1 -- 172.21.15.1:0/1992578213 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1003d6a0 con 0x5645dd085060 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 -- 172.21.15.1:0/1992578213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 msgr2=0x5645dd085440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 0x7f2d040a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005d80 tx=0x7f2d0c005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2d1002a940 tx=0x7f2d10005b50 comp rx=0 tx=0).stop 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 -- 172.21.15.1:0/1992578213 shutdown_connections 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd090240 0x5645dd092630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd08fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.733+0000 7f2d24579740 1 --2- 172.21.15.1:0/1992578213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd085060 0x5645dd085440 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- 172.21.15.1:0/1992578213 >> 172.21.15.1:0/1992578213 conn(0x5645dd0815f0 msgr2=0x5645dd0819d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- 172.21.15.1:0/1992578213 shutdown_connections 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- 172.21.15.1:0/1992578213 wait complete. 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- start start 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 Processor -- start 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 0x5645dd08d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085980 0x5645dd08d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5645dd092e10 con 0x5645dd090240 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5645dcf72f10 con 0x5645dd085980 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645dd092f90 con 0x5645dd085060 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.734+0000 7f2d24579740 10 client.0 _ll_register_callbacks cb 0x5645dcf96db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:01.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33434/0 (socket says 172.21.15.1:33434) 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1739030886 learned_addr learned my addr 172.21.15.1:0/1739030886 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085980 0x5645dd08d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 0x5645dd08d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 msgr2=0x5645dd08d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 0x5645dd08d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1739030886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085980 msgr2=0x5645dd08d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085980 0x5645dd08d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1739030886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645dccf9580 con 0x5645dd090240 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 0x5645dd08d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:01.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2d1409bf60 tx=0x7f2d1409c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60434b3c4332685 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1401f030 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f2d140a0120 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d100035f0 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d140b5200 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d24579740 10 client.15957 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.735+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5645dcdc3960 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d100035f0 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d1400f040 con 0x5645dd090240 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 10 client.15957 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 10 client.15957 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 20 client.15957 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:01.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd09fd60 0x5645dd0a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 4 client.15957 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645dcff7b90 con 0x5645dd09fd60 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.736+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd09fd60 0x5645dd0a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.737+0000 7f2cfaffd640 10 client.15957 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.737+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd09fd60 0x5645dd0a21b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ea88ebdbde6867 server_cookie=bd1f6c05bf5f1aeb in_seq=0 out_seq=0 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.737+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1739030886 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645dcff7b90 con 0x5645dd09fd60 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.737+0000 7f2cfaffd640 10 client.15957 handle_command_reply: tid=0 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.737+0000 7f2d24579740 1 client.15957 shutdown 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 msgr2=0x5645dd08dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2d1409bf60 tx=0x7f2d1409c320 comp rx=0 tx=0).stop 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 shutdown_connections 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd08dc10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085980 0x5645dd08d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd09fd60 0x5645dd0a21b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 --2- 172.21.15.1:0/1739030886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085060 0x5645dd08d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2cfaffd640 0 client.15957 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 >> 172.21.15.1:0/1739030886 conn(0x5645dd0815f0 msgr2=0x5645dd087320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 shutdown_connections 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 1 -- 172.21.15.1:0/1739030886 wait complete. 2024-09-19T05:40:01.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.738+0000 7f2d24579740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T05:40:01.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 Processor -- start 2024-09-19T05:40:01.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 -- start start 2024-09-19T05:40:01.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd080a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd087ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1accf0 con 0x5645dd090240 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1af570 con 0x5645dd085060 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d24579740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1ad360 con 0x5645dd085980 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33442/0 (socket says 172.21.15.1:33442) 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1515468874 learned_addr learned my addr 172.21.15.1:0/1515468874 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.755+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd087ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1515468874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 msgr2=0x5645dd087ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd087ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1515468874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 msgr2=0x5645dd080a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd080a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1515468874 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645dd08c140 con 0x5645dd090240 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd080a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd087ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2d1409c1f0 tx=0x7f2d1409c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44664024986284cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d017fa640 1 -- 172.21.15.1:0/1515468874 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1401f070 con 0x5645dd090240 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d017fa640 1 -- 172.21.15.1:0/1515468874 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d1409b290 con 0x5645dd090240 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.756+0000 7f2d017fa640 1 -- 172.21.15.1:0/1515468874 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140a0380 con 0x5645dd090240 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- 172.21.15.1:0/1515468874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 msgr2=0x5645dd0a7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2d1409c1f0 tx=0x7f2d1409c160 comp rx=0 tx=0).stop 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- 172.21.15.1:0/1515468874 shutdown_connections 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd0a7aa0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd087ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- 172.21.15.1:0/1515468874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd080a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- 172.21.15.1:0/1515468874 >> 172.21.15.1:0/1515468874 conn(0x5645dd0815f0 msgr2=0x5645dd08e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- 172.21.15.1:0/1515468874 shutdown_connections 2024-09-19T05:40:01.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- 172.21.15.1:0/1515468874 wait complete. 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 -- start start 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 Processor -- start 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd094720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.757+0000 7f2d24579740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd094c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1ada30 con 0x5645dd090240 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1aeea0 con 0x5645dd085060 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c1ae100 con 0x5645dd085980 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 10 client.0 _ll_register_callbacks cb 0x7f2d1409c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33450/0 (socket says 172.21.15.1:33450) 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1408191153 learned_addr learned my addr 172.21.15.1:0/1408191153 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1affd640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd094720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 msgr2=0x5645dd094c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd094c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1408191153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 msgr2=0x5645dd094720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd094720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 -- 172.21.15.1:0/1408191153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645dd10a060 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d1bfff640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400efd0 tx=0x7f2d1409bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7594980f86c5a3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1401f070 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f2d140bc2d0 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.758+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d1409b290 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d140a0610 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 10 client.15963 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5645dd10b2f0 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d1409b290 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d14004c70 con 0x5645dd090240 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 10 client.15963 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 10 client.15963 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 20 client.15963 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:01.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd10b680 0x5645dd10da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:01.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 4 client.15963 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9e792ee", "release": true, "await": true}] 2024-09-19T05:40:01.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9e792ee", "release": true, "await": true}) -- 0x5645dcff20a0 con 0x5645dd10b680 2024-09-19T05:40:01.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.759+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd10b680 0x5645dd10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:01.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.760+0000 7f2d1b7fe640 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd10b680 0x5645dd10da70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61ad1695cec4cfb server_cookie=f6463fcaa2f6dec9 in_seq=0 out_seq=0 2024-09-19T05:40:01.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.760+0000 7f2cfaffd640 10 client.15963 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.848+0000 7f2cfaffd640 1 -- 172.21.15.1:0/1408191153 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5645dcff20a0 con 0x5645dd10b680 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.848+0000 7f2cfaffd640 10 client.15963 handle_command_reply: tid=0 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.848+0000 7f2d24579740 1 client.15963 shutdown 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.848+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 msgr2=0x5645dd109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.848+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400efd0 tx=0x7f2d1409bcf0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 shutdown_connections 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5645dd090240 0x5645dd109a70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5645dd10b680 0x5645dd10da70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645dd085980 0x5645dd094c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 --2- 172.21.15.1:0/1408191153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5645dd085060 0x5645dd094720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2cfaffd640 0 client.15963 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 >> 172.21.15.1:0/1408191153 conn(0x5645dd0815f0 msgr2=0x5645dd08d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 shutdown_connections 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 1 -- 172.21.15.1:0/1408191153 wait complete. 2024-09-19T05:40:01.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d24579740 20 client.15963 trim_cache size 0 max 16384 2024-09-19T05:40:01.853 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 64, 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "9e792ee": { 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 64, 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:01.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 130.0, 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:01.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:01.860 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:01.860 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:40:01.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 msgr2=0x7f2d040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 0x7f2d040a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c005d80 tx=0x7f2d0c005d10 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 msgr2=0x7f2d1c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.849+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400eaa0 tx=0x7f2d1400ef60 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 shutdown_connections 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2d040a3240 0x7f2d040a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d1c106a80 0x7f2d1c19cdb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d1c101420 0x7f2d1c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 --2- 172.21.15.1:0/2695239852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d1c100a80 0x7f2d1c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 >> 172.21.15.1:0/2695239852 conn(0x7f2d1c0fc7a0 msgr2=0x7f2d1c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 shutdown_connections 2024-09-19T05:40:01.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:01.850+0000 7f2d221a0640 1 -- 172.21.15.1:0/2695239852 wait complete. 2024-09-19T05:40:02.579 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9e792ee', total seconds elapsed: 13.5 2024-09-19T05:40:02.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 104532 18.35 MB/sec execute 197 sec latency 9234.327 ms 2024-09-19T05:40:03.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:03 smithi060 ceph-mon[35058]: pgmap v917: 129 pgs: 129 active+clean; 465 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-09-19T05:40:03.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:03 smithi082 ceph-mon[35195]: pgmap v917: 129 pgs: 129 active+clean; 465 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-09-19T05:40:03.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:03 smithi001 ceph-mon[30968]: pgmap v917: 129 pgs: 129 active+clean; 465 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-09-19T05:40:03.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 105012 18.45 MB/sec execute 198 sec latency 77.569 ms 2024-09-19T05:40:04.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 105609 18.52 MB/sec execute 199 sec latency 69.833 ms 2024-09-19T05:40:05.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:05 smithi060 ceph-mon[35058]: pgmap v918: 129 pgs: 129 active+clean; 466 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-09-19T05:40:05.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:05 smithi082 ceph-mon[35195]: pgmap v918: 129 pgs: 129 active+clean; 466 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-09-19T05:40:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:05 smithi001 ceph-mon[30968]: pgmap v918: 129 pgs: 129 active+clean; 466 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.9 MiB/s wr, 213 op/s 2024-09-19T05:40:05.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 105984 18.53 MB/sec execute 200 sec latency 182.937 ms 2024-09-19T05:40:06.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 106301 18.53 MB/sec execute 201 sec latency 250.482 ms 2024-09-19T05:40:07.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:07 smithi001 ceph-mon[30968]: pgmap v919: 129 pgs: 129 active+clean; 469 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2024-09-19T05:40:07.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:07 smithi060 ceph-mon[35058]: pgmap v919: 129 pgs: 129 active+clean; 469 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2024-09-19T05:40:07.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:07 smithi082 ceph-mon[35195]: pgmap v919: 129 pgs: 129 active+clean; 469 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.7 MiB/s wr, 232 op/s 2024-09-19T05:40:07.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 106559 18.52 MB/sec execute 202 sec latency 103.709 ms 2024-09-19T05:40:08.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 106952 18.52 MB/sec execute 203 sec latency 56.709 ms 2024-09-19T05:40:09.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:09 smithi082 ceph-mon[35195]: pgmap v920: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-09-19T05:40:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:09 smithi001 ceph-mon[30968]: pgmap v920: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-09-19T05:40:09.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 107397 18.54 MB/sec execute 204 sec latency 88.647 ms 2024-09-19T05:40:09.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:09 smithi060 ceph-mon[35058]: pgmap v920: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-09-19T05:40:10.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 107943 18.54 MB/sec execute 205 sec latency 78.376 ms 2024-09-19T05:40:11.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:11 smithi082 ceph-mon[35195]: pgmap v921: 129 pgs: 129 active+clean; 462 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-09-19T05:40:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:11 smithi001 ceph-mon[30968]: pgmap v921: 129 pgs: 129 active+clean; 462 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-09-19T05:40:11.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 108241 18.53 MB/sec execute 206 sec latency 317.254 ms 2024-09-19T05:40:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:11 smithi060 ceph-mon[35058]: pgmap v921: 129 pgs: 129 active+clean; 462 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.0 MiB/s wr, 269 op/s 2024-09-19T05:40:12.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 108746 18.60 MB/sec execute 207 sec latency 78.839 ms 2024-09-19T05:40:13.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:13 smithi082 ceph-mon[35195]: pgmap v922: 129 pgs: 129 active+clean; 459 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 315 op/s 2024-09-19T05:40:13.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:13 smithi001 ceph-mon[30968]: pgmap v922: 129 pgs: 129 active+clean; 459 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 315 op/s 2024-09-19T05:40:13.645 INFO:tasks.workunit.client.0.smithi001.stdout: 10 109265 18.67 MB/sec execute 208 sec latency 91.449 ms 2024-09-19T05:40:13.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:13 smithi060 ceph-mon[35058]: pgmap v922: 129 pgs: 129 active+clean; 459 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 315 op/s 2024-09-19T05:40:14.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 109703 18.70 MB/sec execute 209 sec latency 62.351 ms 2024-09-19T05:40:15.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:15 smithi082 ceph-mon[35195]: pgmap v923: 129 pgs: 129 active+clean; 455 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 298 op/s 2024-09-19T05:40:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:15 smithi001 ceph-mon[30968]: pgmap v923: 129 pgs: 129 active+clean; 455 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 298 op/s 2024-09-19T05:40:15.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 110083 18.72 MB/sec execute 210 sec latency 79.388 ms 2024-09-19T05:40:15.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:15 smithi060 ceph-mon[35058]: pgmap v923: 129 pgs: 129 active+clean; 455 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 298 op/s 2024-09-19T05:40:16.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 110339 18.68 MB/sec execute 211 sec latency 190.064 ms 2024-09-19T05:40:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:17 smithi001 ceph-mon[30968]: pgmap v924: 129 pgs: 129 active+clean; 460 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 355 op/s 2024-09-19T05:40:17.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 110632 18.66 MB/sec execute 212 sec latency 90.142 ms 2024-09-19T05:40:17.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:17 smithi060 ceph-mon[35058]: pgmap v924: 129 pgs: 129 active+clean; 460 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 355 op/s 2024-09-19T05:40:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:17 smithi082 ceph-mon[35195]: pgmap v924: 129 pgs: 129 active+clean; 460 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 355 op/s 2024-09-19T05:40:18.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 111034 18.67 MB/sec execute 213 sec latency 100.180 ms 2024-09-19T05:40:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:19 smithi001 ceph-mon[30968]: pgmap v925: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 371 op/s 2024-09-19T05:40:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:19 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:40:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:19 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:40:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:19 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:40:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:19 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:40:19.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 111589 18.68 MB/sec execute 214 sec latency 70.767 ms 2024-09-19T05:40:19.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:19 smithi060 ceph-mon[35058]: pgmap v925: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 371 op/s 2024-09-19T05:40:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:19 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:40:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:19 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:40:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:19 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:40:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:19 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:40:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:19 smithi082 ceph-mon[35195]: pgmap v925: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 371 op/s 2024-09-19T05:40:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:19 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:40:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:19 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:40:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:19 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:40:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:19 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:40:20.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 112163 18.78 MB/sec execute 215 sec latency 64.289 ms 2024-09-19T05:40:21.152 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.0 2024-09-19T05:40:21.152 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:40:21.435 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:40:21.558 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:21 smithi001 ceph-mon[30968]: pgmap v926: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 354 op/s 2024-09-19T05:40:21.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 112524 18.77 MB/sec execute 216 sec latency 213.487 ms 2024-09-19T05:40:21.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:21 smithi060 ceph-mon[35058]: pgmap v926: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 354 op/s 2024-09-19T05:40:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:21 smithi082 ceph-mon[35195]: pgmap v926: 129 pgs: 129 active+clean; 457 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 354 op/s 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.003+0000 7f1f0123d640 1 -- 172.21.15.1:0/3466672484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc106f10 msgr2=0x7f1efc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.003+0000 7f1ef9d9b640 1 -- 172.21.15.1:0/3466672484 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4045020 con 0x7f1efc106f10 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.003+0000 7f1f0123d640 1 --2- 172.21.15.1:0/3466672484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc106f10 0x7f1efc10ea90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1ef401acb0 tx=0x7f1ef403b920 comp rx=0 tx=0).stop 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.006+0000 7f1f0123d640 1 -- 172.21.15.1:0/3466672484 shutdown_connections 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.006+0000 7f1f0123d640 1 --2- 172.21.15.1:0/3466672484 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc106f10 0x7f1efc10ea90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.006+0000 7f1f0123d640 1 --2- 172.21.15.1:0/3466672484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.006+0000 7f1f0123d640 1 --2- 172.21.15.1:0/3466672484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc101de0 0x7f1efc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.006+0000 7f1f0123d640 1 -- 172.21.15.1:0/3466672484 >> 172.21.15.1:0/3466672484 conn(0x7f1efc0fd8e0 msgr2=0x7f1efc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.007+0000 7f1f0123d640 1 -- 172.21.15.1:0/3466672484 shutdown_connections 2024-09-19T05:40:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.007+0000 7f1f0123d640 1 -- 172.21.15.1:0/3466672484 wait complete. 2024-09-19T05:40:22.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.008+0000 7f1f0123d640 1 Processor -- start 2024-09-19T05:40:22.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.008+0000 7f1f0123d640 1 -- start start 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.008+0000 7f1f0123d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc101de0 0x7f1efc075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.008+0000 7f1f0123d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.008+0000 7f1f0123d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc106f10 0x7f1efc06f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56106/0 (socket says 172.21.15.1:56106) 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1efa59c640 1 -- 172.21.15.1:0/1993377904 learned_addr learned my addr 172.21.15.1:0/1993377904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1efb59e640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc106f10 0x7f1efc06f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc06e630 con 0x7f1efc101de0 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc06e4b0 con 0x7f1efc102790 2024-09-19T05:40:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.009+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc06e7b0 con 0x7f1efc106f10 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 -- 172.21.15.1:0/1993377904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc106f10 msgr2=0x7f1efc06f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc106f10 0x7f1efc06f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 -- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc101de0 msgr2=0x7f1efc075760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc101de0 0x7f1efc075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc0701c0 con 0x7f1efc102790 2024-09-19T05:40:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.010+0000 7f1efa59c640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000e9f0 tx=0x7f1ef000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:22.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.011+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000cd80 con 0x7f1efc102790 2024-09-19T05:40:22.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.011+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1efc0704b0 con 0x7f1efc102790 2024-09-19T05:40:22.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.011+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1efc1bc550 con 0x7f1efc102790 2024-09-19T05:40:22.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.011+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ef0010910 con 0x7f1efc102790 2024-09-19T05:40:22.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.011+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0018980 con 0x7f1efc102790 2024-09-19T05:40:22.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.015+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee8005290 con 0x7f1efc102790 2024-09-19T05:40:22.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.015+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1ef0018b20 con 0x7f1efc102790 2024-09-19T05:40:22.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.016+0000 7f1ee3fff640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 0x7f1ee40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:22.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.016+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1ef00cff00 con 0x7f1efc102790 2024-09-19T05:40:22.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.019+0000 7f1efad9d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 0x7f1ee40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:22.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.023+0000 7f1efad9d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 0x7f1ee40a5920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009710 tx=0x7f1eec006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:22.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.025+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ef009c810 con 0x7f1efc102790 2024-09-19T05:40:22.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.296+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ee8005580 con 0x7f1efc102790 2024-09-19T05:40:22.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.297+0000 7f1ee3fff640 1 -- 172.21.15.1:0/1993377904 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f1ef009c110 con 0x7f1efc102790 2024-09-19T05:40:22.300 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:40:22.300 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:40:22.300 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 msgr2=0x7f1ee40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 0x7f1ee40a5920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009710 tx=0x7f1eec006c90 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 msgr2=0x7f1efc075ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000e9f0 tx=0x7f1ef000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 shutdown_connections 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1ee40a3460 0x7f1ee40a5920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1efc106f10 0x7f1efc06f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1efc102790 0x7f1efc075ca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 --2- 172.21.15.1:0/1993377904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1efc101de0 0x7f1efc075760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 >> 172.21.15.1:0/1993377904 conn(0x7f1efc0fd8e0 msgr2=0x7f1efc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:22.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 shutdown_connections 2024-09-19T05:40:22.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:22.300+0000 7f1f0123d640 1 -- 172.21.15.1:0/1993377904 wait complete. 2024-09-19T05:40:22.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 112892 18.82 MB/sec execute 217 sec latency 75.737 ms 2024-09-19T05:40:23.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:23 smithi001 ceph-mon[30968]: pgmap v927: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.8 MiB/s wr, 386 op/s 2024-09-19T05:40:23.523 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:23 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1993377904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:23.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 154.0 --await-for 45.0' 2024-09-19T05:40:23.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 154.0 --await-for 45.0 2024-09-19T05:40:23.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113291 18.82 MB/sec execute 218 sec latency 75.352 ms 2024-09-19T05:40:23.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:23 smithi060 ceph-mon[35058]: pgmap v927: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.8 MiB/s wr, 386 op/s 2024-09-19T05:40:23.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:23 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1993377904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:23 smithi082 ceph-mon[35195]: pgmap v927: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.8 MiB/s wr, 386 op/s 2024-09-19T05:40:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:23 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1993377904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:23.890 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:40:24.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113623 18.82 MB/sec execute 219 sec latency 96.999 ms 2024-09-19T05:40:25.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 -- 172.21.15.1:0/4193081386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 msgr2=0x7f1e2010bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 --2- 172.21.15.1:0/4193081386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2010bbd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009900 tx=0x7f1e1002a480 comp rx=0 tx=0).stop 2024-09-19T05:40:25.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 -- 172.21.15.1:0/4193081386 shutdown_connections 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 --2- 172.21.15.1:0/4193081386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e2010c1a0 0x7f1e2010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 --2- 172.21.15.1:0/4193081386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2010bbd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 --2- 172.21.15.1:0/4193081386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e20102dc0 0x7f1e201031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 -- 172.21.15.1:0/4193081386 >> 172.21.15.1:0/4193081386 conn(0x7f1e200fc7a0 msgr2=0x7f1e200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 -- 172.21.15.1:0/4193081386 shutdown_connections 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.153+0000 7f1e27a98640 1 -- 172.21.15.1:0/4193081386 wait complete. 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 Processor -- start 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 -- start start 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20102dc0 0x7f1e2019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 0x7f1e2019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20101af0 con 0x7f1e201036e0 2024-09-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20101970 con 0x7f1e2010c1a0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e27a98640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20101c70 con 0x7f1e20102dc0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e25033640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e25033640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51602/0 (socket says 172.21.15.1:51602) 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e25033640 1 -- 172.21.15.1:0/1221577458 learned_addr learned my addr 172.21.15.1:0/1221577458 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e25834640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20102dc0 0x7f1e2019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.154+0000 7f1e26035640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 0x7f1e2019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 -- 172.21.15.1:0/1221577458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20102dc0 msgr2=0x7f1e2019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20102dc0 0x7f1e2019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 -- 172.21.15.1:0/1221577458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 msgr2=0x7f1e2019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 0x7f1e2019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 -- 172.21.15.1:0/1221577458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2019f600 con 0x7f1e201036e0 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e26035640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 0x7f1e2019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.155+0000 7f1e25033640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e10004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.156+0000 7f1e16ffd640 1 -- 172.21.15.1:0/1221577458 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003f030 con 0x7f1e201036e0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.156+0000 7f1e16ffd640 1 -- 172.21.15.1:0/1221577458 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e10004440 con 0x7f1e201036e0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.157+0000 7f1e16ffd640 1 -- 172.21.15.1:0/1221577458 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035070 con 0x7f1e201036e0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.157+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2019f890 con 0x7f1e201036e0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.157+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e201a71d0 con 0x7f1e201036e0 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.160+0000 7f1e29e71740 1 Processor -- start 2024-09-19T05:40:25.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.160+0000 7f1e29e71740 1 -- start start 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1f080 0x565194f29400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f2bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565194e842a0 con 0x565194f29940 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565194e2bb10 con 0x565194f1f080 2024-09-19T05:40:25.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e29e71740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565194e80260 con 0x565194f1e760 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e16ffd640 1 -- 172.21.15.1:0/1221577458 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1e10042030 con 0x7f1e201036e0 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:46340/0 (socket says 172.21.15.1:46340) 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 -- 172.21.15.1:0/2081374241 learned_addr learned my addr 172.21.15.1:0/2081374241 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e25834640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1f080 0x565194f29400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e25033640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f2bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 -- 172.21.15.1:0/2081374241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1f080 msgr2=0x565194f29400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1f080 0x565194f29400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 -- 172.21.15.1:0/2081374241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 msgr2=0x565194f2bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f2bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e26035640 1 -- 172.21.15.1:0/2081374241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565194bf5b90 con 0x565194f1e760 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.161+0000 7f1e25033640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f2bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e26035640 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e18011790 tx=0x7f1e18011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cfe3a3bd94be583 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e16ffd640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 0x7f1e0c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e0bfff640 1 -- 172.21.15.1:0/2081374241 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18003c30 con 0x565194f1e760 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e0bfff640 1 -- 172.21.15.1:0/2081374241 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e1800fe80 con 0x565194f1e760 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e0bfff640 1 -- 172.21.15.1:0/2081374241 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180193e0 con 0x565194f1e760 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e25834640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 0x7f1e0c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.162+0000 7f1e16ffd640 1 -- 172.21.15.1:0/1221577458 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1e100efd30 con 0x7f1e201036e0 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e25834640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 0x7f1e0c0a5850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x565194f1bb50 tx=0x7f1e1c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 -- 172.21.15.1:0/2081374241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 msgr2=0x565194f1eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e18011790 tx=0x7f1e18011c50 comp rx=0 tx=0).stop 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 -- 172.21.15.1:0/2081374241 shutdown_connections 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f2bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1f080 0x565194f29400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 --2- 172.21.15.1:0/2081374241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1e760 0x565194f1eb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 -- 172.21.15.1:0/2081374241 >> 172.21.15.1:0/2081374241 conn(0x565194f1acf0 msgr2=0x565194f1b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:25.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 -- 172.21.15.1:0/2081374241 shutdown_connections 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.163+0000 7f1e29e71740 1 -- 172.21.15.1:0/2081374241 wait complete. 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 -- start start 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 Processor -- start 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f27250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x565194f2c510 con 0x565194f29940 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565194e0c6e0 con 0x565194f1e760 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565194f2c690 con 0x565194f1f080 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e29e71740 10 client.0 _ll_register_callbacks cb 0x565194e30a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e25834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e26035640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f27250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e25033640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e26035640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f27250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51628/0 (socket says 172.21.15.1:51628) 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e25033640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:46354/0 (socket says 172.21.15.1:46354) 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.164+0000 7f1e26035640 1 -- 172.21.15.1:0/3152585654 learned_addr learned my addr 172.21.15.1:0/3152585654 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 -- 172.21.15.1:0/3152585654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 msgr2=0x565194f267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 -- 172.21.15.1:0/3152585654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 msgr2=0x565194f27250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f27250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 -- 172.21.15.1:0/3152585654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565194f359b0 con 0x565194f1f080 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e25033640 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x565194f1c070 tx=0x7f1e100b8440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a64aa25342a61cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e097fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e100bc0b0 con 0x565194f1f080 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1e100b8720 con 0x565194f1f080 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565194e919d0 con 0x565194f1f080 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1e100ad050 con 0x565194f1f080 2024-09-19T05:40:25.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e29e71740 10 client.25531 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.165+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565194f2c570 con 0x565194f1f080 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x565194e919d0 con 0x565194f1f080 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1e100c47e0 con 0x565194f1f080 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 10 client.25531 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 10 client.25531 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 20 client.25531 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194f39940 0x565194f3bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 4 client.25531 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565194e8bd20 con 0x565194f39940 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e25834640 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194f39940 0x565194f3bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.166+0000 7f1e097fa640 10 client.25531 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:25.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.167+0000 7f1e25834640 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194f39940 0x565194f3bd60 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c6840662f286d3 server_cookie=814f117a56cecb72 in_seq=0 out_seq=0 2024-09-19T05:40:25.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e097fa640 1 -- 172.21.15.1:0/3152585654 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565194e8bd20 con 0x565194f39940 2024-09-19T05:40:25.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e097fa640 10 client.25531 handle_command_reply: tid=0 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 client.25531 shutdown 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 msgr2=0x565194f26d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x565194f1c070 tx=0x7f1e100b8440 comp rx=0 tx=0).stop 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 shutdown_connections 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f27250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194f39940 0x565194f3bd60 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f26d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 --2- 172.21.15.1:0/3152585654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e097fa640 0 client.25531 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 >> 172.21.15.1:0/3152585654 conn(0x565194f1acf0 msgr2=0x565194f19e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 shutdown_connections 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 1 -- 172.21.15.1:0/3152585654 wait complete. 2024-09-19T05:40:25.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.171+0000 7f1e29e71740 20 client.25531 trim_cache size 0 max 16384 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 Processor -- start 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 -- start start 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f34ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f23a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201aee80 con 0x565194f29940 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201b1700 con 0x565194f1e760 2024-09-19T05:40:25.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e29e71740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201af4f0 con 0x565194f1f080 2024-09-19T05:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e25834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e26035640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f23a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e25033640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f34ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e25834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:41506/0 (socket says 172.21.15.1:41506) 2024-09-19T05:40:25.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.197+0000 7f1e25834640 1 -- 172.21.15.1:0/1751677195 learned_addr learned my addr 172.21.15.1:0/1751677195 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 -- 172.21.15.1:0/1751677195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 msgr2=0x565194f211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 -- 172.21.15.1:0/1751677195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 msgr2=0x565194f23a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f23a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 -- 172.21.15.1:0/1751677195 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565194f25780 con 0x565194f1f080 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e25033640 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f34ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b8510 tx=0x7f1e10049000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f002532a9155233 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e0b7fe640 1 -- 172.21.15.1:0/1751677195 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e100bbbf0 con 0x565194f1f080 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e0b7fe640 1 -- 172.21.15.1:0/1751677195 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e100bc0b0 con 0x565194f1f080 2024-09-19T05:40:25.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.198+0000 7f1e0b7fe640 1 -- 172.21.15.1:0/1751677195 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e100035f0 con 0x565194f1f080 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.199+0000 7f1e29e71740 1 -- 172.21.15.1:0/1751677195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 msgr2=0x565194f34ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f34ff0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b8510 tx=0x7f1e10049000 comp rx=0 tx=0).stop 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 -- 172.21.15.1:0/1751677195 shutdown_connections 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194f23a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f34ff0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1751677195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 -- 172.21.15.1:0/1751677195 >> 172.21.15.1:0/1751677195 conn(0x565194f1acf0 msgr2=0x565194f348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 -- 172.21.15.1:0/1751677195 shutdown_connections 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.200+0000 7f1e29e71740 1 -- 172.21.15.1:0/1751677195 wait complete. 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.201+0000 7f1e29e71740 1 -- start start 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.201+0000 7f1e29e71740 1 Processor -- start 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.201+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f3fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.201+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f3ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e29e71740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194fa3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e25033640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f3ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e25834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f3fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e29e71740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201afbc0 con 0x565194f29940 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e29e71740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201b1030 con 0x565194f1e760 2024-09-19T05:40:25.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e25834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f3fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:41522/0 (socket says 172.21.15.1:41522) 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e29e71740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1e201b0290 con 0x565194f1f080 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e25834640 1 -- 172.21.15.1:0/1618373367 learned_addr learned my addr 172.21.15.1:0/1618373367 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e29e71740 10 client.0 _ll_register_callbacks cb 0x7f1e10009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e26035640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194fa3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e26035640 1 -- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 msgr2=0x565194f3ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e26035640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f3ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e26035640 1 -- 172.21.15.1:0/1618373367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 msgr2=0x565194f3fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.202+0000 7f1e26035640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f3fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.203+0000 7f1e26035640 1 -- 172.21.15.1:0/1618373367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565194fa3aa0 con 0x565194f29940 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.203+0000 7f1e26035640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194fa3530 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e1800fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e27dbb47d1ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:25.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.203+0000 7f1e097fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18029070 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f1e18004250 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e100bc0b0 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1e18035050 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e29e71740 10 client.15981 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.204+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565194fa4d60 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e100bc0b0 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1e18018070 con 0x565194f29940 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 10 client.15981 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 10 client.15981 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 20 client.15981 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194fa5350 0x565194fa7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 4 client.15981 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.0, "await_for": 45.0}] 2024-09-19T05:40:25.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.0, "await_for": 45.0}) -- 0x565194e07ec0 con 0x565194fa5350 2024-09-19T05:40:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.205+0000 7f1e25834640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194fa5350 0x565194fa7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.206+0000 7f1e097fa640 10 client.15981 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:25.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:25.206+0000 7f1e25834640 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194fa5350 0x565194fa7740 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4ff5ba0fde0317 server_cookie=ee318021aee3f4a5 in_seq=0 out_seq=0 2024-09-19T05:40:25.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:25 smithi001 ceph-mon[30968]: pgmap v928: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-19T05:40:25.553 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:25 smithi060 ceph-mon[35058]: pgmap v928: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-19T05:40:25.560 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:25 smithi082 ceph-mon[35195]: pgmap v928: 129 pgs: 129 active+clean; 467 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-19T05:40:25.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113809 18.77 MB/sec execute 220 sec latency 458.220 ms 2024-09-19T05:40:26.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e097fa640 1 -- 172.21.15.1:0/1618373367 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x565194e07ec0 con 0x565194fa5350 2024-09-19T05:40:26.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e097fa640 10 client.15981 handle_command_reply: tid=0 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 client.15981 shutdown 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 msgr2=0x565194fa3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194fa3530 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e1800fc20 comp rx=0 tx=0).stop 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 shutdown_connections 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x565194f29940 0x565194fa3530 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x565194fa5350 0x565194fa7740 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565194f1f080 0x565194f3ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e097fa640 0 client.15981 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:26.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 --2- 172.21.15.1:0/1618373367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565194f1e760 0x565194f3fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 >> 172.21.15.1:0/1618373367 conn(0x565194f1acf0 msgr2=0x565194f35100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 shutdown_connections 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.315+0000 7f1e29e71740 1 -- 172.21.15.1:0/1618373367 wait complete. 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e29e71740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 66, 2024-09-19T05:40:26.319 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "4607498d": { 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 66, 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 154.0, 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:40:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 msgr2=0x7f1e0c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 0x7f1e0c0a5850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x565194f1bb50 tx=0x7f1e1c005f90 comp rx=0 tx=0).stop 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 msgr2=0x7f1e2019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1e10006010 tx=0x7f1e10004040 comp rx=0 tx=0).stop 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 shutdown_connections 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f1e0c0a3390 0x7f1e0c0a5850 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2010c1a0 0x7f1e2019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e201036e0 0x7f1e2019ab90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 --2- 172.21.15.1:0/1221577458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20102dc0 0x7f1e2019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:26.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 >> 172.21.15.1:0/1221577458 conn(0x7f1e200fc7a0 msgr2=0x7f1e200fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:26.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 shutdown_connections 2024-09-19T05:40:26.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:26.316+0000 7f1e27a98640 1 -- 172.21.15.1:0/1221577458 wait complete. 2024-09-19T05:40:26.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.69 MB/sec execute 221 sec latency 1458.292 ms 2024-09-19T05:40:27.039 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4607498d', quiesce took 5.9 seconds. Will release after: 28.1 2024-09-19T05:40:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:27 smithi001 ceph-mon[30968]: pgmap v929: 129 pgs: 129 active+clean; 456 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 364 op/s 2024-09-19T05:40:27.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.60 MB/sec execute 222 sec latency 2458.399 ms 2024-09-19T05:40:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:27 smithi060 ceph-mon[35058]: pgmap v929: 129 pgs: 129 active+clean; 456 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 364 op/s 2024-09-19T05:40:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:27 smithi082 ceph-mon[35195]: pgmap v929: 129 pgs: 129 active+clean; 456 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 364 op/s 2024-09-19T05:40:28.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.52 MB/sec execute 223 sec latency 3458.521 ms 2024-09-19T05:40:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:29 smithi082 ceph-mon[35195]: pgmap v930: 129 pgs: 129 active+clean; 444 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:40:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:29 smithi001 ceph-mon[30968]: pgmap v930: 129 pgs: 129 active+clean; 444 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:40:29.646 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.44 MB/sec execute 224 sec latency 4458.649 ms 2024-09-19T05:40:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:29 smithi060 ceph-mon[35058]: pgmap v930: 129 pgs: 129 active+clean; 444 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 359 op/s 2024-09-19T05:40:30.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.36 MB/sec execute 225 sec latency 5458.753 ms 2024-09-19T05:40:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:31 smithi001 ceph-mon[30968]: pgmap v931: 129 pgs: 129 active+clean; 436 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 315 op/s 2024-09-19T05:40:31.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.27 MB/sec execute 226 sec latency 6458.875 ms 2024-09-19T05:40:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:31 smithi060 ceph-mon[35058]: pgmap v931: 129 pgs: 129 active+clean; 436 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 315 op/s 2024-09-19T05:40:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:31 smithi082 ceph-mon[35195]: pgmap v931: 129 pgs: 129 active+clean; 436 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.4 MiB/s wr, 315 op/s 2024-09-19T05:40:32.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.19 MB/sec execute 227 sec latency 7458.997 ms 2024-09-19T05:40:33.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:33 smithi001 ceph-mon[30968]: pgmap v932: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 309 op/s 2024-09-19T05:40:33.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.11 MB/sec execute 228 sec latency 8459.121 ms 2024-09-19T05:40:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:33 smithi060 ceph-mon[35058]: pgmap v932: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 309 op/s 2024-09-19T05:40:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:33 smithi082 ceph-mon[35195]: pgmap v932: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 309 op/s 2024-09-19T05:40:34.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 18.03 MB/sec execute 229 sec latency 9459.174 ms 2024-09-19T05:40:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:35 smithi001 ceph-mon[30968]: pgmap v933: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-19T05:40:35.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.96 MB/sec execute 230 sec latency 10459.235 ms 2024-09-19T05:40:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:35 smithi060 ceph-mon[35058]: pgmap v933: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-19T05:40:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:35 smithi082 ceph-mon[35195]: pgmap v933: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-09-19T05:40:36.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.88 MB/sec execute 231 sec latency 11459.288 ms 2024-09-19T05:40:37.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:37 smithi001 ceph-mon[30968]: pgmap v934: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-19T05:40:37.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.80 MB/sec execute 232 sec latency 12459.387 ms 2024-09-19T05:40:37.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:37 smithi060 ceph-mon[35058]: pgmap v934: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-19T05:40:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:37 smithi082 ceph-mon[35195]: pgmap v934: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 157 op/s 2024-09-19T05:40:38.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.73 MB/sec execute 233 sec latency 13459.427 ms 2024-09-19T05:40:39.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:39 smithi001 ceph-mon[30968]: pgmap v935: 129 pgs: 129 active+clean; 443 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-19T05:40:39.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.65 MB/sec execute 234 sec latency 14459.478 ms 2024-09-19T05:40:39.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:39 smithi060 ceph-mon[35058]: pgmap v935: 129 pgs: 129 active+clean; 443 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-19T05:40:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:39 smithi082 ceph-mon[35195]: pgmap v935: 129 pgs: 129 active+clean; 443 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 135 op/s 2024-09-19T05:40:40.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.57 MB/sec execute 235 sec latency 15459.593 ms 2024-09-19T05:40:41.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:41 smithi001 ceph-mon[30968]: pgmap v936: 129 pgs: 129 active+clean; 442 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.5 MiB/s wr, 44 op/s 2024-09-19T05:40:41.647 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.50 MB/sec execute 236 sec latency 16459.694 ms 2024-09-19T05:40:41.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:41 smithi060 ceph-mon[35058]: pgmap v936: 129 pgs: 129 active+clean; 442 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.5 MiB/s wr, 44 op/s 2024-09-19T05:40:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:41 smithi082 ceph-mon[35195]: pgmap v936: 129 pgs: 129 active+clean; 442 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 1.5 MiB/s wr, 44 op/s 2024-09-19T05:40:42.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.43 MB/sec execute 237 sec latency 17459.812 ms 2024-09-19T05:40:43.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:43 smithi001 ceph-mon[30968]: pgmap v937: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.5 MiB/s wr, 74 op/s 2024-09-19T05:40:43.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.35 MB/sec execute 238 sec latency 18459.868 ms 2024-09-19T05:40:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:43 smithi060 ceph-mon[35058]: pgmap v937: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.5 MiB/s wr, 74 op/s 2024-09-19T05:40:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:43 smithi082 ceph-mon[35195]: pgmap v937: 129 pgs: 129 active+clean; 435 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 2.5 MiB/s wr, 74 op/s 2024-09-19T05:40:44.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.28 MB/sec execute 239 sec latency 19459.968 ms 2024-09-19T05:40:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:45 smithi001 ceph-mon[30968]: pgmap v938: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 68 op/s 2024-09-19T05:40:45.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.21 MB/sec execute 240 sec latency 20460.076 ms 2024-09-19T05:40:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:45 smithi060 ceph-mon[35058]: pgmap v938: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 68 op/s 2024-09-19T05:40:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:45 smithi082 ceph-mon[35195]: pgmap v938: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.6 MiB/s wr, 68 op/s 2024-09-19T05:40:46.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.14 MB/sec execute 241 sec latency 21460.129 ms 2024-09-19T05:40:47.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:47 smithi001 ceph-mon[30968]: pgmap v939: 129 pgs: 129 active+clean; 433 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 3.2 MiB/s wr, 93 op/s 2024-09-19T05:40:47.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.07 MB/sec execute 242 sec latency 22460.221 ms 2024-09-19T05:40:47.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:47 smithi060 ceph-mon[35058]: pgmap v939: 129 pgs: 129 active+clean; 433 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 3.2 MiB/s wr, 93 op/s 2024-09-19T05:40:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:47 smithi082 ceph-mon[35195]: pgmap v939: 129 pgs: 129 active+clean; 433 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 3.2 MiB/s wr, 93 op/s 2024-09-19T05:40:48.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 17.00 MB/sec execute 243 sec latency 23460.272 ms 2024-09-19T05:40:49.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:49 smithi001 ceph-mon[30968]: pgmap v940: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.9 MiB/s wr, 116 op/s 2024-09-19T05:40:49.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.93 MB/sec execute 244 sec latency 24460.375 ms 2024-09-19T05:40:49.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:49 smithi060 ceph-mon[35058]: pgmap v940: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.9 MiB/s wr, 116 op/s 2024-09-19T05:40:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:49 smithi082 ceph-mon[35195]: pgmap v940: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 3.9 MiB/s wr, 116 op/s 2024-09-19T05:40:50.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.86 MB/sec execute 245 sec latency 25460.482 ms 2024-09-19T05:40:51.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:51 smithi001 ceph-mon[30968]: pgmap v941: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 3.2 MiB/s wr, 112 op/s 2024-09-19T05:40:51.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.79 MB/sec execute 246 sec latency 26460.539 ms 2024-09-19T05:40:51.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:51 smithi060 ceph-mon[35058]: pgmap v941: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 3.2 MiB/s wr, 112 op/s 2024-09-19T05:40:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:51 smithi082 ceph-mon[35195]: pgmap v941: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 3.2 MiB/s wr, 112 op/s 2024-09-19T05:40:52.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.72 MB/sec execute 247 sec latency 27460.634 ms 2024-09-19T05:40:53.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:53 smithi001 ceph-mon[30968]: pgmap v942: 129 pgs: 129 active+clean; 433 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 4.0 MiB/s wr, 137 op/s 2024-09-19T05:40:53.648 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.65 MB/sec execute 248 sec latency 28460.689 ms 2024-09-19T05:40:53.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:53 smithi060 ceph-mon[35058]: pgmap v942: 129 pgs: 129 active+clean; 433 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 4.0 MiB/s wr, 137 op/s 2024-09-19T05:40:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:53 smithi082 ceph-mon[35195]: pgmap v942: 129 pgs: 129 active+clean; 433 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 4.0 MiB/s wr, 137 op/s 2024-09-19T05:40:54.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.59 MB/sec execute 249 sec latency 29460.782 ms 2024-09-19T05:40:55.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:40:55.420 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:40:55.542 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:55 smithi001 ceph-mon[30968]: pgmap v943: 129 pgs: 129 active+clean; 431 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2024-09-19T05:40:55.561 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:55 smithi082 ceph-mon[35195]: pgmap v943: 129 pgs: 129 active+clean; 431 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2024-09-19T05:40:55.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.52 MB/sec execute 250 sec latency 30460.885 ms 2024-09-19T05:40:55.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:55 smithi060 ceph-mon[35058]: pgmap v943: 129 pgs: 129 active+clean; 431 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.2 MiB/s wr, 109 op/s 2024-09-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 -- 172.21.15.1:0/1651350365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3241036e0 msgr2=0x7fd324107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/1651350365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3241036e0 0x7fd324107b90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd318009930 tx=0x7fd31802a420 comp rx=0 tx=0).stop 2024-09-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 -- 172.21.15.1:0/1651350365 shutdown_connections 2024-09-19T05:40:55.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/1651350365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241082a0 0x7fd32410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/1651350365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3241036e0 0x7fd324107b90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/1651350365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd324102d30 0x7fd324103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 -- 172.21.15.1:0/1651350365 >> 172.21.15.1:0/1651350365 conn(0x7fd3240fc7d0 msgr2=0x7fd3240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 -- 172.21.15.1:0/1651350365 shutdown_connections 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 -- 172.21.15.1:0/1651350365 wait complete. 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.902+0000 7fd32c7f2640 1 Processor -- start 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 -- start start 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241036e0 0x7fd324198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3241082a0 0x7fd32419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd3241120c0 con 0x7fd324102d30 2024-09-19T05:40:55.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd324111f40 con 0x7fd3241082a0 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32c7f2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd324112240 con 0x7fd3241036e0 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42746/0 (socket says 172.21.15.1:42746) 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 -- 172.21.15.1:0/576880454 learned_addr learned my addr 172.21.15.1:0/576880454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd329d8d640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241036e0 0x7fd324198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32ad8f640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3241082a0 0x7fd32419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 -- 172.21.15.1:0/576880454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241036e0 msgr2=0x7fd324198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241036e0 0x7fd324198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 -- 172.21.15.1:0/576880454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3241082a0 msgr2=0x7fd32419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3241082a0 0x7fd32419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 -- 172.21.15.1:0/576880454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32419d5d0 con 0x7fd324102d30 2024-09-19T05:40:55.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.903+0000 7fd32a58e640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cce0 tx=0x7fd31400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.904+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314004b20 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.904+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd314004cc0 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.904+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32419d8c0 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.904+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31400f7d0 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.904+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3241a51a0 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.905+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd324103110 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.907+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd31400f970 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.907+0000 7fd3237fe640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 0x7fd30c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.908+0000 7fd329d8d640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 0x7fd30c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.908+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd3140d0100 con 0x7fd324102d30 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.908+0000 7fd329d8d640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 0x7fd30c0a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd318005940 tx=0x7fd3180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:55.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:55.911+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd314014030 con 0x7fd324102d30 2024-09-19T05:40:56.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.125+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd324199980 con 0x7fd324102d30 2024-09-19T05:40:56.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.126+0000 7fd3237fe640 1 -- 172.21.15.1:0/576880454 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fd324199980 con 0x7fd324102d30 2024-09-19T05:40:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:40:56.129 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:40:56.130 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 msgr2=0x7fd30c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 0x7fd30c0a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd318005940 tx=0x7fd3180058d0 comp rx=0 tx=0).stop 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 msgr2=0x7fd324198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cce0 tx=0x7fd31400a620 comp rx=0 tx=0).stop 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 shutdown_connections 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd30c0a3240 0x7fd30c0a5700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3241082a0 0x7fd32419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3241036e0 0x7fd324198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:56.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 --2- 172.21.15.1:0/576880454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd324102d30 0x7fd324198620 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 >> 172.21.15.1:0/576880454 conn(0x7fd3240fc7d0 msgr2=0x7fd324105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 shutdown_connections 2024-09-19T05:40:56.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:56.128+0000 7fd32c7f2640 1 -- 172.21.15.1:0/576880454 wait complete. 2024-09-19T05:40:56.563 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:56 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/576880454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:56.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.45 MB/sec execute 251 sec latency 31460.947 ms 2024-09-19T05:40:56.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:56 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/576880454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:56.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:56 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/576880454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:40:56.837 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 4607498d --release --await' 2024-09-19T05:40:56.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 4607498d --release --await 2024-09-19T05:40:57.092 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:40:57.485 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:57 smithi001 ceph-mon[30968]: pgmap v944: 129 pgs: 129 active+clean; 429 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.8 MiB/s wr, 132 op/s 2024-09-19T05:40:57.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 113818 16.39 MB/sec execute 252 sec latency 32460.997 ms 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 -- 172.21.15.1:0/3908644334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4102d90 msgr2=0x7fc9b4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 --2- 172.21.15.1:0/3908644334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4102d90 0x7fc9b4103170 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009cd0 tx=0x7fc9a402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 -- 172.21.15.1:0/3908644334 shutdown_connections 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 --2- 172.21.15.1:0/3908644334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4108290 0x7fc9b410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 --2- 172.21.15.1:0/3908644334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4103740 0x7fc9b4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 --2- 172.21.15.1:0/3908644334 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4102d90 0x7fc9b4103170 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 -- 172.21.15.1:0/3908644334 >> 172.21.15.1:0/3908644334 conn(0x7fc9b40fc7d0 msgr2=0x7fc9b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 -- 172.21.15.1:0/3908644334 shutdown_connections 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.708+0000 7fc9b951c640 1 -- 172.21.15.1:0/3908644334 wait complete. 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 Processor -- start 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 -- start start 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4102d90 0x7fc9b41009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4103740 0x7fc9b4100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4112090 con 0x7fc9b4108290 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4111f10 con 0x7fc9b4103740 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b951c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4112210 con 0x7fc9b4102d90 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42766/0 (socket says 172.21.15.1:42766) 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.709+0000 7fc9b37fe640 1 -- 172.21.15.1:0/2203753147 learned_addr learned my addr 172.21.15.1:0/2203753147 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4103740 0x7fc9b4100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4102d90 0x7fc9b41009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 -- 172.21.15.1:0/2203753147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4102d90 msgr2=0x7fc9b41009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4102d90 0x7fc9b41009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 -- 172.21.15.1:0/2203753147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4103740 msgr2=0x7fc9b4100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4103740 0x7fc9b4100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 -- 172.21.15.1:0/2203753147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b41a6a70 con 0x7fc9b4108290 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b37fe640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e970 tx=0x7fc9ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc99bfff640 1 -- 172.21.15.1:0/2203753147 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00ccc0 con 0x7fc9b4108290 2024-09-19T05:40:57.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b41a6d60 con 0x7fc9b4108290 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc99bfff640 1 -- 172.21.15.1:0/2203753147 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9ac00ce60 con 0x7fc9b4108290 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc99bfff640 1 -- 172.21.15.1:0/2203753147 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac010490 con 0x7fc9b4108290 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.710+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b41a7250 con 0x7fc9b4108290 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.712+0000 7fc99bfff640 1 -- 172.21.15.1:0/2203753147 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc9ac005020 con 0x7fc9b4108290 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 Processor -- start 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 -- start start 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0d854b620 con 0x55c0d85f1240 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c0d84f2e50 con 0x55c0d85e6980 2024-09-19T05:40:57.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c0d85475e0 con 0x55c0d85e6060 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42774/0 (socket says 172.21.15.1:42774) 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc9b27fc640 1 -- 172.21.15.1:0/1099592244 learned_addr learned my addr 172.21.15.1:0/1099592244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.713+0000 7fc99bfff640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b37fe640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 -- 172.21.15.1:0/1099592244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 msgr2=0x55c0d85e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc99bfff640 1 -- 172.21.15.1:0/2203753147 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc9ac0d01f0 con 0x7fc9b4108290 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 -- 172.21.15.1:0/1099592244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 msgr2=0x55c0d85f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 -- 172.21.15.1:0/1099592244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d84e3d40 con 0x55c0d85f1240 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8012560 tx=0x7fc9a800b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20d3b90bd523556 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9b37fe640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 0x7fc99c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac004fd0 tx=0x7fc9ac0bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9997fa640 1 -- 172.21.15.1:0/1099592244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a801e640 con 0x55c0d85f1240 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9997fa640 1 -- 172.21.15.1:0/1099592244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8010910 con 0x55c0d85f1240 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.714+0000 7fc9997fa640 1 -- 172.21.15.1:0/1099592244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a801d8e0 con 0x55c0d85f1240 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/1099592244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 msgr2=0x55c0d85f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8012560 tx=0x7fc9a800b9b0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/1099592244 shutdown_connections 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f3630 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/1099592244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/1099592244 >> 172.21.15.1:0/1099592244 conn(0x55c0d85e25f0 msgr2=0x55c0d85e29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/1099592244 shutdown_connections 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/1099592244 wait complete. 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.715+0000 7fc9bb8f5740 1 -- start start 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 Processor -- start 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6060 0x55c0d85ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d85eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c0d85f3e10 con 0x55c0d85e6980 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c0d84d3f10 con 0x55c0d85e6060 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c0d85f3f90 con 0x55c0d85f1240 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9bb8f5740 10 client.0 _ll_register_callbacks cb 0x55c0d84f7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42786/0 (socket says 172.21.15.1:42786) 2024-09-19T05:40:57.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 -- 172.21.15.1:0/547020723 learned_addr learned my addr 172.21.15.1:0/547020723 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6060 0x55c0d85ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d85eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 -- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 msgr2=0x55c0d85eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d85eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 -- 172.21.15.1:0/547020723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6060 msgr2=0x55c0d85ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6060 0x55c0d85ee0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b2ffd640 1 -- 172.21.15.1:0/547020723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d825a580 con 0x55c0d85e6980 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.716+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d85eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009cd0 tx=0x7fc9a4031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7b6d640eaa2793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:40:57.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4049060 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc9a4003970 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a8010910 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc9a4003b70 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 10 client.15999 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c0d8324960 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8010910 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc9a4043070 con 0x55c0d85e6980 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 10 client.15999 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 10 client.15999 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 20 client.15999 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:57.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d8600d90 0x55c0d8603200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 4 client.15999 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.717+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0d8558b90 con 0x55c0d8600d90 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.718+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d8600d90 0x55c0d8603200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.718+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d8600d90 0x55c0d8603200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=711bcc21eb81efb server_cookie=99ebc19422375bdb in_seq=0 out_seq=0 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.718+0000 7fc996ff5640 10 client.15999 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc996ff5640 1 -- 172.21.15.1:0/547020723 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0d8558b90 con 0x55c0d8600d90 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc996ff5640 10 client.15999 handle_command_reply: tid=0 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 client.15999 shutdown 2024-09-19T05:40:57.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 msgr2=0x55c0d85ee620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009cd0 tx=0x7fc9a4031af0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 shutdown_connections 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d8600d90 0x55c0d8603200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d85eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6980 0x55c0d85ee620 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc996ff5640 0 client.15999 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/547020723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6060 0x55c0d85ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 >> 172.21.15.1:0/547020723 conn(0x55c0d85e25f0 msgr2=0x55c0d85e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 shutdown_connections 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/547020723 wait complete. 2024-09-19T05:40:57.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.719+0000 7fc9bb8f5740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T05:40:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 Processor -- start 2024-09-19T05:40:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 -- start start 2024-09-19T05:40:57.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d8608ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d8609010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41aef80 con 0x55c0d85e6060 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41b1800 con 0x55c0d85e6980 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41af5f0 con 0x55c0d85f1240 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42794/0 (socket says 172.21.15.1:42794) 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.736+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3971399762 learned_addr learned my addr 172.21.15.1:0/3971399762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d8608ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3971399762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 msgr2=0x55c0d8609010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d8609010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3971399762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 msgr2=0x55c0d8608ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d8608ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3971399762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0d85e2090 con 0x55c0d85e6060 2024-09-19T05:40:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d8608ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:40:57.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc9a801e000 tx=0x7fc9a800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b45b25c6c82878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc998ff9640 1 -- 172.21.15.1:0/3971399762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8023040 con 0x55c0d85e6060 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc998ff9640 1 -- 172.21.15.1:0/3971399762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8005530 con 0x55c0d85e6060 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.737+0000 7fc998ff9640 1 -- 172.21.15.1:0/3971399762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004bc0 con 0x55c0d85e6060 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3971399762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 msgr2=0x55c0d85effb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc9a801e000 tx=0x7fc9a800b4c0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3971399762 shutdown_connections 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85f1240 0x55c0d8609010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d8608ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3971399762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85e6060 0x55c0d85effb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3971399762 >> 172.21.15.1:0/3971399762 conn(0x55c0d85e25f0 msgr2=0x55c0d85e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3971399762 shutdown_connections 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3971399762 wait complete. 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 -- start start 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.738+0000 7fc9bb8f5740 1 Processor -- start 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41afcc0 con 0x55c0d85f1240 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41b1130 con 0x55c0d85e6980 2024-09-19T05:40:57.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b41b0390 con 0x55c0d85e6060 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9bb8f5740 10 client.0 _ll_register_callbacks cb 0x7fc9a4009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42802/0 (socket says 172.21.15.1:42802) 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3096780989 learned_addr learned my addr 172.21.15.1:0/3096780989 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 msgr2=0x55c0d85f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3096780989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 msgr2=0x55c0d85f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 -- 172.21.15.1:0/3096780989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0d85f6430 con 0x55c0d85f1240 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc9b27fc640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8012fd0 tx=0x7fc9a8004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78724e5f4f2749e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.739+0000 7fc996ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:40:57.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80035f0 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc9a8003790 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a8005530 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc9a8003990 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 10 client.16005 fetch_fsmap learned FSMap version 21 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c0d866c7c0 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a8005530 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc9a801c070 con 0x55c0d85f1240 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 10 client.16005 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 10 client.16005 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 20 client.16005 populate_metadata read hostname 'smithi001' 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.740+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d866cbe0 0x55c0d866efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.741+0000 7fc9bb8f5740 4 client.16005 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4607498d", "release": true, "await": true}] 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.741+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4607498d", "release": true, "await": true}) -- 0x55c0d85530a0 con 0x55c0d866cbe0 2024-09-19T05:40:57.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.741+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d866cbe0 0x55c0d866efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:40:57.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.741+0000 7fc9b2ffd640 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d866cbe0 0x55c0d866efd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ff2f6447058ebf server_cookie=b134feef57c902b1 in_seq=0 out_seq=0 2024-09-19T05:40:57.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.741+0000 7fc996ff5640 10 client.16005 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:57.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:57 smithi060 ceph-mon[35058]: pgmap v944: 129 pgs: 129 active+clean; 429 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.8 MiB/s wr, 132 op/s 2024-09-19T05:40:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:57 smithi082 ceph-mon[35195]: pgmap v944: 129 pgs: 129 active+clean; 429 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.8 MiB/s wr, 132 op/s 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc996ff5640 1 -- 172.21.15.1:0/3096780989 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c0d85530a0 con 0x55c0d866cbe0 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc996ff5640 10 client.16005 handle_command_reply: tid=0 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 client.16005 shutdown 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 msgr2=0x55c0d85f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8012fd0 tx=0x7fc9a8004700 comp rx=0 tx=0).stop 2024-09-19T05:40:57.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 shutdown_connections 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c0d85f1240 0x55c0d85f5ef0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c0d85e6980 0x55c0d85f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55c0d866cbe0 0x55c0d866efd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 --2- 172.21.15.1:0/3096780989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c0d85e6060 0x55c0d85f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc996ff5640 0 client.16005 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 >> 172.21.15.1:0/3096780989 conn(0x55c0d85e25f0 msgr2=0x55c0d85e7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 shutdown_connections 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 1 -- 172.21.15.1:0/3096780989 wait complete. 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.816+0000 7fc9bb8f5740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T05:40:57.820 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 68, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "4607498d": { 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 68, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:40:57.821 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 154.0, 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:40:57.822 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:40:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 msgr2=0x7fc99c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 0x7fc99c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac004fd0 tx=0x7fc9ac0bc040 comp rx=0 tx=0).stop 2024-09-19T05:40:57.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 msgr2=0x7fc9b4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e970 tx=0x7fc9ac00ed70 comp rx=0 tx=0).stop 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 shutdown_connections 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc99c0a3240 0x7fc99c0a5700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc9b4108290 0x7fc9b4101470 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9b4103740 0x7fc9b4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 --2- 172.21.15.1:0/2203753147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9b4102d90 0x7fc9b41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 >> 172.21.15.1:0/2203753147 conn(0x7fc9b40fc7d0 msgr2=0x7fc9b4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 shutdown_connections 2024-09-19T05:40:57.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:40:57.817+0000 7fc9b951c640 1 -- 172.21.15.1:0/2203753147 wait complete. 2024-09-19T05:40:58.570 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4607498d', total seconds elapsed: 37.4 2024-09-19T05:40:58.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 114138 16.37 MB/sec execute 253 sec latency 32628.922 ms 2024-09-19T05:40:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:40:59 smithi001 ceph-mon[30968]: pgmap v945: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:40:59.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 114545 16.40 MB/sec execute 254 sec latency 100.284 ms 2024-09-19T05:40:59.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:40:59 smithi060 ceph-mon[35058]: pgmap v945: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:40:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:40:59 smithi082 ceph-mon[35195]: pgmap v945: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:41:00.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 115048 16.41 MB/sec execute 255 sec latency 152.467 ms 2024-09-19T05:41:01.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:01 smithi001 ceph-mon[30968]: pgmap v946: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.0 MiB/s wr, 111 op/s 2024-09-19T05:41:01.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 115541 16.48 MB/sec execute 256 sec latency 70.115 ms 2024-09-19T05:41:01.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:01 smithi060 ceph-mon[35058]: pgmap v946: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.0 MiB/s wr, 111 op/s 2024-09-19T05:41:01.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:01 smithi082 ceph-mon[35195]: pgmap v946: 129 pgs: 129 active+clean; 428 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.0 MiB/s wr, 111 op/s 2024-09-19T05:41:02.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 116150 16.55 MB/sec execute 257 sec latency 87.135 ms 2024-09-19T05:41:03.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:03 smithi001 ceph-mon[30968]: pgmap v947: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 170 op/s 2024-09-19T05:41:03.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 116522 16.58 MB/sec execute 258 sec latency 56.003 ms 2024-09-19T05:41:03.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:03 smithi060 ceph-mon[35058]: pgmap v947: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 170 op/s 2024-09-19T05:41:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:03 smithi082 ceph-mon[35195]: pgmap v947: 129 pgs: 129 active+clean; 436 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 170 op/s 2024-09-19T05:41:04.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 116947 16.60 MB/sec execute 259 sec latency 87.228 ms 2024-09-19T05:41:05.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:05 smithi001 ceph-mon[30968]: pgmap v948: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 156 op/s 2024-09-19T05:41:05.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 117264 16.60 MB/sec execute 260 sec latency 87.549 ms 2024-09-19T05:41:05.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:05 smithi060 ceph-mon[35058]: pgmap v948: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 156 op/s 2024-09-19T05:41:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:05 smithi082 ceph-mon[35195]: pgmap v948: 129 pgs: 129 active+clean; 435 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 156 op/s 2024-09-19T05:41:06.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 117720 16.60 MB/sec execute 261 sec latency 70.912 ms 2024-09-19T05:41:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:07 smithi001 ceph-mon[30968]: pgmap v949: 129 pgs: 129 active+clean; 438 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-09-19T05:41:07.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 118321 16.66 MB/sec execute 262 sec latency 83.727 ms 2024-09-19T05:41:07.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:07 smithi060 ceph-mon[35058]: pgmap v949: 129 pgs: 129 active+clean; 438 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-09-19T05:41:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:07 smithi082 ceph-mon[35195]: pgmap v949: 129 pgs: 129 active+clean; 438 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-09-19T05:41:08.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 118805 16.69 MB/sec execute 263 sec latency 87.572 ms 2024-09-19T05:41:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:09 smithi001 ceph-mon[30968]: pgmap v950: 129 pgs: 129 active+clean; 441 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-19T05:41:09.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 119425 16.78 MB/sec execute 264 sec latency 62.838 ms 2024-09-19T05:41:09.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:09 smithi060 ceph-mon[35058]: pgmap v950: 129 pgs: 129 active+clean; 441 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-19T05:41:09.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:09 smithi082 ceph-mon[35195]: pgmap v950: 129 pgs: 129 active+clean; 441 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-19T05:41:10.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 119902 16.83 MB/sec execute 265 sec latency 139.039 ms 2024-09-19T05:41:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:11 smithi001 ceph-mon[30968]: pgmap v951: 129 pgs: 129 active+clean; 442 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:41:11.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 120307 16.86 MB/sec execute 266 sec latency 51.068 ms 2024-09-19T05:41:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:11 smithi060 ceph-mon[35058]: pgmap v951: 129 pgs: 129 active+clean; 442 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:41:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:11 smithi082 ceph-mon[35195]: pgmap v951: 129 pgs: 129 active+clean; 442 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:41:12.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 120627 16.85 MB/sec execute 267 sec latency 93.374 ms 2024-09-19T05:41:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:13 smithi001 ceph-mon[30968]: pgmap v952: 129 pgs: 129 active+clean; 425 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 286 op/s 2024-09-19T05:41:13.649 INFO:tasks.workunit.client.0.smithi001.stdout: 10 120950 16.84 MB/sec execute 268 sec latency 90.083 ms 2024-09-19T05:41:13.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:13 smithi060 ceph-mon[35058]: pgmap v952: 129 pgs: 129 active+clean; 425 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 286 op/s 2024-09-19T05:41:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:13 smithi082 ceph-mon[35195]: pgmap v952: 129 pgs: 129 active+clean; 425 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.5 MiB/s wr, 286 op/s 2024-09-19T05:41:14.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 121434 16.86 MB/sec execute 269 sec latency 109.800 ms 2024-09-19T05:41:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:15 smithi001 ceph-mon[30968]: pgmap v953: 129 pgs: 129 active+clean; 430 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2024-09-19T05:41:15.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 121978 16.88 MB/sec execute 270 sec latency 73.919 ms 2024-09-19T05:41:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:15 smithi060 ceph-mon[35058]: pgmap v953: 129 pgs: 129 active+clean; 430 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2024-09-19T05:41:15.759 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:15 smithi082 ceph-mon[35195]: pgmap v953: 129 pgs: 129 active+clean; 430 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2024-09-19T05:41:16.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 122551 16.95 MB/sec execute 271 sec latency 70.382 ms 2024-09-19T05:41:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:17 smithi001 ceph-mon[30968]: pgmap v954: 129 pgs: 129 active+clean; 435 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-19T05:41:17.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 123162 17.03 MB/sec execute 272 sec latency 60.153 ms 2024-09-19T05:41:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:17 smithi060 ceph-mon[35058]: pgmap v954: 129 pgs: 129 active+clean; 435 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-19T05:41:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:17 smithi082 ceph-mon[35195]: pgmap v954: 129 pgs: 129 active+clean; 435 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-19T05:41:18.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 123651 17.08 MB/sec execute 273 sec latency 63.973 ms 2024-09-19T05:41:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:19 smithi001 ceph-mon[30968]: pgmap v955: 129 pgs: 129 active+clean; 440 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 262 op/s 2024-09-19T05:41:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:19 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:41:19.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 124035 17.09 MB/sec execute 274 sec latency 77.532 ms 2024-09-19T05:41:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:19 smithi060 ceph-mon[35058]: pgmap v955: 129 pgs: 129 active+clean; 440 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 262 op/s 2024-09-19T05:41:19.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:19 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:41:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:19 smithi082 ceph-mon[35195]: pgmap v955: 129 pgs: 129 active+clean; 440 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 262 op/s 2024-09-19T05:41:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:19 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:41:20.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 124302 17.06 MB/sec execute 275 sec latency 113.504 ms 2024-09-19T05:41:21.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 124747 17.09 MB/sec execute 276 sec latency 102.538 ms 2024-09-19T05:41:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:21 smithi060 ceph-mon[35058]: pgmap v956: 129 pgs: 129 active+clean; 441 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:41:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:21 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:21 smithi082 ceph-mon[35195]: pgmap v956: 129 pgs: 129 active+clean; 441 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:41:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:21 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:21 smithi001 ceph-mon[30968]: pgmap v956: 129 pgs: 129 active+clean; 441 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 227 op/s 2024-09-19T05:41:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:21 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:22.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 125239 17.10 MB/sec execute 277 sec latency 113.700 ms 2024-09-19T05:41:23.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 125805 17.13 MB/sec execute 278 sec latency 76.015 ms 2024-09-19T05:41:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:23 smithi060 ceph-mon[35058]: pgmap v957: 129 pgs: 129 active+clean; 447 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 279 op/s 2024-09-19T05:41:24.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:23 smithi082 ceph-mon[35195]: pgmap v957: 129 pgs: 129 active+clean; 447 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 279 op/s 2024-09-19T05:41:24.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:23 smithi001 ceph-mon[30968]: pgmap v957: 129 pgs: 129 active+clean; 447 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 279 op/s 2024-09-19T05:41:24.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 126421 17.22 MB/sec execute 279 sec latency 52.899 ms 2024-09-19T05:41:25.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 126908 17.28 MB/sec execute 280 sec latency 324.566 ms 2024-09-19T05:41:26.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:25 smithi060 ceph-mon[35058]: pgmap v958: 129 pgs: 129 active+clean; 450 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T05:41:26.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:25 smithi082 ceph-mon[35195]: pgmap v958: 129 pgs: 129 active+clean; 450 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T05:41:26.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:25 smithi001 ceph-mon[30968]: pgmap v958: 129 pgs: 129 active+clean; 450 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T05:41:26.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 127303 17.28 MB/sec execute 281 sec latency 344.398 ms 2024-09-19T05:41:27.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 127623 17.29 MB/sec execute 282 sec latency 67.966 ms 2024-09-19T05:41:28.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:27 smithi060 ceph-mon[35058]: pgmap v959: 129 pgs: 129 active+clean; 454 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-09-19T05:41:28.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:27 smithi082 ceph-mon[35195]: pgmap v959: 129 pgs: 129 active+clean; 454 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-09-19T05:41:28.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:27 smithi001 ceph-mon[30968]: pgmap v959: 129 pgs: 129 active+clean; 454 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-09-19T05:41:28.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 127926 17.28 MB/sec execute 283 sec latency 83.547 ms 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: pgmap v960: 129 pgs: 129 active+clean; 460 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 246 op/s 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:41:29.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: pgmap v960: 129 pgs: 129 active+clean; 460 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 246 op/s 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:41:29.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: pgmap v960: 129 pgs: 129 active+clean; 460 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.6 MiB/s wr, 246 op/s 2024-09-19T05:41:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:41:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:41:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:41:29.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 128390 17.31 MB/sec execute 284 sec latency 79.359 ms 2024-09-19T05:41:30.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 128941 17.32 MB/sec execute 285 sec latency 102.965 ms 2024-09-19T05:41:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:31 smithi001 ceph-mon[30968]: pgmap v961: 129 pgs: 129 active+clean; 448 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.2 MiB/s wr, 209 op/s 2024-09-19T05:41:31.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 129522 17.37 MB/sec execute 286 sec latency 44.683 ms 2024-09-19T05:41:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:31 smithi060 ceph-mon[35058]: pgmap v961: 129 pgs: 129 active+clean; 448 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.2 MiB/s wr, 209 op/s 2024-09-19T05:41:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:31 smithi082 ceph-mon[35195]: pgmap v961: 129 pgs: 129 active+clean; 448 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.2 MiB/s wr, 209 op/s 2024-09-19T05:41:32.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 130141 17.45 MB/sec execute 287 sec latency 64.339 ms 2024-09-19T05:41:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:33 smithi001 ceph-mon[30968]: pgmap v962: 129 pgs: 129 active+clean; 450 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.3 MiB/s wr, 285 op/s 2024-09-19T05:41:33.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 130548 17.48 MB/sec execute 288 sec latency 118.034 ms 2024-09-19T05:41:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:33 smithi060 ceph-mon[35058]: pgmap v962: 129 pgs: 129 active+clean; 450 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.3 MiB/s wr, 285 op/s 2024-09-19T05:41:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:33 smithi082 ceph-mon[35195]: pgmap v962: 129 pgs: 129 active+clean; 450 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.3 MiB/s wr, 285 op/s 2024-09-19T05:41:34.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 130779 17.46 MB/sec execute 289 sec latency 383.257 ms 2024-09-19T05:41:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:35 smithi001 ceph-mon[30968]: pgmap v963: 129 pgs: 129 active+clean; 446 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:41:35.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 131107 17.47 MB/sec execute 290 sec latency 61.954 ms 2024-09-19T05:41:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:35 smithi060 ceph-mon[35058]: pgmap v963: 129 pgs: 129 active+clean; 446 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:41:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:35 smithi082 ceph-mon[35195]: pgmap v963: 129 pgs: 129 active+clean; 446 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.8 MiB/s wr, 237 op/s 2024-09-19T05:41:36.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 131452 17.47 MB/sec execute 291 sec latency 65.780 ms 2024-09-19T05:41:37.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:37 smithi001 ceph-mon[30968]: pgmap v964: 129 pgs: 129 active+clean; 447 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 263 op/s 2024-09-19T05:41:37.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 131855 17.46 MB/sec execute 292 sec latency 147.699 ms 2024-09-19T05:41:37.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:37 smithi060 ceph-mon[35058]: pgmap v964: 129 pgs: 129 active+clean; 447 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 263 op/s 2024-09-19T05:41:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:37 smithi082 ceph-mon[35195]: pgmap v964: 129 pgs: 129 active+clean; 447 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 263 op/s 2024-09-19T05:41:38.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 132401 17.48 MB/sec execute 293 sec latency 71.293 ms 2024-09-19T05:41:39.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:39 smithi001 ceph-mon[30968]: pgmap v965: 129 pgs: 129 active+clean; 453 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-19T05:41:39.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 132734 17.47 MB/sec execute 294 sec latency 287.977 ms 2024-09-19T05:41:39.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:39 smithi060 ceph-mon[35058]: pgmap v965: 129 pgs: 129 active+clean; 453 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-19T05:41:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:39 smithi082 ceph-mon[35195]: pgmap v965: 129 pgs: 129 active+clean; 453 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-19T05:41:40.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 133171 17.51 MB/sec execute 295 sec latency 76.855 ms 2024-09-19T05:41:41.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:41 smithi001 ceph-mon[30968]: pgmap v966: 129 pgs: 129 active+clean; 456 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 290 op/s 2024-09-19T05:41:41.650 INFO:tasks.workunit.client.0.smithi001.stdout: 10 133760 17.58 MB/sec execute 296 sec latency 86.103 ms 2024-09-19T05:41:41.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:41 smithi060 ceph-mon[35058]: pgmap v966: 129 pgs: 129 active+clean; 456 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 290 op/s 2024-09-19T05:41:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:41 smithi082 ceph-mon[35195]: pgmap v966: 129 pgs: 129 active+clean; 456 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.1 MiB/s wr, 290 op/s 2024-09-19T05:41:42.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 134277 17.63 MB/sec execute 297 sec latency 57.004 ms 2024-09-19T05:41:43.593 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:43 smithi001 ceph-mon[30968]: pgmap v967: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:41:43.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 134610 17.63 MB/sec execute 298 sec latency 164.874 ms 2024-09-19T05:41:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:43 smithi060 ceph-mon[35058]: pgmap v967: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:41:43.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:43 smithi082 ceph-mon[35195]: pgmap v967: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:41:44.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 134832 17.60 MB/sec execute 299 sec latency 280.288 ms 2024-09-19T05:41:45.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:45 smithi001 ceph-mon[30968]: pgmap v968: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-09-19T05:41:45.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 135121 17.60 MB/sec execute 300 sec latency 157.088 ms 2024-09-19T05:41:45.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:45 smithi060 ceph-mon[35058]: pgmap v968: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-09-19T05:41:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:45 smithi082 ceph-mon[35195]: pgmap v968: 129 pgs: 129 active+clean; 459 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.6 MiB/s wr, 303 op/s 2024-09-19T05:41:46.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 135564 17.60 MB/sec execute 301 sec latency 71.701 ms 2024-09-19T05:41:47.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:47 smithi001 ceph-mon[30968]: pgmap v969: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.2 MiB/s wr, 387 op/s 2024-09-19T05:41:47.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 136076 17.61 MB/sec execute 302 sec latency 84.412 ms 2024-09-19T05:41:47.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:47 smithi060 ceph-mon[35058]: pgmap v969: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.2 MiB/s wr, 387 op/s 2024-09-19T05:41:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:47 smithi082 ceph-mon[35195]: pgmap v969: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.2 MiB/s wr, 387 op/s 2024-09-19T05:41:48.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 136657 17.67 MB/sec execute 303 sec latency 42.868 ms 2024-09-19T05:41:49.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:49 smithi001 ceph-mon[30968]: pgmap v970: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 374 op/s 2024-09-19T05:41:49.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 137049 17.70 MB/sec execute 304 sec latency 395.393 ms 2024-09-19T05:41:49.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:49 smithi060 ceph-mon[35058]: pgmap v970: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 374 op/s 2024-09-19T05:41:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:49 smithi082 ceph-mon[35195]: pgmap v970: 129 pgs: 129 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.7 MiB/s wr, 374 op/s 2024-09-19T05:41:50.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 137378 17.71 MB/sec execute 305 sec latency 93.736 ms 2024-09-19T05:41:51.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:51 smithi001 ceph-mon[30968]: pgmap v971: 129 pgs: 129 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2024-09-19T05:41:51.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 137846 17.73 MB/sec execute 306 sec latency 78.540 ms 2024-09-19T05:41:51.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:51 smithi060 ceph-mon[35058]: pgmap v971: 129 pgs: 129 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2024-09-19T05:41:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:51 smithi082 ceph-mon[35195]: pgmap v971: 129 pgs: 129 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2024-09-19T05:41:52.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 138201 17.74 MB/sec execute 307 sec latency 55.195 ms 2024-09-19T05:41:53.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:53 smithi001 ceph-mon[30968]: pgmap v972: 129 pgs: 129 active+clean; 480 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.1 MiB/s wr, 388 op/s 2024-09-19T05:41:53.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 138565 17.75 MB/sec execute 308 sec latency 68.108 ms 2024-09-19T05:41:53.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:53 smithi060 ceph-mon[35058]: pgmap v972: 129 pgs: 129 active+clean; 480 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.1 MiB/s wr, 388 op/s 2024-09-19T05:41:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:53 smithi082 ceph-mon[35195]: pgmap v972: 129 pgs: 129 active+clean; 480 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.1 MiB/s wr, 388 op/s 2024-09-19T05:41:54.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 138846 17.74 MB/sec execute 309 sec latency 200.335 ms 2024-09-19T05:41:55.560 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:55 smithi082 ceph-mon[35195]: pgmap v973: 129 pgs: 129 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 310 op/s 2024-09-19T05:41:55.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:55 smithi001 ceph-mon[30968]: pgmap v973: 129 pgs: 129 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 310 op/s 2024-09-19T05:41:55.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 139203 17.72 MB/sec execute 310 sec latency 91.466 ms 2024-09-19T05:41:55.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:55 smithi060 ceph-mon[35058]: pgmap v973: 129 pgs: 129 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 310 op/s 2024-09-19T05:41:56.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 139743 17.74 MB/sec execute 311 sec latency 49.119 ms 2024-09-19T05:41:57.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:57 smithi060 ceph-mon[35058]: pgmap v974: 129 pgs: 129 active+clean; 450 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.9 MiB/s wr, 387 op/s 2024-09-19T05:41:57.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:57 smithi001 ceph-mon[30968]: pgmap v974: 129 pgs: 129 active+clean; 450 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.9 MiB/s wr, 387 op/s 2024-09-19T05:41:57.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 140369 17.79 MB/sec execute 312 sec latency 88.283 ms 2024-09-19T05:41:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:57 smithi082 ceph-mon[35195]: pgmap v974: 129 pgs: 129 active+clean; 450 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.9 MiB/s wr, 387 op/s 2024-09-19T05:41:58.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 140717 17.81 MB/sec execute 313 sec latency 308.032 ms 2024-09-19T05:41:59.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:41:59 smithi001 ceph-mon[30968]: pgmap v975: 129 pgs: 129 active+clean; 453 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 363 op/s 2024-09-19T05:41:59.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 141084 17.85 MB/sec execute 314 sec latency 245.877 ms 2024-09-19T05:41:59.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:41:59 smithi060 ceph-mon[35058]: pgmap v975: 129 pgs: 129 active+clean; 453 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 363 op/s 2024-09-19T05:41:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:41:59 smithi082 ceph-mon[35195]: pgmap v975: 129 pgs: 129 active+clean; 453 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.1 MiB/s wr, 363 op/s 2024-09-19T05:42:00.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 141485 17.85 MB/sec execute 315 sec latency 89.439 ms 2024-09-19T05:42:01.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:01 smithi001 ceph-mon[30968]: pgmap v976: 129 pgs: 129 active+clean; 456 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 371 op/s 2024-09-19T05:42:01.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 141786 17.84 MB/sec execute 316 sec latency 104.122 ms 2024-09-19T05:42:01.713 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:42:01.714 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-19T05:42:01.714 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:42:01.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:01 smithi060 ceph-mon[35058]: pgmap v976: 129 pgs: 129 active+clean; 456 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 371 op/s 2024-09-19T05:42:01.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:01 smithi082 ceph-mon[35195]: pgmap v976: 129 pgs: 129 active+clean; 456 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.9 MiB/s wr, 371 op/s 2024-09-19T05:42:01.991 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 -- 172.21.15.1:0/3109901397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0100e20 msgr2=0x7f28f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 --2- 172.21.15.1:0/3109901397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0100e20 0x7f28f0101200 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009900 tx=0x7f28e002a480 comp rx=0 tx=0).stop 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 -- 172.21.15.1:0/3109901397 shutdown_connections 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 --2- 172.21.15.1:0/3109901397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 --2- 172.21.15.1:0/3109901397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0102570 0x7f28f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 --2- 172.21.15.1:0/3109901397 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0100e20 0x7f28f0101200 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 -- 172.21.15.1:0/3109901397 >> 172.21.15.1:0/3109901397 conn(0x7f28f00fc7d0 msgr2=0x7f28f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 -- 172.21.15.1:0/3109901397 shutdown_connections 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.521+0000 7f28f6701640 1 -- 172.21.15.1:0/3109901397 wait complete. 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 Processor -- start 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 -- start start 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0100e20 0x7f28f0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0110f50 con 0x7f28f0102570 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0110dd0 con 0x7f28f0102ef0 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f6701640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28f01110d0 con 0x7f28f0100e20 2024-09-19T05:42:02.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f4c9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50980/0 (socket says 172.21.15.1:50980) 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28effff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0100e20 0x7f28f0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28f4c9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:43736/0 (socket says 172.21.15.1:43736) 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.522+0000 7f28ef7fe640 1 -- 172.21.15.1:0/2656660034 learned_addr learned my addr 172.21.15.1:0/2656660034 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 -- 172.21.15.1:0/2656660034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0100e20 msgr2=0x7f28f0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0100e20 0x7f28f0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 -- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 msgr2=0x7f28f0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 -- 172.21.15.1:0/2656660034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f019d4d0 con 0x7f28f0102ef0 2024-09-19T05:42:02.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28ef7fe640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f4c9e640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009fd0 tx=0x7f28e800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e800ce20 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f019d7c0 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28e8010430 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f01a50a0 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.523+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e800f620 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.524+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f0101200 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.525+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f28e80039b0 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.526+0000 7f28ed7fa640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 0x7f28d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.526+0000 7f28effff640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 0x7f28d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.526+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f28e80d0250 con 0x7f28f0102ef0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.527+0000 7f28effff640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 0x7f28d80a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009230 tx=0x7f28e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:02.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.529+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f28e809cbf0 con 0x7f28f0102ef0 2024-09-19T05:42:02.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 142151 17.85 MB/sec execute 317 sec latency 64.468 ms 2024-09-19T05:42:02.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.769+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28f01a52d0 con 0x7f28f0102ef0 2024-09-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.770+0000 7f28ed7fa640 1 -- 172.21.15.1:0/2656660034 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f28e809c4f0 con 0x7f28f0102ef0 2024-09-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:42:02.772 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 msgr2=0x7f28d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 0x7f28d80a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009230 tx=0x7f28e00058d0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 msgr2=0x7f28f019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009fd0 tx=0x7f28e800ef10 comp rx=0 tx=0).stop 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 shutdown_connections 2024-09-19T05:42:02.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f28d80a3240 0x7f28d80a5700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28f0102ef0 0x7f28f019cdf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28f0102570 0x7f28f0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 --2- 172.21.15.1:0/2656660034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28f0100e20 0x7f28f0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 >> 172.21.15.1:0/2656660034 conn(0x7f28f00fc7d0 msgr2=0x7f28f006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 shutdown_connections 2024-09-19T05:42:02.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:02.772+0000 7f28f6701640 1 -- 172.21.15.1:0/2656660034 wait complete. 2024-09-19T05:42:03.415 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:03 smithi001 ceph-mon[30968]: pgmap v977: 129 pgs: 129 active+clean; 460 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 344 op/s 2024-09-19T05:42:03.415 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:03 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2656660034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:03.651 INFO:tasks.workunit.client.0.smithi001.stdout: 10 142572 17.85 MB/sec execute 318 sec latency 94.030 ms 2024-09-19T05:42:03.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:03 smithi060 ceph-mon[35058]: pgmap v977: 129 pgs: 129 active+clean; 460 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 344 op/s 2024-09-19T05:42:03.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:03 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2656660034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:03 smithi082 ceph-mon[35195]: pgmap v977: 129 pgs: 129 active+clean; 460 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 344 op/s 2024-09-19T05:42:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:03 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2656660034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:04.004 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-19T05:42:04.005 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-19T05:42:04.507 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:04.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 142889 17.84 MB/sec execute 319 sec latency 367.387 ms 2024-09-19T05:42:05.575 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:05 smithi001 ceph-mon[30968]: pgmap v978: 129 pgs: 129 active+clean; 462 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 316 op/s 2024-09-19T05:42:05.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143269 17.84 MB/sec execute 320 sec latency 166.829 ms 2024-09-19T05:42:05.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:05 smithi060 ceph-mon[35058]: pgmap v978: 129 pgs: 129 active+clean; 462 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 316 op/s 2024-09-19T05:42:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:05 smithi082 ceph-mon[35195]: pgmap v978: 129 pgs: 129 active+clean; 462 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.4 MiB/s wr, 316 op/s 2024-09-19T05:42:05.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 -- 172.21.15.1:0/3740286136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 msgr2=0x7f12cc0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 --2- 172.21.15.1:0/3740286136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 0x7f12cc0b1af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12d4068370 tx=0x7f12d40904c0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 -- 172.21.15.1:0/3740286136 shutdown_connections 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 --2- 172.21.15.1:0/3740286136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 0x7f12cc0b1af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 --2- 172.21.15.1:0/3740286136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc0a5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 --2- 172.21.15.1:0/3740286136 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc0ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.934+0000 7f12d359e640 1 -- 172.21.15.1:0/3740286136 >> 172.21.15.1:0/3740286136 conn(0x7f12cc01a500 msgr2=0x7f12cc01a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.935+0000 7f12d359e640 1 -- 172.21.15.1:0/3740286136 shutdown_connections 2024-09-19T05:42:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.935+0000 7f12d359e640 1 -- 172.21.15.1:0/3740286136 wait complete. 2024-09-19T05:42:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.936+0000 7f12d359e640 1 Processor -- start 2024-09-19T05:42:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.936+0000 7f12d359e640 1 -- start start 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 0x7f12cc1438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0b46c0 con 0x7f12cc0aadf0 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0b4540 con 0x7f12cc0a5080 2024-09-19T05:42:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.937+0000 7f12d359e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0b4840 con 0x7f12cc0a5a40 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54902/0 (socket says 172.21.15.1:54902) 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d259c640 1 -- 172.21.15.1:0/1752880303 learned_addr learned my addr 172.21.15.1:0/1752880303 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38598/0 (socket says 172.21.15.1:38598) 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 -- 172.21.15.1:0/1752880303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 msgr2=0x7f12cc1438d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:42:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 0x7f12cc1438d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 -- 172.21.15.1:0/1752880303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 msgr2=0x7f12cc143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:05.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.938+0000 7f12d2d9d640 1 -- 172.21.15.1:0/1752880303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc148340 con 0x7f12cc0aadf0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.939+0000 7f12d2d9d640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f12d4067ce0 tx=0x7f12d4097920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.939+0000 7f12c37fe640 1 -- 172.21.15.1:0/1752880303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4097d60 con 0x7f12cc0aadf0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.939+0000 7f12c37fe640 1 -- 172.21.15.1:0/1752880303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d4063530 con 0x7f12cc0aadf0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.939+0000 7f12c37fe640 1 -- 172.21.15.1:0/1752880303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d406d700 con 0x7f12cc0aadf0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.940+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc1485d0 con 0x7f12cc0aadf0 2024-09-19T05:42:05.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.940+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc148a90 con 0x7f12cc0aadf0 2024-09-19T05:42:05.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.944+0000 7f12c37fe640 1 -- 172.21.15.1:0/1752880303 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f12d4063050 con 0x7f12cc0aadf0 2024-09-19T05:42:05.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.945+0000 7f12db389740 1 Processor -- start 2024-09-19T05:42:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.945+0000 7f12db389740 1 -- start start 2024-09-19T05:42:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b0c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b0eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561143a672a0 con 0x561143b02220 2024-09-19T05:42:05.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561143a0eb10 con 0x561143b01900 2024-09-19T05:42:05.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12db389740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561143a63260 con 0x561143b0cae0 2024-09-19T05:42:05.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b0c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54904/0 (socket says 172.21.15.1:54904) 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12d1d9b640 1 -- 172.21.15.1:0/154362591 learned_addr learned my addr 172.21.15.1:0/154362591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b0eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.946+0000 7f12c37fe640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 0x7f12bc0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12c37fe640 1 -- 172.21.15.1:0/1752880303 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f12d4153620 con 0x7f12cc0aadf0 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 -- 172.21.15.1:0/154362591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 msgr2=0x561143b0eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b0eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 -- 172.21.15.1:0/154362591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 msgr2=0x561143b0c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b0c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 -- 172.21.15.1:0/154362591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611437d8b90 con 0x561143b01900 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f12c800efc0 tx=0x7f12c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e371106a9cd9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.947+0000 7f12d2d9d640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 0x7f12bc0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.948+0000 7f12c0ff9640 1 -- 172.21.15.1:0/154362591 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8004020 con 0x561143b01900 2024-09-19T05:42:05.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.948+0000 7f12c0ff9640 1 -- 172.21.15.1:0/154362591 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c8005500 con 0x561143b01900 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- 172.21.15.1:0/154362591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 msgr2=0x561143b01ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12d2d9d640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 0x7f12bc0a58e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12d4065a40 tx=0x7f12d4099040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f12c800efc0 tx=0x7f12c80046c0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12c0ff9640 1 -- 172.21.15.1:0/154362591 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8004d90 con 0x561143b01900 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- 172.21.15.1:0/154362591 shutdown_connections 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b0eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b0c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 --2- 172.21.15.1:0/154362591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b01ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- 172.21.15.1:0/154362591 >> 172.21.15.1:0/154362591 conn(0x561143afde90 msgr2=0x561143afe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- 172.21.15.1:0/154362591 shutdown_connections 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- 172.21.15.1:0/154362591 wait complete. 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 -- start start 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.949+0000 7f12db389740 1 Processor -- start 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 0x561143b09a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b09f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b0cae0 0x561143b0a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561143b0f700 con 0x561143b02220 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5611439ef6e0 con 0x561143b0cae0 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561143b0f880 con 0x561143b01900 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b09f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b09f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38620/0 (socket says 172.21.15.1:38620) 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12d259c640 1 -- 172.21.15.1:0/1088703855 learned_addr learned my addr 172.21.15.1:0/1088703855 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12db389740 10 client.0 _ll_register_callbacks cb 0x561143a13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 0x561143b09a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.950+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b0cae0 0x561143b0a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 -- 172.21.15.1:0/1088703855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b0cae0 msgr2=0x561143b0a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b0cae0 0x561143b0a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 -- 172.21.15.1:0/1088703855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 msgr2=0x561143b09f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b09f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 -- 172.21.15.1:0/1088703855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561143b18d00 con 0x561143b01900 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 0x561143b09a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12c8004760 tx=0x7f12c80048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed504ae6afb1468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8022030 con 0x561143b01900 2024-09-19T05:42:05.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8005500 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f12c8023070 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f12c8004d90 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12db389740 10 client.25567 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.951+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561143b1b670 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c8005500 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x561143b01900 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 10 client.25567 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 10 client.25567 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 20 client.25567 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b1ca10 0x561143b1ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 4 client.25567 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561143a749d0 con 0x561143b1ca10 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.952+0000 7f12d259c640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b1ca10 0x561143b1ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.953+0000 7f12b9ffb640 10 client.25567 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:05.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.953+0000 7f12d259c640 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b1ca10 0x561143b1ee00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9249495149b647a8 server_cookie=272e3eadfd71d3c9 in_seq=0 out_seq=0 2024-09-19T05:42:05.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.956+0000 7f12b9ffb640 1 -- 172.21.15.1:0/1088703855 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561143a749d0 con 0x561143b1ca10 2024-09-19T05:42:05.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.956+0000 7f12b9ffb640 10 client.25567 handle_command_reply: tid=0 2024-09-19T05:42:05.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.956+0000 7f12db389740 1 client.25567 shutdown 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 msgr2=0x561143b09a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 0x561143b09a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12c8004760 tx=0x7f12c80048d0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 shutdown_connections 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b0cae0 0x561143b0a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b09f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b1ca10 0x561143b1ee00 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 --2- 172.21.15.1:0/1088703855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b01900 0x561143b09a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 >> 172.21.15.1:0/1088703855 conn(0x561143afde90 msgr2=0x561143b03bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12b9ffb640 0 client.25567 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 shutdown_connections 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 1 -- 172.21.15.1:0/1088703855 wait complete. 2024-09-19T05:42:05.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.957+0000 7f12db389740 20 client.25567 trim_cache size 0 max 16384 2024-09-19T05:42:05.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 Processor -- start 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 -- start start 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b04370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc157bb0 con 0x561143b02220 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc15a430 con 0x561143b01900 2024-09-19T05:42:05.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.978+0000 7f12db389740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc158220 con 0x561143b0cae0 2024-09-19T05:42:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54920/0 (socket says 172.21.15.1:54920) 2024-09-19T05:42:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 -- 172.21.15.1:0/760688378 learned_addr learned my addr 172.21.15.1:0/760688378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d259c640 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b04370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 -- 172.21.15.1:0/760688378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 msgr2=0x561143b082d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b082d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 -- 172.21.15.1:0/760688378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 msgr2=0x561143b04370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b04370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.979+0000 7f12d1d9b640 1 -- 172.21.15.1:0/760688378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561143afef40 con 0x561143b01900 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.980+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12c800e980 tx=0x7f12c800ea30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7a0f6b4f304fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.980+0000 7f12bbfff640 1 -- 172.21.15.1:0/760688378 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c803b070 con 0x561143b01900 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.980+0000 7f12bbfff640 1 -- 172.21.15.1:0/760688378 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c8023040 con 0x561143b01900 2024-09-19T05:42:05.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.980+0000 7f12bbfff640 1 -- 172.21.15.1:0/760688378 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8022040 con 0x561143b01900 2024-09-19T05:42:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 -- 172.21.15.1:0/760688378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 msgr2=0x561143b0b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:05.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f12c800e980 tx=0x7f12c800ea30 comp rx=0 tx=0).stop 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 -- 172.21.15.1:0/760688378 shutdown_connections 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b04370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 --2- 172.21.15.1:0/760688378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b0b8d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 -- 172.21.15.1:0/760688378 >> 172.21.15.1:0/760688378 conn(0x561143afde90 msgr2=0x561143b0a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 -- 172.21.15.1:0/760688378 shutdown_connections 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.981+0000 7f12db389740 1 -- 172.21.15.1:0/760688378 wait complete. 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.982+0000 7f12db389740 1 -- start start 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.982+0000 7f12db389740 1 Processor -- start 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12db389740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12db389740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12d1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54924/0 (socket says 172.21.15.1:54924) 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b10770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38648/0 (socket says 172.21.15.1:38648) 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12d1d9b640 1 -- 172.21.15.1:0/318384486 learned_addr learned my addr 172.21.15.1:0/318384486 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b10d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.983+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc1588f0 con 0x561143b02220 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc159d60 con 0x561143b01900 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc158fc0 con 0x561143b0cae0 2024-09-19T05:42:05.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12db389740 10 client.0 _ll_register_callbacks cb 0x7f12c80051a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12d1d9b640 1 -- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 msgr2=0x561143b10d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b10d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12d1d9b640 1 -- 172.21.15.1:0/318384486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 msgr2=0x561143b10770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b10770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.984+0000 7f12d1d9b640 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561143b115b0 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.985+0000 7f12d1d9b640 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12c8004610 tx=0x7f12c8005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392a71cebe8290c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.985+0000 7f12b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.985+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c803b020 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.985+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f12c800c6a0 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.985+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8023040 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f12c8022040 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12db389740 10 client.25604 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561143b87660 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c800e6a0 con 0x561143b01900 2024-09-19T05:42:05.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f12c800e050 con 0x561143b01900 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12db389740 10 client.25604 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.986+0000 7f12db389740 10 client.25604 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.987+0000 7f12db389740 20 client.25604 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.987+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b87d80 0x561143b8a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.987+0000 7f12db389740 4 client.25604 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.987+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7f12c8023040 con 0x561143b87d80 2024-09-19T05:42:05.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.988+0000 7f12d259c640 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b87d80 0x561143b8a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.991+0000 7f12d259c640 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b87d80 0x561143b8a170 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b989e8b93576e2 server_cookie=84a9b706b1b98f00 in_seq=0 out_seq=0 2024-09-19T05:42:05.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:05.991+0000 7f12b9ffb640 10 client.25604 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:06.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143424 17.81 MB/sec execute 321 sec latency 667.715 ms 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.944+0000 7f12b9ffb640 1 -- 172.21.15.1:0/318384486 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f12c8023040 con 0x561143b87d80 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.944+0000 7f12b9ffb640 10 client.25604 handle_command_reply: tid=0 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.944+0000 7f12db389740 1 client.25604 shutdown 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 msgr2=0x561143b15440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12c8004610 tx=0x7f12c8005750 comp rx=0 tx=0).stop 2024-09-19T05:42:06.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 shutdown_connections 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x561143b87d80 0x561143b8a170 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561143b0cae0 0x561143b10d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12b9ffb640 0 client.25604 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561143b02220 0x561143b10770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 --2- 172.21.15.1:0/318384486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561143b01900 0x561143b15440 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 >> 172.21.15.1:0/318384486 conn(0x561143afde90 msgr2=0x561143b17a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 shutdown_connections 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 1 -- 172.21.15.1:0/318384486 wait complete. 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.945+0000 7f12db389740 20 client.25604 trim_cache size 0 max 16384 2024-09-19T05:42:06.949 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 70, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "c9c7286f": { 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 70, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-19T05:42:06.950 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:06.951 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 msgr2=0x7f12bc0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 0x7f12bc0a58e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12d4065a40 tx=0x7f12d4099040 comp rx=0 tx=0).stop 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 msgr2=0x7f12cc147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f12d4067ce0 tx=0x7f12d4097920 comp rx=0 tx=0).stop 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 shutdown_connections 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f12bc0a3420 0x7f12bc0a58e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12cc0aadf0 0x7f12cc147c60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12cc0a5a40 0x7f12cc1438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 --2- 172.21.15.1:0/1752880303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12cc0a5080 0x7f12cc143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:06.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 >> 172.21.15.1:0/1752880303 conn(0x7f12cc01a500 msgr2=0x7f12cc0a3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:06.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 shutdown_connections 2024-09-19T05:42:06.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:06.946+0000 7f12d359e640 1 -- 172.21.15.1:0/1752880303 wait complete. 2024-09-19T05:42:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:07 smithi001 ceph-mon[30968]: pgmap v979: 129 pgs: 129 active+clean; 464 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:42:07.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.76 MB/sec execute 322 sec latency 1667.818 ms 2024-09-19T05:42:07.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:07 smithi060 ceph-mon[35058]: pgmap v979: 129 pgs: 129 active+clean; 464 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:42:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:07 smithi082 ceph-mon[35195]: pgmap v979: 129 pgs: 129 active+clean; 464 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-09-19T05:42:07.951 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c9c7286f', quiesce took 6.2 seconds. Will release after: 18.3 2024-09-19T05:42:08.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.70 MB/sec execute 323 sec latency 2667.923 ms 2024-09-19T05:42:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:09 smithi001 ceph-mon[30968]: pgmap v980: 129 pgs: 129 active+clean; 456 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 327 op/s 2024-09-19T05:42:09.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.65 MB/sec execute 324 sec latency 3668.003 ms 2024-09-19T05:42:09.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:09 smithi060 ceph-mon[35058]: pgmap v980: 129 pgs: 129 active+clean; 456 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 327 op/s 2024-09-19T05:42:09.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:09 smithi082 ceph-mon[35195]: pgmap v980: 129 pgs: 129 active+clean; 456 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.2 MiB/s wr, 327 op/s 2024-09-19T05:42:10.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.59 MB/sec execute 325 sec latency 4668.109 ms 2024-09-19T05:42:11.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:11 smithi001 ceph-mon[30968]: pgmap v981: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-09-19T05:42:11.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.54 MB/sec execute 326 sec latency 5668.237 ms 2024-09-19T05:42:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:11 smithi060 ceph-mon[35058]: pgmap v981: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-09-19T05:42:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:11 smithi082 ceph-mon[35195]: pgmap v981: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 325 op/s 2024-09-19T05:42:12.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.48 MB/sec execute 327 sec latency 6668.349 ms 2024-09-19T05:42:13.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:13 smithi001 ceph-mon[30968]: pgmap v982: 129 pgs: 129 active+clean; 447 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 304 op/s 2024-09-19T05:42:13.652 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.43 MB/sec execute 328 sec latency 7668.466 ms 2024-09-19T05:42:13.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:13 smithi060 ceph-mon[35058]: pgmap v982: 129 pgs: 129 active+clean; 447 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 304 op/s 2024-09-19T05:42:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:13 smithi082 ceph-mon[35195]: pgmap v982: 129 pgs: 129 active+clean; 447 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 304 op/s 2024-09-19T05:42:14.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.38 MB/sec execute 329 sec latency 8668.517 ms 2024-09-19T05:42:15.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:15 smithi001 ceph-mon[30968]: pgmap v983: 129 pgs: 129 active+clean; 449 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 259 op/s 2024-09-19T05:42:15.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.33 MB/sec execute 330 sec latency 9668.634 ms 2024-09-19T05:42:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:15 smithi060 ceph-mon[35058]: pgmap v983: 129 pgs: 129 active+clean; 449 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 259 op/s 2024-09-19T05:42:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:15 smithi082 ceph-mon[35195]: pgmap v983: 129 pgs: 129 active+clean; 449 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 259 op/s 2024-09-19T05:42:16.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.27 MB/sec execute 331 sec latency 10668.690 ms 2024-09-19T05:42:17.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:17 smithi001 ceph-mon[30968]: pgmap v984: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 251 op/s 2024-09-19T05:42:17.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.22 MB/sec execute 332 sec latency 11668.811 ms 2024-09-19T05:42:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:17 smithi060 ceph-mon[35058]: pgmap v984: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 251 op/s 2024-09-19T05:42:17.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:17 smithi082 ceph-mon[35195]: pgmap v984: 129 pgs: 129 active+clean; 453 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.3 MiB/s wr, 251 op/s 2024-09-19T05:42:18.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.17 MB/sec execute 333 sec latency 12668.929 ms 2024-09-19T05:42:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:19 smithi001 ceph-mon[30968]: pgmap v985: 129 pgs: 129 active+clean; 457 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 4.6 MiB/s wr, 192 op/s 2024-09-19T05:42:19.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.12 MB/sec execute 334 sec latency 13668.970 ms 2024-09-19T05:42:19.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:19 smithi060 ceph-mon[35058]: pgmap v985: 129 pgs: 129 active+clean; 457 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 4.6 MiB/s wr, 192 op/s 2024-09-19T05:42:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:19 smithi082 ceph-mon[35195]: pgmap v985: 129 pgs: 129 active+clean; 457 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 4.6 MiB/s wr, 192 op/s 2024-09-19T05:42:20.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.07 MB/sec execute 335 sec latency 14669.084 ms 2024-09-19T05:42:21.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 17.02 MB/sec execute 336 sec latency 15669.179 ms 2024-09-19T05:42:21.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:21 smithi060 ceph-mon[35058]: pgmap v986: 129 pgs: 129 active+clean; 458 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.1 MiB/s wr, 162 op/s 2024-09-19T05:42:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:21 smithi082 ceph-mon[35195]: pgmap v986: 129 pgs: 129 active+clean; 458 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.1 MiB/s wr, 162 op/s 2024-09-19T05:42:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:21 smithi001 ceph-mon[30968]: pgmap v986: 129 pgs: 129 active+clean; 458 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 4.1 MiB/s wr, 162 op/s 2024-09-19T05:42:22.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.97 MB/sec execute 337 sec latency 16669.272 ms 2024-09-19T05:42:23.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.92 MB/sec execute 338 sec latency 17669.405 ms 2024-09-19T05:42:23.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:23 smithi060 ceph-mon[35058]: pgmap v987: 129 pgs: 129 active+clean; 448 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 4.3 MiB/s wr, 136 op/s 2024-09-19T05:42:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:23 smithi082 ceph-mon[35195]: pgmap v987: 129 pgs: 129 active+clean; 448 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 4.3 MiB/s wr, 136 op/s 2024-09-19T05:42:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:23 smithi001 ceph-mon[30968]: pgmap v987: 129 pgs: 129 active+clean; 448 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 4.3 MiB/s wr, 136 op/s 2024-09-19T05:42:24.653 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.87 MB/sec execute 339 sec latency 18669.515 ms 2024-09-19T05:42:25.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.82 MB/sec execute 340 sec latency 19669.633 ms 2024-09-19T05:42:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:25 smithi060 ceph-mon[35058]: pgmap v988: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:42:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:25 smithi082 ceph-mon[35195]: pgmap v988: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:42:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:25 smithi001 ceph-mon[30968]: pgmap v988: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.6 MiB/s wr, 126 op/s 2024-09-19T05:42:26.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:42:26.526 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:26.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.77 MB/sec execute 341 sec latency 20669.705 ms 2024-09-19T05:42:27.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 -- 172.21.15.1:0/1124886212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c1055b0 msgr2=0x7f561c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:27.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 --2- 172.21.15.1:0/1124886212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c1055b0 0x7f561c10d130 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5614009ca0 tx=0x7f561402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 -- 172.21.15.1:0/1124886212 shutdown_connections 2024-09-19T05:42:27.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 --2- 172.21.15.1:0/1124886212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c1055b0 0x7f561c10d130 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 --2- 172.21.15.1:0/1124886212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100e30 0x7f561c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 --2- 172.21.15.1:0/1124886212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c100480 0x7f561c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 -- 172.21.15.1:0/1124886212 >> 172.21.15.1:0/1124886212 conn(0x7f561c077210 msgr2=0x7f561c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 -- 172.21.15.1:0/1124886212 shutdown_connections 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.991+0000 7f56208da640 1 -- 172.21.15.1:0/1124886212 wait complete. 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.992+0000 7f56208da640 1 Processor -- start 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.992+0000 7f56208da640 1 -- start start 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100480 0x7f561c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 0x7f561c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f561c10fd90 con 0x7f561c100e30 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f561c10fc10 con 0x7f561c100480 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f561c10ff10 con 0x7f561c1055b0 2024-09-19T05:42:27.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45642/0 (socket says 172.21.15.1:45642) 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 -- 172.21.15.1:0/2447701450 learned_addr learned my addr 172.21.15.1:0/2447701450 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f561a59c640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100480 0x7f561c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f561ad9d640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 0x7f561c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 -- 172.21.15.1:0/2447701450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 msgr2=0x7f561c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 0x7f561c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 -- 172.21.15.1:0/2447701450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100480 msgr2=0x7f561c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100480 0x7f561c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 -- 172.21.15.1:0/2447701450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c19d3b0 con 0x7f561c100e30 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f561ad9d640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 0x7f561c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f5613fff640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f560400ea20 tx=0x7f560400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560400cd40 con 0x7f561c100e30 2024-09-19T05:42:27.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c19d6a0 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.993+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56040168f0 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.994+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560400b920 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.994+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c1a4f80 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.994+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561c100860 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.996+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5604016aa0 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.996+0000 7f56137fe640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 0x7f56080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.997+0000 7f561a59c640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 0x7f56080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.997+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f56040d00d0 con 0x7f561c100e30 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:26.997+0000 7f561a59c640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 0x7f56080a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b60 tx=0x7f560c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:27.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.000+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f560409ca40 con 0x7f561c100e30 2024-09-19T05:42:27.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.211+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f561c108850 con 0x7f561c100e30 2024-09-19T05:42:27.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.212+0000 7f56137fe640 1 -- 172.21.15.1:0/2447701450 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f560409c340 con 0x7f561c100e30 2024-09-19T05:42:27.214 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:42:27.214 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:42:27.214 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:42:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 msgr2=0x7f56080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 0x7f56080a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f560c009b60 tx=0x7f560c005f90 comp rx=0 tx=0).stop 2024-09-19T05:42:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 msgr2=0x7f561c198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f560400ea20 tx=0x7f560400eee0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 shutdown_connections 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f56080a3240 0x7f56080a5700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f561c1055b0 0x7f561c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f561c100e30 0x7f561c198940 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 --2- 172.21.15.1:0/2447701450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f561c100480 0x7f561c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 >> 172.21.15.1:0/2447701450 conn(0x7f561c077210 msgr2=0x7f561c103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.214+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 shutdown_connections 2024-09-19T05:42:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:27.215+0000 7f56208da640 1 -- 172.21.15.1:0/2447701450 wait complete. 2024-09-19T05:42:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:27 smithi001 ceph-mon[30968]: pgmap v989: 129 pgs: 129 active+clean; 439 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.9 MiB/s wr, 149 op/s 2024-09-19T05:42:27.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:27 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2447701450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:27.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.72 MB/sec execute 342 sec latency 21669.798 ms 2024-09-19T05:42:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:27 smithi060 ceph-mon[35058]: pgmap v989: 129 pgs: 129 active+clean; 439 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.9 MiB/s wr, 149 op/s 2024-09-19T05:42:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:27 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2447701450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:27 smithi082 ceph-mon[35195]: pgmap v989: 129 pgs: 129 active+clean; 439 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.9 MiB/s wr, 149 op/s 2024-09-19T05:42:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:27 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2447701450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:27.927 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id c9c7286f --release --await' 2024-09-19T05:42:27.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id c9c7286f --release --await 2024-09-19T05:42:28.281 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:28.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143429 16.67 MB/sec execute 343 sec latency 22669.893 ms 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 -- 172.21.15.1:0/424952871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c100e20 msgr2=0x7f912c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 --2- 172.21.15.1:0/424952871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c100e20 0x7f912c101200 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f911c009900 tx=0x7f911c02a480 comp rx=0 tx=0).stop 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 -- 172.21.15.1:0/424952871 shutdown_connections 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 --2- 172.21.15.1:0/424952871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c102ef0 0x7f912c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 --2- 172.21.15.1:0/424952871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 0x7f912c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 --2- 172.21.15.1:0/424952871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c100e20 0x7f912c101200 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 -- 172.21.15.1:0/424952871 >> 172.21.15.1:0/424952871 conn(0x7f912c0fc7d0 msgr2=0x7f912c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 -- 172.21.15.1:0/424952871 shutdown_connections 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.800+0000 7f91328c5640 1 -- 172.21.15.1:0/424952871 wait complete. 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.801+0000 7f91328c5640 1 Processor -- start 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.801+0000 7f91328c5640 1 -- start start 2024-09-19T05:42:28.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c100e20 0x7f912c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 0x7f912c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f912c110f80 con 0x7f912c102ef0 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f912c110e00 con 0x7f912c100e20 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f91328c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f912c111100 con 0x7f912c102570 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45666/0 (socket says 172.21.15.1:45666) 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 -- 172.21.15.1:0/1022261184 learned_addr learned my addr 172.21.15.1:0/1022261184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 0x7f912c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 -- 172.21.15.1:0/1022261184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 msgr2=0x7f912c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f912bfff640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c100e20 0x7f912c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 0x7f912c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 -- 172.21.15.1:0/1022261184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c100e20 msgr2=0x7f912c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c100e20 0x7f912c199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.802+0000 7f9130e62640 1 -- 172.21.15.1:0/1022261184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c1a4940 con 0x7f912c102ef0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f9130e62640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f912400eb10 tx=0x7f912400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f91297fa640 1 -- 172.21.15.1:0/1022261184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124004b20 con 0x7f912c102ef0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c1a4b10 con 0x7f912c102ef0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f91297fa640 1 -- 172.21.15.1:0/1022261184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124004cc0 con 0x7f912c102ef0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f91297fa640 1 -- 172.21.15.1:0/1022261184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124010760 con 0x7f912c102ef0 2024-09-19T05:42:28.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.803+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1a4fd0 con 0x7f912c102ef0 2024-09-19T05:42:28.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.805+0000 7f91297fa640 1 -- 172.21.15.1:0/1022261184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9124005020 con 0x7f912c102ef0 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.805+0000 7f9134c9e740 1 Processor -- start 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.805+0000 7f9134c9e740 1 -- start start 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c759440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 0x563c3c763d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c766630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563c3c6be620 con 0x563c3c759980 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563c3c665e50 con 0x563c3c759060 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f9134c9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c3c6ba5e0 con 0x563c3c764240 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c759440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 0x563c3c763d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c759440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40290/0 (socket says 172.21.15.1:40290) 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912b7fe640 1 -- 172.21.15.1:0/811082443 learned_addr learned my addr 172.21.15.1:0/811082443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912b7fe640 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c766630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f91297fa640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 0x7f91140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 -- 172.21.15.1:0/811082443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 msgr2=0x563c3c766630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c766630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 -- 172.21.15.1:0/811082443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 msgr2=0x563c3c759440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c759440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.806+0000 7f912bfff640 1 -- 172.21.15.1:0/811082443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c3c656d40 con 0x563c3c759980 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f9130e62640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 0x7f91140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f91297fa640 1 -- 172.21.15.1:0/1022261184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f91240d03c0 con 0x7f912c102ef0 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f912bfff640 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 0x563c3c763d00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f911c006010 tx=0x7f911c005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8afee5a09d6525c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f91127fc640 1 -- 172.21.15.1:0/811082443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c03f070 con 0x563c3c759980 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f91127fc640 1 -- 172.21.15.1:0/811082443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f911c005520 con 0x563c3c759980 2024-09-19T05:42:28.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.807+0000 7f91127fc640 1 -- 172.21.15.1:0/811082443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c035030 con 0x563c3c759980 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- 172.21.15.1:0/811082443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 msgr2=0x563c3c763d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9130e62640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 0x7f91140a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9124004e90 tx=0x7f91240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 0x563c3c763d00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f911c006010 tx=0x7f911c005e60 comp rx=0 tx=0).stop 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- 172.21.15.1:0/811082443 shutdown_connections 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c766630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759980 0x563c3c763d00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 --2- 172.21.15.1:0/811082443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c759440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- 172.21.15.1:0/811082443 >> 172.21.15.1:0/811082443 conn(0x563c3c7555f0 msgr2=0x563c3c7559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- 172.21.15.1:0/811082443 shutdown_connections 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- 172.21.15.1:0/811082443 wait complete. 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.808+0000 7f9134c9e740 1 -- start start 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 Processor -- start 2024-09-19T05:42:28.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c7615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c764240 0x563c3c761af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563c3c766e10 con 0x563c3c764240 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563c3c646f10 con 0x563c3c759060 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c3c766f90 con 0x563c3c759980 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f9134c9e740 10 client.0 _ll_register_callbacks cb 0x563c3c66adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40304/0 (socket says 172.21.15.1:40304) 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f912b7fe640 1 -- 172.21.15.1:0/1818662004 learned_addr learned my addr 172.21.15.1:0/1818662004 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f912bfff640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c7615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.809+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c764240 0x563c3c761af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 -- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 msgr2=0x563c3c7615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c7615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 -- 172.21.15.1:0/1818662004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c764240 msgr2=0x563c3c761af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c764240 0x563c3c761af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 -- 172.21.15.1:0/1818662004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c3c3cd580 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9120014f30 tx=0x7f912000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afbb96dbca85822 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f910b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120005020 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f91200051c0 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f911c005520 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9120029050 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f9134c9e740 10 client.25619 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.810+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c3c497960 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f911c005520 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f912000f6f0 con 0x563c3c759060 2024-09-19T05:42:28.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 10 client.25619 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 10 client.25619 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 20 client.25619 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c773ce0 0x563c3c7760f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 4 client.25619 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c3c6cbb90 con 0x563c3c773ce0 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f912bfff640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c773ce0 0x563c3c7760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f910b7fe640 10 client.25619 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.811+0000 7f912bfff640 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c773ce0 0x563c3c7760f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2827d225fe00ec server_cookie=373a868969c3fc32 in_seq=0 out_seq=0 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f910b7fe640 1 -- 172.21.15.1:0/1818662004 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c3c6cbb90 con 0x563c3c773ce0 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f910b7fe640 10 client.25619 handle_command_reply: tid=0 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 client.25619 shutdown 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 msgr2=0x563c3c761070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9120014f30 tx=0x7f912000cc10 comp rx=0 tx=0).stop 2024-09-19T05:42:28.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 shutdown_connections 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c764240 0x563c3c761af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c773ce0 0x563c3c7760f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c7615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1818662004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759060 0x563c3c761070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 >> 172.21.15.1:0/1818662004 conn(0x563c3c7555f0 msgr2=0x563c3c754750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f910b7fe640 0 client.25619 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.812+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 shutdown_connections 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.813+0000 7f9134c9e740 1 -- 172.21.15.1:0/1818662004 wait complete. 2024-09-19T05:42:28.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.813+0000 7f9134c9e740 20 client.25619 trim_cache size 0 max 16384 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 Processor -- start 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 -- start start 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 0x563c3c77b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c77bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1acdb0 con 0x563c3c759060 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1af630 con 0x563c3c759980 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f9134c9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1ad420 con 0x563c3c764240 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45706/0 (socket says 172.21.15.1:45706) 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 -- 172.21.15.1:0/4118466266 learned_addr learned my addr 172.21.15.1:0/4118466266 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912bfff640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 0x563c3c77b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c77bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 -- 172.21.15.1:0/4118466266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 msgr2=0x563c3c77bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.830+0000 7f912b7fe640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c77bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f912b7fe640 1 -- 172.21.15.1:0/4118466266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 msgr2=0x563c3c77b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f912b7fe640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 0x563c3c77b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f912b7fe640 1 -- 172.21.15.1:0/4118466266 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c3c755420 con 0x563c3c759060 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f912bfff640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 0x563c3c77b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f912b7fe640 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9120012010 tx=0x7f9120011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9177c65257502f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f9111ffb640 1 -- 172.21.15.1:0/4118466266 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120034020 con 0x563c3c759060 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f9111ffb640 1 -- 172.21.15.1:0/4118466266 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f912000fce0 con 0x563c3c759060 2024-09-19T05:42:28.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.831+0000 7f9111ffb640 1 -- 172.21.15.1:0/4118466266 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120025070 con 0x563c3c759060 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- 172.21.15.1:0/4118466266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 msgr2=0x563c3c75b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9120012010 tx=0x7f9120011f80 comp rx=0 tx=0).stop 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- 172.21.15.1:0/4118466266 shutdown_connections 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c764240 0x563c3c77bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c759980 0x563c3c77b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 --2- 172.21.15.1:0/4118466266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c75b1c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- 172.21.15.1:0/4118466266 >> 172.21.15.1:0/4118466266 conn(0x563c3c7555f0 msgr2=0x563c3c75aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- 172.21.15.1:0/4118466266 shutdown_connections 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- 172.21.15.1:0/4118466266 wait complete. 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.832+0000 7f9134c9e740 1 -- start start 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 Processor -- start 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c76c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c764240 0x563c3c7671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1adaf0 con 0x563c3c759060 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1aef60 con 0x563c3c764240 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1ae1c0 con 0x563c3c759980 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f9134c9e740 10 client.0 _ll_register_callbacks cb 0x7f9120014df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f912b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45722/0 (socket says 172.21.15.1:45722) 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f912b7fe640 1 -- 172.21.15.1:0/1854752993 learned_addr learned my addr 172.21.15.1:0/1854752993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c764240 0x563c3c7671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.833+0000 7f912bfff640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c76c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 -- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 msgr2=0x563c3c76c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c76c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 -- 172.21.15.1:0/1854752993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c764240 msgr2=0x563c3c7671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c764240 0x563c3c7671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 -- 172.21.15.1:0/1854752993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c3c767740 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f912b7fe640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f912000c610 tx=0x7f9120014250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e34da2ae6ebc420 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f910b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120034040 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9120012650 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912000fce0 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9120025040 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f9134c9e740 10 client.16053 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.834+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c3c7e3640 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120012d30 con 0x563c3c759060 2024-09-19T05:42:28.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f91200397f0 con 0x563c3c759060 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 10 client.16053 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 10 client.16053 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 20 client.16053 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c7e3de0 0x563c3c7e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 4 client.16053 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c9c7286f", "release": true, "await": true}] 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c9c7286f", "release": true, "await": true}) -- 0x7f912000fce0 con 0x563c3c7e3de0 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.835+0000 7f912bfff640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c7e3de0 0x563c3c7e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.836+0000 7f912bfff640 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c7e3de0 0x563c3c7e6200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cf63346fb79428 server_cookie=e9bdbe88295c6d35 in_seq=0 out_seq=0 2024-09-19T05:42:28.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.836+0000 7f910b7fe640 10 client.16053 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.893+0000 7f910b7fe640 1 -- 172.21.15.1:0/1854752993 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f912000fce0 con 0x563c3c7e3de0 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.893+0000 7f910b7fe640 10 client.16053 handle_command_reply: tid=0 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.893+0000 7f9134c9e740 1 client.16053 shutdown 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 msgr2=0x563c3c76c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f912000c610 tx=0x7f9120014250 comp rx=0 tx=0).stop 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 shutdown_connections 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563c3c764240 0x563c3c7671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x563c3c7e3de0 0x563c3c7e6200 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c3c759980 0x563c3c76c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 --2- 172.21.15.1:0/1854752993 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563c3c759060 0x563c3c76c220 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 >> 172.21.15.1:0/1854752993 conn(0x563c3c7555f0 msgr2=0x563c3c75b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f910b7fe640 0 client.16053 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 shutdown_connections 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 1 -- 172.21.15.1:0/1854752993 wait complete. 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.894+0000 7f9134c9e740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:42:28.897 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 72, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "c9c7286f": { 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 72, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:42:28.898 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:28.899 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 msgr2=0x7f91140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 0x7f91140a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9124004e90 tx=0x7f91240058d0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 msgr2=0x7f912c1a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f912400eb10 tx=0x7f912400c2d0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 shutdown_connections 2024-09-19T05:42:28.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f91140a3240 0x7f91140a5700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f912c102ef0 0x7f912c1a4400 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f912c102570 0x7f912c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 --2- 172.21.15.1:0/1022261184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f912c100e20 0x7f912c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 >> 172.21.15.1:0/1022261184 conn(0x7f912c0fc7d0 msgr2=0x7f912c0fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 shutdown_connections 2024-09-19T05:42:28.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:28.895+0000 7f91328c5640 1 -- 172.21.15.1:0/1022261184 wait complete. 2024-09-19T05:42:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:29 smithi001 ceph-mon[30968]: pgmap v990: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 3.5 MiB/s wr, 127 op/s 2024-09-19T05:42:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:42:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:29 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:29.628 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c9c7286f', total seconds elapsed: 27.9 2024-09-19T05:42:29.628 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-19T05:42:29.628 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:42:29.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 143862 16.69 MB/sec execute 344 sec latency 22910.202 ms 2024-09-19T05:42:29.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:29 smithi060 ceph-mon[35058]: pgmap v990: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 3.5 MiB/s wr, 127 op/s 2024-09-19T05:42:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:42:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:29 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:29 smithi082 ceph-mon[35195]: pgmap v990: 129 pgs: 129 active+clean; 445 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 3.5 MiB/s wr, 127 op/s 2024-09-19T05:42:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:42:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:29 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:30.126 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:30.590 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:30.590 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:30.590 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:30.590 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:30 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:30.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 144130 16.68 MB/sec execute 345 sec latency 291.408 ms 2024-09-19T05:42:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 -- 172.21.15.1:0/2798611278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb58102d30 msgr2=0x7fcb58103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:30.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/2798611278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb58102d30 0x7fcb58103110 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009930 tx=0x7fcb4802a420 comp rx=0 tx=0).stop 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 -- 172.21.15.1:0/2798611278 shutdown_connections 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/2798611278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb581082a0 0x7fcb5810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/2798611278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581036e0 0x7fcb58107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/2798611278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb58102d30 0x7fcb58103110 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 -- 172.21.15.1:0/2798611278 >> 172.21.15.1:0/2798611278 conn(0x7fcb580fc7d0 msgr2=0x7fcb580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 -- 172.21.15.1:0/2798611278 shutdown_connections 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 -- 172.21.15.1:0/2798611278 wait complete. 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.683+0000 7fcb5e13c640 1 Processor -- start 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 -- start start 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 0x7fcb58198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581082a0 0x7fcb5819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:30.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581120e0 con 0x7fcb581036e0 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58111f60 con 0x7fcb58102d30 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb5e13c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58112260 con 0x7fcb581082a0 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 0x7fcb58198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 0x7fcb58198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45738/0 (socket says 172.21.15.1:45738) 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:40340/0 (socket says 172.21.15.1:40340) 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb56ffd640 1 -- 172.21.15.1:0/1885945430 learned_addr learned my addr 172.21.15.1:0/1885945430 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb57fff640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581082a0 0x7fcb5819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb577fe640 1 -- 172.21.15.1:0/1885945430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581082a0 msgr2=0x7fcb5819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.684+0000 7fcb577fe640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581082a0 0x7fcb5819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb577fe640 1 -- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 msgr2=0x7fcb58198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb577fe640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 0x7fcb58198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb577fe640 1 -- 172.21.15.1:0/1885945430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5819d550 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb577fe640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb4802a940 tx=0x7fcb48003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4803f070 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5819d7e0 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb48031c90 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48035030 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.685+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581a5120 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.686+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb58103110 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.687+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fcb48042070 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.688+0000 7fcb54ff9640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 0x7fcb400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.688+0000 7fcb56ffd640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 0x7fcb400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.688+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcb480f0bd0 con 0x7fcb58102d30 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.689+0000 7fcb56ffd640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 0x7fcb400a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0095f0 tx=0x7fcb4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:30.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.691+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb480bce90 con 0x7fcb58102d30 2024-09-19T05:42:30.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.937+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb58199900 con 0x7fcb58102d30 2024-09-19T05:42:30.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.938+0000 7fcb54ff9640 1 -- 172.21.15.1:0/1885945430 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fcb480c1190 con 0x7fcb58102d30 2024-09-19T05:42:30.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:42:30.940 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:42:30.940 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:42:30.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 msgr2=0x7fcb400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:30.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 0x7fcb400a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0095f0 tx=0x7fcb4c005f90 comp rx=0 tx=0).stop 2024-09-19T05:42:30.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 msgr2=0x7fcb581985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcb4802a940 tx=0x7fcb48003b20 comp rx=0 tx=0).stop 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 shutdown_connections 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcb400a3240 0x7fcb400a5700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb581082a0 0x7fcb5819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcb581036e0 0x7fcb58198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 --2- 172.21.15.1:0/1885945430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb58102d30 0x7fcb581985a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.940+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 >> 172.21.15.1:0/1885945430 conn(0x7fcb580fc7d0 msgr2=0x7fcb58106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.941+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 shutdown_connections 2024-09-19T05:42:30.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:30.941+0000 7fcb5e13c640 1 -- 172.21.15.1:0/1885945430 wait complete. 2024-09-19T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:30 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:30 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 144515 16.72 MB/sec execute 346 sec latency 81.757 ms 2024-09-19T05:42:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:31 smithi082 ceph-mon[35195]: pgmap v991: 129 pgs: 129 active+clean; 444 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2024-09-19T05:42:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:42:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:42:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:31 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1885945430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:31.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:31 smithi001 ceph-mon[30968]: pgmap v991: 129 pgs: 129 active+clean; 444 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2024-09-19T05:42:31.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:42:31.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:42:31.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:31.838 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:31 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1885945430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:31.866 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-19T05:42:31.867 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-19T05:42:32.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:31 smithi060 ceph-mon[35058]: pgmap v991: 129 pgs: 129 active+clean; 444 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 2.9 MiB/s wr, 117 op/s 2024-09-19T05:42:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:42:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:42:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:42:32.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:31 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1885945430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:32.184 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:32.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 144936 16.75 MB/sec execute 347 sec latency 65.770 ms 2024-09-19T05:42:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 -- 172.21.15.1:0/1582710725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 msgr2=0x7fd7fc10e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 --2- 172.21.15.1:0/1582710725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc10e460 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009ca0 tx=0x7fd7f402a950 comp rx=0 tx=0).stop 2024-09-19T05:42:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 -- 172.21.15.1:0/1582710725 shutdown_connections 2024-09-19T05:42:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 --2- 172.21.15.1:0/1582710725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc10e460 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 --2- 172.21.15.1:0/1582710725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 --2- 172.21.15.1:0/1582710725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 0x7fd7fc102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 -- 172.21.15.1:0/1582710725 >> 172.21.15.1:0/1582710725 conn(0x7fd7fc0fc610 msgr2=0x7fd7fc0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 -- 172.21.15.1:0/1582710725 shutdown_connections 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.012+0000 7fd802da2640 1 -- 172.21.15.1:0/1582710725 wait complete. 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.013+0000 7fd802da2640 1 Processor -- start 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.013+0000 7fd802da2640 1 -- start start 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.013+0000 7fd802da2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 0x7fd7fc1007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.013+0000 7fd802da2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd802da2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd802da2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc111db0 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd802da2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc111c30 con 0x7fd7fc102b90 2024-09-19T05:42:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd802da2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc111f30 con 0x7fd7fc1034b0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd80159f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45758/0 (socket says 172.21.15.1:45758) 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 -- 172.21.15.1:0/3463817844 learned_addr learned my addr 172.21.15.1:0/3463817844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd801da0640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 0x7fd7fc1007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 -- 172.21.15.1:0/3463817844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 msgr2=0x7fd7fc100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 -- 172.21.15.1:0/3463817844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 msgr2=0x7fd7fc1007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 0x7fd7fc1007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 -- 172.21.15.1:0/3463817844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc1a6710 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd80159f640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4004af0 tx=0x7fd7f402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd7f2ffd640 1 -- 172.21.15.1:0/3463817844 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4034040 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7fc1a69a0 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd7f2ffd640 1 -- 172.21.15.1:0/3463817844 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f4030920 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.014+0000 7fd7f2ffd640 1 -- 172.21.15.1:0/3463817844 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4004670 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.015+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7fc1a6ed0 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.017+0000 7fd7f2ffd640 1 -- 172.21.15.1:0/3463817844 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd7f4037020 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.017+0000 7fd8063dd740 1 Processor -- start 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd7f2ffd640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 -- start start 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd7f2ffd640 1 -- 172.21.15.1:0/3463817844 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd7f40f09f0 con 0x7fd7fc10bfc0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d74bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d7565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd80159f640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d758ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556f8d6b12a0 con 0x556f8d74c220 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556f8d658b10 con 0x556f8d74b900 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8063dd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f8d6ad260 con 0x556f8d756ae0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd80159f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d7565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d758ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd80159f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d7565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45764/0 (socket says 172.21.15.1:45764) 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd80159f640 1 -- 172.21.15.1:0/2215396118 learned_addr learned my addr 172.21.15.1:0/2215396118 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd801da0640 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d74bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 -- 172.21.15.1:0/2215396118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 msgr2=0x556f8d74bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d74bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 -- 172.21.15.1:0/2215396118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 msgr2=0x556f8d7565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d7565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.018+0000 7fd8025a1640 1 -- 172.21.15.1:0/2215396118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8d422b90 con 0x556f8d756ae0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.019+0000 7fd80159f640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 0x7fd7e80a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec013d10 tx=0x7fd7ec009eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.019+0000 7fd8025a1640 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d758ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40b95d0 tx=0x7fd7f40bc800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6284a2c3d9a2c44f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.019+0000 7fd7e7fff640 1 -- 172.21.15.1:0/2215396118 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40bd300 con 0x556f8d756ae0 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.019+0000 7fd7e7fff640 1 -- 172.21.15.1:0/2215396118 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f40d3070 con 0x556f8d756ae0 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.019+0000 7fd7e7fff640 1 -- 172.21.15.1:0/2215396118 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4003d00 con 0x556f8d756ae0 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- 172.21.15.1:0/2215396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 msgr2=0x556f8d758ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d758ed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40b95d0 tx=0x7fd7f40bc800 comp rx=0 tx=0).stop 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- 172.21.15.1:0/2215396118 shutdown_connections 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d758ed0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d7565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 --2- 172.21.15.1:0/2215396118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d74bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- 172.21.15.1:0/2215396118 >> 172.21.15.1:0/2215396118 conn(0x556f8d747e90 msgr2=0x556f8d748270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- 172.21.15.1:0/2215396118 shutdown_connections 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- 172.21.15.1:0/2215396118 wait complete. 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 -- start start 2024-09-19T05:42:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.020+0000 7fd8063dd740 1 Processor -- start 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d753f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d754460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556f8d759470 con 0x556f8d74b900 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556f8d6396e0 con 0x556f8d74c220 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f8d7595f0 con 0x556f8d756ae0 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8063dd740 10 client.0 _ll_register_callbacks cb 0x556f8d65da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd801da0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd80159f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d753f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd801da0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45768/0 (socket says 172.21.15.1:45768) 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd801da0640 1 -- 172.21.15.1:0/567364933 learned_addr learned my addr 172.21.15.1:0/567364933 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d754460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 -- 172.21.15.1:0/567364933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 msgr2=0x556f8d753f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d753f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 -- 172.21.15.1:0/567364933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 msgr2=0x556f8d7539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 -- 172.21.15.1:0/567364933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8d762900 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd801da0640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd8025a1640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d754460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x556f8d749210 tx=0x7fd7f40c58e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=387210e52f9f100a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.021+0000 7fd7e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40d9070 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd7f4003d00 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f40d3070 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd7f40bd300 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 10 client.25609 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f8d759470 con 0x556f8d756ae0 2024-09-19T05:42:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f40d3070 con 0x556f8d756ae0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd7f404d030 con 0x556f8d756ae0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 10 client.25609 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 10 client.25609 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 20 client.25609 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7663f0 0x556f8d7687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 4 client.25609 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f8d6be9d0 con 0x556f8d7663f0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.022+0000 7fd801da0640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7663f0 0x556f8d7687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.023+0000 7fd801da0640 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7663f0 0x556f8d7687e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c6c03577d16173 server_cookie=15a1cfc60e18b913 in_seq=0 out_seq=0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.023+0000 7fd7e57fa640 10 client.25609 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.024+0000 7fd7e57fa640 1 -- 172.21.15.1:0/567364933 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f8d6be9d0 con 0x556f8d7663f0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.024+0000 7fd7e57fa640 10 client.25609 handle_command_reply: tid=0 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.024+0000 7fd8063dd740 1 client.25609 shutdown 2024-09-19T05:42:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 msgr2=0x556f8d754460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d754460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x556f8d749210 tx=0x7fd7f40c58e0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 shutdown_connections 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7663f0 0x556f8d7687e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d754460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd7e57fa640 0 client.25609 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d753f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 --2- 172.21.15.1:0/567364933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74b900 0x556f8d7539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 >> 172.21.15.1:0/567364933 conn(0x556f8d747e90 msgr2=0x556f8d74dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 shutdown_connections 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 1 -- 172.21.15.1:0/567364933 wait complete. 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.025+0000 7fd8063dd740 20 client.25609 trim_cache size 0 max 16384 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 Processor -- start 2024-09-19T05:42:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 -- start start 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d74b900 0x556f8d7542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d752890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1aecb0 con 0x556f8d756ae0 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1b1530 con 0x556f8d74c220 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8063dd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1af320 con 0x556f8d74b900 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8025a1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45782/0 (socket says 172.21.15.1:45782) 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd8025a1640 1 -- 172.21.15.1:0/3725481432 learned_addr learned my addr 172.21.15.1:0/3725481432 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd80159f640 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d752890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.043+0000 7fd801da0640 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d74b900 0x556f8d7542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 -- 172.21.15.1:0/3725481432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d74b900 msgr2=0x556f8d7542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d74b900 0x556f8d7542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 -- 172.21.15.1:0/3725481432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 msgr2=0x556f8d752890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d752890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 -- 172.21.15.1:0/3725481432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f8d74b680 con 0x556f8d756ae0 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd8025a1640 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40bc900 tx=0x7fd7f40bb110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23447698ba7af90e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd7e77fe640 1 -- 172.21.15.1:0/3725481432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40c0fb0 con 0x556f8d756ae0 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd7e77fe640 1 -- 172.21.15.1:0/3725481432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f40d3070 con 0x556f8d756ae0 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.044+0000 7fd7e77fe640 1 -- 172.21.15.1:0/3725481432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40db500 con 0x556f8d756ae0 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- 172.21.15.1:0/3725481432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 msgr2=0x556f8d76dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40bc900 tx=0x7fd7f40bb110 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- 172.21.15.1:0/3725481432 shutdown_connections 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d756ae0 0x556f8d76dff0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74c220 0x556f8d752890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- 172.21.15.1:0/3725481432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d74b900 0x556f8d7542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- 172.21.15.1:0/3725481432 >> 172.21.15.1:0/3725481432 conn(0x556f8d747e90 msgr2=0x556f8d752180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- 172.21.15.1:0/3725481432 shutdown_connections 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- 172.21.15.1:0/3725481432 wait complete. 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- start start 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 Processor -- start 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d75a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d75abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d75b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.045+0000 7fd8063dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1af9f0 con 0x556f8d74c220 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd8063dd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1b0e60 con 0x556f8d74b900 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd8063dd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc1b00c0 con 0x556f8d756ae0 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd8063dd740 10 client.0 _ll_register_callbacks cb 0x7fd7f40a5f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd80159f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d75abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d75a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd80159f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d75abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45788/0 (socket says 172.21.15.1:45788) 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd80159f640 1 -- 172.21.15.1:0/910305301 learned_addr learned my addr 172.21.15.1:0/910305301 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd8025a1640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d75b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 -- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 msgr2=0x556f8d75b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d75b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 -- 172.21.15.1:0/910305301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 msgr2=0x556f8d75abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d75abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 -- 172.21.15.1:0/910305301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f8d7d0130 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd801da0640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d75a670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556f8d768d20 tx=0x7fd7f8010580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7585a2d95b31917 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd7e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8004460 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f40d3070 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.046+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fd7f8005020 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd7f8005220 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 10 client.25649 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f8d7d1430 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f40d3070 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd7f8025070 con 0x556f8d74b900 2024-09-19T05:42:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 10 client.25649 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 10 client.25649 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 20 client.25649 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7d1ba0 0x556f8d7d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 4 client.25649 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x556f8d6b8d20 con 0x556f8d7d1ba0 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.047+0000 7fd80159f640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7d1ba0 0x556f8d7d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.048+0000 7fd7e57fa640 10 client.25649 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.048+0000 7fd80159f640 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7d1ba0 0x556f8d7d3fc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c3dbd5121dea9b server_cookie=9500639fc51a10a2 in_seq=0 out_seq=0 2024-09-19T05:42:33.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145079 16.71 MB/sec execute 348 sec latency 623.442 ms 2024-09-19T05:42:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:33 smithi082 ceph-mon[35195]: pgmap v992: 129 pgs: 129 active+clean; 446 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 196 op/s 2024-09-19T05:42:33.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:33 smithi001 ceph-mon[30968]: pgmap v992: 129 pgs: 129 active+clean; 446 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 196 op/s 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.948+0000 7fd7e57fa640 1 -- 172.21.15.1:0/910305301 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556f8d6b8d20 con 0x556f8d7d1ba0 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.948+0000 7fd7e57fa640 10 client.25649 handle_command_reply: tid=0 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.948+0000 7fd8063dd740 1 client.25649 shutdown 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.948+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 msgr2=0x556f8d75a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.948+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d75a670 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556f8d768d20 tx=0x7fd7f8010580 comp rx=0 tx=0).stop 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 shutdown_connections 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x556f8d7d1ba0 0x556f8d7d3fc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f8d756ae0 0x556f8d75b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556f8d74c220 0x556f8d75abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd7e57fa640 0 client.25649 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 --2- 172.21.15.1:0/910305301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556f8d74b900 0x556f8d75a670 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 >> 172.21.15.1:0/910305301 conn(0x556f8d747e90 msgr2=0x556f8d7529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 shutdown_connections 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 1 -- 172.21.15.1:0/910305301 wait complete. 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd8063dd740 20 client.25649 trim_cache size 0 max 16384 2024-09-19T05:42:33.952 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 74, 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "4b919f05": { 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 74, 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:33.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:33.954 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 msgr2=0x7fd7e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 0x7fd7e80a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec013d10 tx=0x7fd7ec009eb0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 msgr2=0x7fd7fc101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.949+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4004af0 tx=0x7fd7f402f3a0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 shutdown_connections 2024-09-19T05:42:33.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fd7e80a3240 0x7fd7e80a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7fc10bfc0 0x7fd7fc101270 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc1034b0 0x7fd7fc100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 --2- 172.21.15.1:0/3463817844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7fc102b90 0x7fd7fc1007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 >> 172.21.15.1:0/3463817844 conn(0x7fd7fc0fc610 msgr2=0x7fd7fc0fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 shutdown_connections 2024-09-19T05:42:33.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:33.950+0000 7fd802da2640 1 -- 172.21.15.1:0/3463817844 wait complete. 2024-09-19T05:42:34.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:33 smithi060 ceph-mon[35058]: pgmap v992: 129 pgs: 129 active+clean; 446 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 196 op/s 2024-09-19T05:42:34.654 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.67 MB/sec execute 349 sec latency 898.393 ms 2024-09-19T05:42:35.018 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4b919f05', quiesce took 5.4 seconds. Will release after: 19.1 2024-09-19T05:42:35.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.62 MB/sec execute 350 sec latency 1779.713 ms 2024-09-19T05:42:35.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:35 smithi001 ceph-mon[30968]: pgmap v993: 129 pgs: 129 active+clean; 442 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-09-19T05:42:36.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:35 smithi060 ceph-mon[35058]: pgmap v993: 129 pgs: 129 active+clean; 442 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-09-19T05:42:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:35 smithi082 ceph-mon[35195]: pgmap v993: 129 pgs: 129 active+clean; 442 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.6 MiB/s wr, 173 op/s 2024-09-19T05:42:36.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.57 MB/sec execute 351 sec latency 2779.798 ms 2024-09-19T05:42:37.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.52 MB/sec execute 352 sec latency 3779.905 ms 2024-09-19T05:42:37.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:37 smithi001 ceph-mon[30968]: pgmap v994: 129 pgs: 129 active+clean; 440 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 207 op/s 2024-09-19T05:42:38.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:37 smithi060 ceph-mon[35058]: pgmap v994: 129 pgs: 129 active+clean; 440 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 207 op/s 2024-09-19T05:42:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:37 smithi082 ceph-mon[35195]: pgmap v994: 129 pgs: 129 active+clean; 440 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 207 op/s 2024-09-19T05:42:38.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.48 MB/sec execute 353 sec latency 4780.029 ms 2024-09-19T05:42:39.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.43 MB/sec execute 354 sec latency 5780.151 ms 2024-09-19T05:42:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:39 smithi001 ceph-mon[30968]: pgmap v995: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-09-19T05:42:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:39 smithi060 ceph-mon[35058]: pgmap v995: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-09-19T05:42:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:39 smithi082 ceph-mon[35195]: pgmap v995: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-09-19T05:42:40.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.38 MB/sec execute 355 sec latency 6780.276 ms 2024-09-19T05:42:41.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.34 MB/sec execute 356 sec latency 7780.384 ms 2024-09-19T05:42:41.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:41 smithi001 ceph-mon[30968]: pgmap v996: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 3.9 MiB/s wr, 241 op/s 2024-09-19T05:42:42.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:41 smithi060 ceph-mon[35058]: pgmap v996: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 3.9 MiB/s wr, 241 op/s 2024-09-19T05:42:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:41 smithi082 ceph-mon[35195]: pgmap v996: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 3.9 MiB/s wr, 241 op/s 2024-09-19T05:42:42.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.29 MB/sec execute 357 sec latency 8780.516 ms 2024-09-19T05:42:43.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.25 MB/sec execute 358 sec latency 9780.610 ms 2024-09-19T05:42:43.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:43 smithi001 ceph-mon[30968]: pgmap v997: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2024-09-19T05:42:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:43 smithi060 ceph-mon[35058]: pgmap v997: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2024-09-19T05:42:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:43 smithi082 ceph-mon[35195]: pgmap v997: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 3.9 MiB/s wr, 242 op/s 2024-09-19T05:42:44.655 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.20 MB/sec execute 359 sec latency 10780.684 ms 2024-09-19T05:42:45.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.16 MB/sec execute 360 sec latency 11780.776 ms 2024-09-19T05:42:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:45 smithi001 ceph-mon[30968]: pgmap v998: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 153 op/s 2024-09-19T05:42:46.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:45 smithi060 ceph-mon[35058]: pgmap v998: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 153 op/s 2024-09-19T05:42:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:45 smithi082 ceph-mon[35195]: pgmap v998: 129 pgs: 129 active+clean; 434 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.1 MiB/s wr, 153 op/s 2024-09-19T05:42:46.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.11 MB/sec execute 361 sec latency 12780.854 ms 2024-09-19T05:42:47.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.07 MB/sec execute 362 sec latency 13780.948 ms 2024-09-19T05:42:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:47 smithi001 ceph-mon[30968]: pgmap v999: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-19T05:42:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:47 smithi060 ceph-mon[35058]: pgmap v999: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-19T05:42:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:47 smithi082 ceph-mon[35195]: pgmap v999: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 136 op/s 2024-09-19T05:42:48.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 16.02 MB/sec execute 363 sec latency 14781.062 ms 2024-09-19T05:42:49.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.98 MB/sec execute 364 sec latency 15781.162 ms 2024-09-19T05:42:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:49 smithi001 ceph-mon[30968]: pgmap v1000: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 973 KiB/s wr, 94 op/s 2024-09-19T05:42:50.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:49 smithi060 ceph-mon[35058]: pgmap v1000: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 973 KiB/s wr, 94 op/s 2024-09-19T05:42:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:49 smithi082 ceph-mon[35195]: pgmap v1000: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 973 KiB/s wr, 94 op/s 2024-09-19T05:42:50.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.94 MB/sec execute 365 sec latency 16781.286 ms 2024-09-19T05:42:51.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.89 MB/sec execute 366 sec latency 17781.395 ms 2024-09-19T05:42:51.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:51 smithi001 ceph-mon[30968]: pgmap v1001: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-09-19T05:42:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:51 smithi060 ceph-mon[35058]: pgmap v1001: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-09-19T05:42:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:51 smithi082 ceph-mon[35195]: pgmap v1001: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-09-19T05:42:52.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.85 MB/sec execute 367 sec latency 18781.490 ms 2024-09-19T05:42:53.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.81 MB/sec execute 368 sec latency 19781.567 ms 2024-09-19T05:42:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:53 smithi001 ceph-mon[30968]: pgmap v1002: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 166 KiB/s wr, 22 op/s 2024-09-19T05:42:54.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:53 smithi060 ceph-mon[35058]: pgmap v1002: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 166 KiB/s wr, 22 op/s 2024-09-19T05:42:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:53 smithi082 ceph-mon[35195]: pgmap v1002: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 166 KiB/s wr, 22 op/s 2024-09-19T05:42:54.119 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:42:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:54.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.76 MB/sec execute 369 sec latency 20781.644 ms 2024-09-19T05:42:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 -- 172.21.15.1:0/2547508611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0100e20 msgr2=0x7f0de0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:54.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/2547508611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0100e20 0x7f0de0101200 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009ca0 tx=0x7f0dd402a950 comp rx=0 tx=0).stop 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 -- 172.21.15.1:0/2547508611 shutdown_connections 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/2547508611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/2547508611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0102570 0x7f0de01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/2547508611 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0100e20 0x7f0de0101200 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 -- 172.21.15.1:0/2547508611 >> 172.21.15.1:0/2547508611 conn(0x7f0de00fc7d0 msgr2=0x7f0de00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 -- 172.21.15.1:0/2547508611 shutdown_connections 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.886+0000 7f0de6c6c640 1 -- 172.21.15.1:0/2547508611 wait complete. 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 Processor -- start 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 -- start start 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0100e20 0x7f0de01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:54.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de01a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0110f80 con 0x7f0de0102570 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0110e00 con 0x7f0de0102ef0 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de6c6c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0111100 con 0x7f0de0100e20 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53782/0 (socket says 172.21.15.1:53782) 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 -- 172.21.15.1:0/3264259569 learned_addr learned my addr 172.21.15.1:0/3264259569 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de4a08640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0100e20 0x7f0de01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de5209640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de01a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 -- 172.21.15.1:0/3264259569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0100e20 msgr2=0x7f0de01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:54.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0100e20 0x7f0de01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 -- 172.21.15.1:0/3264259569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 msgr2=0x7f0de01a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de01a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0ddffff640 1 -- 172.21.15.1:0/3264259569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de01a4890 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.887+0000 7f0de5209640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de01a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0ddffff640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d950 tx=0x7f0dcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc017030 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de01a4a60 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc004020 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0047a0 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.888+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de01a4fa0 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.889+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de0101200 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.890+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0dcc0041d0 con 0x7f0de0102570 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.891+0000 7f0dddffb640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 0x7f0dd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:54.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.891+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f0dcc0cf6a0 con 0x7f0de0102570 2024-09-19T05:42:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.891+0000 7f0de4a08640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 0x7f0dd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.892+0000 7f0de4a08640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 0x7f0dd00a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4004ad0 tx=0x7f0dd4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:54.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:54.895+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dcc09c010 con 0x7f0de0102570 2024-09-19T05:42:55.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.107+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0de0109090 con 0x7f0de0102570 2024-09-19T05:42:55.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.108+0000 7f0dddffb640 1 -- 172.21.15.1:0/3264259569 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f0dcc0860e0 con 0x7f0de0102570 2024-09-19T05:42:55.110 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:42:55.110 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:42:55.111 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:42:55.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 msgr2=0x7f0dd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 0x7f0dd00a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4004ad0 tx=0x7f0dd4004a60 comp rx=0 tx=0).stop 2024-09-19T05:42:55.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 msgr2=0x7f0de0199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:55.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d950 tx=0x7f0dcc00de10 comp rx=0 tx=0).stop 2024-09-19T05:42:55.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 shutdown_connections 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f0dd00a3240 0x7f0dd00a5700 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de0102ef0 0x7f0de01a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0102570 0x7f0de0199810 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 --2- 172.21.15.1:0/3264259569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0de0100e20 0x7f0de01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 >> 172.21.15.1:0/3264259569 conn(0x7f0de00fc7d0 msgr2=0x7f0de00fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 shutdown_connections 2024-09-19T05:42:55.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:55.110+0000 7f0de6c6c640 1 -- 172.21.15.1:0/3264259569 wait complete. 2024-09-19T05:42:55.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145082 15.72 MB/sec execute 370 sec latency 21781.707 ms 2024-09-19T05:42:55.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:55 smithi001 ceph-mon[30968]: pgmap v1003: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T05:42:55.784 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:55 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3264259569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:55.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:55 smithi082 ceph-mon[35195]: pgmap v1003: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T05:42:55.810 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:55 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3264259569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:55.820 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 4b919f05 --release --await' 2024-09-19T05:42:55.820 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 4b919f05 --release --await 2024-09-19T05:42:56.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:55 smithi060 ceph-mon[35058]: pgmap v1003: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-19T05:42:56.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:55 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3264259569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:42:56.087 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 -- 172.21.15.1:0/3443544066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4101420 msgr2=0x7fbca410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/3443544066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4101420 0x7fbca410d950 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009cd0 tx=0x7fbc9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 -- 172.21.15.1:0/3443544066 shutdown_connections 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/3443544066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4101420 0x7fbca410d950 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/3443544066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 0x7fbca4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/3443544066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4106a80 0x7fbca4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 -- 172.21.15.1:0/3443544066 >> 172.21.15.1:0/3443544066 conn(0x7fbca40fc7a0 msgr2=0x7fbca40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 -- 172.21.15.1:0/3443544066 shutdown_connections 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.586+0000 7fbcac6ef640 1 -- 172.21.15.1:0/3443544066 wait complete. 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 Processor -- start 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 -- start start 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 0x7fbca419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4101420 0x7fbca419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4110e80 con 0x7fbca4106a80 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4110d00 con 0x7fbca4101420 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcac6ef640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4111000 con 0x7fbca4100a80 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcaac8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcaac8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53790/0 (socket says 172.21.15.1:53790) 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbcaac8c640 1 -- 172.21.15.1:0/415511267 learned_addr learned my addr 172.21.15.1:0/415511267 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.587+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4101420 0x7fbca419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 0x7fbca419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 -- 172.21.15.1:0/415511267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 msgr2=0x7fbca419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 0x7fbca419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 -- 172.21.15.1:0/415511267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4101420 msgr2=0x7fbca419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4101420 0x7fbca419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 -- 172.21.15.1:0/415511267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca419f540 con 0x7fbca4106a80 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcaac8c640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005cc0 tx=0x7fbc9c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbc9b7fe640 1 -- 172.21.15.1:0/415511267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c004040 con 0x7fbca4106a80 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca419f7d0 con 0x7fbca4106a80 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbc9b7fe640 1 -- 172.21.15.1:0/415511267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc9c0046c0 con 0x7fbca4106a80 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbc9b7fe640 1 -- 172.21.15.1:0/415511267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c046480 con 0x7fbca4106a80 2024-09-19T05:42:56.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.588+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca41a7110 con 0x7fbca4106a80 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.590+0000 7fbc9b7fe640 1 -- 172.21.15.1:0/415511267 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbc9c0305a0 con 0x7fbca4106a80 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 Processor -- start 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 -- start start 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 0x5630ff5fb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630ff553620 con 0x5630ff5ee980 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5630ff4fae50 con 0x5630ff5f9240 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5630ff54f5e0 con 0x5630ff5ee060 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaa48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaa48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53800/0 (socket says 172.21.15.1:53800) 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbcaa48b640 1 -- 172.21.15.1:0/3459987884 learned_addr learned my addr 172.21.15.1:0/3459987884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 0x5630ff5fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.591+0000 7fbc9b7fe640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 0x7fbc900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 -- 172.21.15.1:0/3459987884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 msgr2=0x5630ff5ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 -- 172.21.15.1:0/3459987884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 msgr2=0x5630ff5fb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 0x5630ff5fb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 -- 172.21.15.1:0/3459987884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ff4ebd40 con 0x5630ff5ee980 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaac8c640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 0x7fbc900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 0x5630ff5fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbc9b7fe640 1 -- 172.21.15.1:0/415511267 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc9c02e030 con 0x7fbca4106a80 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cbe0 tx=0x7fbca000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11574be4af44f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbc98ff9640 1 -- 172.21.15.1:0/3459987884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0005220 con 0x5630ff5ee980 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbc98ff9640 1 -- 172.21.15.1:0/3459987884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbca0004c80 con 0x5630ff5ee980 2024-09-19T05:42:56.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbc98ff9640 1 -- 172.21.15.1:0/3459987884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0010850 con 0x5630ff5ee980 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.592+0000 7fbcaac8c640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 0x7fbc900a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0eefb0 tx=0x7fbc9c08f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3459987884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 msgr2=0x5630ff5f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cbe0 tx=0x7fbca000e720 comp rx=0 tx=0).stop 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3459987884 shutdown_connections 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5f9240 0x5630ff5fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f8d00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3459987884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3459987884 >> 172.21.15.1:0/3459987884 conn(0x5630ff5ea5f0 msgr2=0x5630ff5ea9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3459987884 shutdown_connections 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3459987884 wait complete. 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 -- start start 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.593+0000 7fbcaeac8740 1 Processor -- start 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee980 0x5630ff5f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5630ff5fbe10 con 0x5630ff5f9240 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5630ff4dbf10 con 0x5630ff5ee980 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5630ff5fbf90 con 0x5630ff5ee060 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaeac8740 10 client.0 _ll_register_callbacks cb 0x5630ff4ffdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53816/0 (socket says 172.21.15.1:53816) 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 -- 172.21.15.1:0/3990690262 learned_addr learned my addr 172.21.15.1:0/3990690262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee980 0x5630ff5f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 -- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 msgr2=0x5630ff5f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 -- 172.21.15.1:0/3990690262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee980 msgr2=0x5630ff5f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee980 0x5630ff5f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 -- 172.21.15.1:0/3990690262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ff262580 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc94012a80 tx=0x7fbc94014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d406ddeef475f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbc8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.594+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94004030 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbca0004c80 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc940041d0 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc940043d0 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 10 client.16095 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630ff32c960 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbca0004c80 con 0x5630ff5f9240 2024-09-19T05:42:56.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc94003b80 con 0x5630ff5f9240 2024-09-19T05:42:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 10 client.16095 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 10 client.16095 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 20 client.16095 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:56.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff608e60 0x5630ff60b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 4 client.16095 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:42:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630ff560b90 con 0x5630ff608e60 2024-09-19T05:42:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.595+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff608e60 0x5630ff60b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.596+0000 7fbc8dffb640 10 client.16095 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.596+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff608e60 0x5630ff60b290 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90a4ee4035ce906 server_cookie=cabcea1046653912 in_seq=0 out_seq=0 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.596+0000 7fbc8dffb640 1 -- 172.21.15.1:0/3990690262 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630ff560b90 con 0x5630ff608e60 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.596+0000 7fbc8dffb640 10 client.16095 handle_command_reply: tid=0 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.596+0000 7fbcaeac8740 1 client.16095 shutdown 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 msgr2=0x5630ff5f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc94012a80 tx=0x7fbc94014040 comp rx=0 tx=0).stop 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 shutdown_connections 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff5f6ba0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee980 0x5630ff5f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff608e60 0x5630ff60b290 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/3990690262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee060 0x5630ff5f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 >> 172.21.15.1:0/3990690262 conn(0x5630ff5ea5f0 msgr2=0x5630ff5f02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbc8dffb640 0 client.16095 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:56.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 shutdown_connections 2024-09-19T05:42:56.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 1 -- 172.21.15.1:0/3990690262 wait complete. 2024-09-19T05:42:56.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.597+0000 7fbcaeac8740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.614+0000 7fbcaeac8740 1 Processor -- start 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.614+0000 7fbcaeac8740 1 -- start start 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5f1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5f9240 0x5630ff5e9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41aee20 con 0x5630ff5ee980 2024-09-19T05:42:56.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b16a0 con 0x5630ff5ee060 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41af490 con 0x5630ff5f9240 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53832/0 (socket says 172.21.15.1:53832) 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 -- 172.21.15.1:0/4101380901 learned_addr learned my addr 172.21.15.1:0/4101380901 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5f9240 0x5630ff5e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 -- 172.21.15.1:0/4101380901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5f9240 msgr2=0x5630ff5e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5f9240 0x5630ff5e9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 -- 172.21.15.1:0/4101380901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 msgr2=0x5630ff5f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 -- 172.21.15.1:0/4101380901 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ff5f8a90 con 0x5630ff5ee980 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.615+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cbe0 tx=0x7fbca000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3bf0bed585b2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbc8ffff640 1 -- 172.21.15.1:0/4101380901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca002b020 con 0x5630ff5ee980 2024-09-19T05:42:56.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbc8ffff640 1 -- 172.21.15.1:0/4101380901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbca0004b60 con 0x5630ff5ee980 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbc8ffff640 1 -- 172.21.15.1:0/4101380901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0010700 con 0x5630ff5ee980 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 -- 172.21.15.1:0/4101380901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 msgr2=0x5630ff5f0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbca000cbe0 tx=0x7fbca000c4d0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 -- 172.21.15.1:0/4101380901 shutdown_connections 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5f9240 0x5630ff5e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5ee980 0x5630ff5f0ac0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/4101380901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 -- 172.21.15.1:0/4101380901 >> 172.21.15.1:0/4101380901 conn(0x5630ff5ea5f0 msgr2=0x5630ff5e8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 -- 172.21.15.1:0/4101380901 shutdown_connections 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.616+0000 7fbcaeac8740 1 -- 172.21.15.1:0/4101380901 wait complete. 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 -- start start 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 Processor -- start 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee980 0x5630ff5fdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41afb60 con 0x5630ff5f9240 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b0fd0 con 0x5630ff5ee060 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbca41b0230 con 0x5630ff5ee980 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaeac8740 10 client.0 _ll_register_callbacks cb 0x7fbc94012870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbca9c8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbca9c8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53846/0 (socket says 172.21.15.1:53846) 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbca9c8a640 1 -- 172.21.15.1:0/2409990738 learned_addr learned my addr 172.21.15.1:0/2409990738 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.617+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee980 0x5630ff5fdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 -- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee980 msgr2=0x5630ff5fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee980 0x5630ff5fdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 -- 172.21.15.1:0/2409990738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 msgr2=0x5630ff5fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 -- 172.21.15.1:0/2409990738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ff66d130 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbca9c8a640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbc940057c0 tx=0x7fbc940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f41f9f26bfa0b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400bcd0 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fbc9400db60 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbca0004b60 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc9400dd60 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbcaeac8740 10 client.16101 fetch_fsmap learned FSMap version 21 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5630ff674520 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbca0004b60 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.618+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc94004bb0 con 0x5630ff5f9240 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 10 client.16101 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:42:56.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 10 client.16101 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 20 client.16101 populate_metadata read hostname 'smithi001' 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff674950 0x5630ff676d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 4 client.16101 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4b919f05", "release": true, "await": true}] 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4b919f05", "release": true, "await": true}) -- 0x5630ff55b0a0 con 0x5630ff674950 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff674950 0x5630ff676d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbcaa48b640 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff674950 0x5630ff676d40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f682c84fae52a61f server_cookie=159c2339a528f2f0 in_seq=0 out_seq=0 2024-09-19T05:42:56.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.619+0000 7fbc8dffb640 10 client.16101 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:56.656 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145084 15.68 MB/sec execute 371 sec latency 22781.739 ms 2024-09-19T05:42:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.697+0000 7fbc8dffb640 1 -- 172.21.15.1:0/2409990738 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5630ff55b0a0 con 0x5630ff674950 2024-09-19T05:42:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.697+0000 7fbc8dffb640 10 client.16101 handle_command_reply: tid=0 2024-09-19T05:42:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.697+0000 7fbcaeac8740 1 client.16101 shutdown 2024-09-19T05:42:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 msgr2=0x5630ff66cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbc940057c0 tx=0x7fbc940046c0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 shutdown_connections 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5630ff5f9240 0x5630ff66cb70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5630ff674950 0x5630ff676d40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbc8dffb640 0 client.16101 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5630ff5ee980 0x5630ff5fdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 --2- 172.21.15.1:0/2409990738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5630ff5ee060 0x5630ff5fd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 >> 172.21.15.1:0/2409990738 conn(0x5630ff5ea5f0 msgr2=0x5630ff5f60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 shutdown_connections 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 1 -- 172.21.15.1:0/2409990738 wait complete. 2024-09-19T05:42:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.698+0000 7fbcaeac8740 20 client.16101 trim_cache size 0 max 16384 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 76, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "4b919f05": { 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 76, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:42:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 144.5, 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:42:56.703 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 msgr2=0x7fbc900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 0x7fbc900a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0eefb0 tx=0x7fbc9c08f040 comp rx=0 tx=0).stop 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 msgr2=0x7fbca419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c005cc0 tx=0x7fbc9c003970 comp rx=0 tx=0).stop 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 shutdown_connections 2024-09-19T05:42:56.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fbc900a3240 0x7fbc900a5700 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbca4106a80 0x7fbca419ee60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca4101420 0x7fbca419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 --2- 172.21.15.1:0/415511267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4100a80 0x7fbca419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 >> 172.21.15.1:0/415511267 conn(0x7fbca40fc7a0 msgr2=0x7fbca40fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 shutdown_connections 2024-09-19T05:42:56.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:42:56.699+0000 7fbcac6ef640 1 -- 172.21.15.1:0/415511267 wait complete. 2024-09-19T05:42:57.581 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4b919f05', total seconds elapsed: 28.0 2024-09-19T05:42:57.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145441 15.69 MB/sec execute 372 sec latency 22800.715 ms 2024-09-19T05:42:57.803 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:57 smithi060 ceph-mon[35058]: pgmap v1004: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T05:42:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:57 smithi001 ceph-mon[30968]: pgmap v1004: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T05:42:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:57 smithi082 ceph-mon[35195]: pgmap v1004: 129 pgs: 129 active+clean; 433 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-09-19T05:42:58.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 145774 15.69 MB/sec execute 373 sec latency 92.045 ms 2024-09-19T05:42:59.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 146209 15.70 MB/sec execute 374 sec latency 69.913 ms 2024-09-19T05:42:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:42:59 smithi001 ceph-mon[30968]: pgmap v1005: 129 pgs: 129 active+clean; 435 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 188 KiB/s wr, 22 op/s 2024-09-19T05:43:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:42:59 smithi060 ceph-mon[35058]: pgmap v1005: 129 pgs: 129 active+clean; 435 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 188 KiB/s wr, 22 op/s 2024-09-19T05:43:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:42:59 smithi082 ceph-mon[35195]: pgmap v1005: 129 pgs: 129 active+clean; 435 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 188 KiB/s wr, 22 op/s 2024-09-19T05:43:00.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 146681 15.72 MB/sec execute 375 sec latency 105.319 ms 2024-09-19T05:43:01.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 147120 15.74 MB/sec execute 376 sec latency 140.154 ms 2024-09-19T05:43:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:01 smithi001 ceph-mon[30968]: pgmap v1006: 129 pgs: 129 active+clean; 437 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 376 KiB/s wr, 41 op/s 2024-09-19T05:43:02.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:01 smithi060 ceph-mon[35058]: pgmap v1006: 129 pgs: 129 active+clean; 437 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 376 KiB/s wr, 41 op/s 2024-09-19T05:43:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:01 smithi082 ceph-mon[35195]: pgmap v1006: 129 pgs: 129 active+clean; 437 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 376 KiB/s wr, 41 op/s 2024-09-19T05:43:02.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 147665 15.79 MB/sec execute 377 sec latency 62.987 ms 2024-09-19T05:43:03.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 148124 15.82 MB/sec execute 378 sec latency 94.677 ms 2024-09-19T05:43:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:03 smithi001 ceph-mon[30968]: pgmap v1007: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 79 op/s 2024-09-19T05:43:04.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:03 smithi060 ceph-mon[35058]: pgmap v1007: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 79 op/s 2024-09-19T05:43:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:03 smithi082 ceph-mon[35195]: pgmap v1007: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.2 MiB/s wr, 79 op/s 2024-09-19T05:43:04.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 148535 15.84 MB/sec execute 379 sec latency 70.588 ms 2024-09-19T05:43:05.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 148907 15.85 MB/sec execute 380 sec latency 85.605 ms 2024-09-19T05:43:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:05 smithi001 ceph-mon[30968]: pgmap v1008: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-09-19T05:43:06.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:05 smithi060 ceph-mon[35058]: pgmap v1008: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-09-19T05:43:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:05 smithi082 ceph-mon[35195]: pgmap v1008: 129 pgs: 129 active+clean; 441 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-09-19T05:43:06.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 149164 15.84 MB/sec execute 381 sec latency 140.491 ms 2024-09-19T05:43:07.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:07 smithi001 ceph-mon[30968]: pgmap v1009: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:43:07.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 149592 15.85 MB/sec execute 382 sec latency 96.835 ms 2024-09-19T05:43:08.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:07 smithi060 ceph-mon[35058]: pgmap v1009: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:43:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:07 smithi082 ceph-mon[35195]: pgmap v1009: 129 pgs: 129 active+clean; 439 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:43:08.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 150158 15.88 MB/sec execute 383 sec latency 44.571 ms 2024-09-19T05:43:09.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 150692 15.91 MB/sec execute 384 sec latency 62.053 ms 2024-09-19T05:43:09.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:09 smithi001 ceph-mon[30968]: pgmap v1010: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2024-09-19T05:43:10.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:09 smithi060 ceph-mon[35058]: pgmap v1010: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2024-09-19T05:43:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:09 smithi082 ceph-mon[35195]: pgmap v1010: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.7 MiB/s wr, 246 op/s 2024-09-19T05:43:10.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 151277 15.96 MB/sec execute 385 sec latency 75.436 ms 2024-09-19T05:43:11.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 151759 16.00 MB/sec execute 386 sec latency 75.508 ms 2024-09-19T05:43:11.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:11 smithi001 ceph-mon[30968]: pgmap v1011: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 242 op/s 2024-09-19T05:43:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:11 smithi060 ceph-mon[35058]: pgmap v1011: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 242 op/s 2024-09-19T05:43:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:11 smithi082 ceph-mon[35195]: pgmap v1011: 129 pgs: 129 active+clean; 431 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.8 MiB/s wr, 242 op/s 2024-09-19T05:43:12.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 152140 16.01 MB/sec execute 387 sec latency 64.497 ms 2024-09-19T05:43:13.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 152496 16.02 MB/sec execute 388 sec latency 80.803 ms 2024-09-19T05:43:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:13 smithi001 ceph-mon[30968]: pgmap v1012: 129 pgs: 129 active+clean; 436 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-19T05:43:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:13 smithi060 ceph-mon[35058]: pgmap v1012: 129 pgs: 129 active+clean; 436 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-19T05:43:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:13 smithi082 ceph-mon[35195]: pgmap v1012: 129 pgs: 129 active+clean; 436 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-19T05:43:14.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 152895 16.03 MB/sec execute 389 sec latency 72.399 ms 2024-09-19T05:43:15.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 153348 16.04 MB/sec execute 390 sec latency 62.735 ms 2024-09-19T05:43:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:15 smithi001 ceph-mon[30968]: pgmap v1013: 129 pgs: 129 active+clean; 437 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-09-19T05:43:16.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:15 smithi060 ceph-mon[35058]: pgmap v1013: 129 pgs: 129 active+clean; 437 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-09-19T05:43:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:15 smithi082 ceph-mon[35195]: pgmap v1013: 129 pgs: 129 active+clean; 437 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.1 MiB/s wr, 290 op/s 2024-09-19T05:43:16.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 153803 16.05 MB/sec execute 391 sec latency 109.642 ms 2024-09-19T05:43:17.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 154337 16.10 MB/sec execute 392 sec latency 94.608 ms 2024-09-19T05:43:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:17 smithi001 ceph-mon[30968]: pgmap v1014: 129 pgs: 129 active+clean; 440 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 280 op/s 2024-09-19T05:43:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:17 smithi060 ceph-mon[35058]: pgmap v1014: 129 pgs: 129 active+clean; 440 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 280 op/s 2024-09-19T05:43:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:17 smithi082 ceph-mon[35195]: pgmap v1014: 129 pgs: 129 active+clean; 440 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 280 op/s 2024-09-19T05:43:18.657 INFO:tasks.workunit.client.0.smithi001.stdout: 10 154849 16.13 MB/sec execute 393 sec latency 80.563 ms 2024-09-19T05:43:19.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 155339 16.16 MB/sec execute 394 sec latency 54.188 ms 2024-09-19T05:43:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:19 smithi001 ceph-mon[30968]: pgmap v1015: 129 pgs: 129 active+clean; 445 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 273 op/s 2024-09-19T05:43:20.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:19 smithi060 ceph-mon[35058]: pgmap v1015: 129 pgs: 129 active+clean; 445 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 273 op/s 2024-09-19T05:43:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:19 smithi082 ceph-mon[35195]: pgmap v1015: 129 pgs: 129 active+clean; 445 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 273 op/s 2024-09-19T05:43:20.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 155730 16.18 MB/sec execute 395 sec latency 100.641 ms 2024-09-19T05:43:21.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 156128 16.19 MB/sec execute 396 sec latency 83.889 ms 2024-09-19T05:43:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:21 smithi001 ceph-mon[30968]: pgmap v1016: 129 pgs: 129 active+clean; 448 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:43:22.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:21 smithi060 ceph-mon[35058]: pgmap v1016: 129 pgs: 129 active+clean; 448 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:43:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:21 smithi082 ceph-mon[35195]: pgmap v1016: 129 pgs: 129 active+clean; 448 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-19T05:43:22.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 156601 16.21 MB/sec execute 397 sec latency 88.954 ms 2024-09-19T05:43:23.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:23 smithi060 ceph-mon[35058]: pgmap v1017: 129 pgs: 129 active+clean; 454 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 273 op/s 2024-09-19T05:43:23.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:23 smithi082 ceph-mon[35195]: pgmap v1017: 129 pgs: 129 active+clean; 454 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 273 op/s 2024-09-19T05:43:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:23 smithi001 ceph-mon[30968]: pgmap v1017: 129 pgs: 129 active+clean; 454 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 273 op/s 2024-09-19T05:43:23.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 157057 16.22 MB/sec execute 398 sec latency 81.148 ms 2024-09-19T05:43:24.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 157362 16.21 MB/sec execute 399 sec latency 345.888 ms 2024-09-19T05:43:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:25 smithi001 ceph-mon[30968]: pgmap v1018: 129 pgs: 129 active+clean; 455 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-09-19T05:43:25.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 157894 16.25 MB/sec execute 400 sec latency 74.505 ms 2024-09-19T05:43:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:25 smithi060 ceph-mon[35058]: pgmap v1018: 129 pgs: 129 active+clean; 455 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-09-19T05:43:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:25 smithi082 ceph-mon[35195]: pgmap v1018: 129 pgs: 129 active+clean; 455 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-09-19T05:43:26.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 158406 16.29 MB/sec execute 401 sec latency 101.827 ms 2024-09-19T05:43:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:27 smithi001 ceph-mon[30968]: pgmap v1019: 129 pgs: 129 active+clean; 464 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-09-19T05:43:27.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 158871 16.31 MB/sec execute 402 sec latency 46.081 ms 2024-09-19T05:43:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:27 smithi060 ceph-mon[35058]: pgmap v1019: 129 pgs: 129 active+clean; 464 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-09-19T05:43:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:27 smithi082 ceph-mon[35195]: pgmap v1019: 129 pgs: 129 active+clean; 464 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-09-19T05:43:28.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 159248 16.33 MB/sec execute 403 sec latency 127.329 ms 2024-09-19T05:43:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:29 smithi001 ceph-mon[30968]: pgmap v1020: 129 pgs: 129 active+clean; 466 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2024-09-19T05:43:29.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 159628 16.34 MB/sec execute 404 sec latency 77.644 ms 2024-09-19T05:43:29.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:29 smithi060 ceph-mon[35058]: pgmap v1020: 129 pgs: 129 active+clean; 466 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2024-09-19T05:43:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:29 smithi082 ceph-mon[35195]: pgmap v1020: 129 pgs: 129 active+clean; 466 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2024-09-19T05:43:30.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 160081 16.35 MB/sec execute 405 sec latency 67.310 ms 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: pgmap v1021: 129 pgs: 129 active+clean; 450 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:31 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 160414 16.35 MB/sec execute 406 sec latency 285.687 ms 2024-09-19T05:43:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: pgmap v1021: 129 pgs: 129 active+clean; 450 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-09-19T05:43:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:43:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:31 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: pgmap v1021: 129 pgs: 129 active+clean; 450 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.2 MiB/s wr, 204 op/s 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:31 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:32.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 160822 16.36 MB/sec execute 407 sec latency 279.740 ms 2024-09-19T05:43:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:43:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:43:33.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:43:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:43:33.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:43:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:43:33.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:43:33.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 161295 16.38 MB/sec execute 408 sec latency 88.817 ms 2024-09-19T05:43:34.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:33 smithi060 ceph-mon[35058]: pgmap v1022: 129 pgs: 129 active+clean; 452 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-09-19T05:43:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:33 smithi082 ceph-mon[35195]: pgmap v1022: 129 pgs: 129 active+clean; 452 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-09-19T05:43:34.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:33 smithi001 ceph-mon[30968]: pgmap v1022: 129 pgs: 129 active+clean; 452 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-09-19T05:43:34.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 161845 16.42 MB/sec execute 409 sec latency 87.075 ms 2024-09-19T05:43:35.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 162314 16.45 MB/sec execute 410 sec latency 65.007 ms 2024-09-19T05:43:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:35 smithi060 ceph-mon[35058]: pgmap v1023: 129 pgs: 129 active+clean; 456 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-09-19T05:43:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:35 smithi082 ceph-mon[35195]: pgmap v1023: 129 pgs: 129 active+clean; 456 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-09-19T05:43:36.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:35 smithi001 ceph-mon[30968]: pgmap v1023: 129 pgs: 129 active+clean; 456 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-09-19T05:43:36.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 162684 16.47 MB/sec execute 411 sec latency 265.923 ms 2024-09-19T05:43:37.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 162968 16.45 MB/sec execute 412 sec latency 414.748 ms 2024-09-19T05:43:38.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:37 smithi060 ceph-mon[35058]: pgmap v1024: 129 pgs: 129 active+clean; 457 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-19T05:43:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:37 smithi082 ceph-mon[35195]: pgmap v1024: 129 pgs: 129 active+clean; 457 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-19T05:43:38.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:37 smithi001 ceph-mon[30968]: pgmap v1024: 129 pgs: 129 active+clean; 457 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-19T05:43:38.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 163266 16.45 MB/sec execute 413 sec latency 100.071 ms 2024-09-19T05:43:39.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 163747 16.47 MB/sec execute 414 sec latency 101.746 ms 2024-09-19T05:43:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:39 smithi060 ceph-mon[35058]: pgmap v1025: 129 pgs: 129 active+clean; 465 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.3 MiB/s wr, 290 op/s 2024-09-19T05:43:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:39 smithi082 ceph-mon[35195]: pgmap v1025: 129 pgs: 129 active+clean; 465 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.3 MiB/s wr, 290 op/s 2024-09-19T05:43:40.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:39 smithi001 ceph-mon[30968]: pgmap v1025: 129 pgs: 129 active+clean; 465 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.3 MiB/s wr, 290 op/s 2024-09-19T05:43:40.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 164217 16.48 MB/sec execute 415 sec latency 55.899 ms 2024-09-19T05:43:41.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 164688 16.51 MB/sec execute 416 sec latency 150.482 ms 2024-09-19T05:43:42.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:41 smithi060 ceph-mon[35058]: pgmap v1026: 129 pgs: 129 active+clean; 465 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-19T05:43:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:41 smithi082 ceph-mon[35195]: pgmap v1026: 129 pgs: 129 active+clean; 465 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-19T05:43:42.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:41 smithi001 ceph-mon[30968]: pgmap v1026: 129 pgs: 129 active+clean; 465 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 291 op/s 2024-09-19T05:43:42.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 165093 16.52 MB/sec execute 417 sec latency 383.721 ms 2024-09-19T05:43:43.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 165418 16.52 MB/sec execute 418 sec latency 132.928 ms 2024-09-19T05:43:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:43 smithi060 ceph-mon[35058]: pgmap v1027: 129 pgs: 129 active+clean; 466 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:43:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:43 smithi082 ceph-mon[35195]: pgmap v1027: 129 pgs: 129 active+clean; 466 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:43:44.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:43 smithi001 ceph-mon[30968]: pgmap v1027: 129 pgs: 129 active+clean; 466 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-19T05:43:44.658 INFO:tasks.workunit.client.0.smithi001.stdout: 10 165915 16.55 MB/sec execute 419 sec latency 68.732 ms 2024-09-19T05:43:45.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 166305 16.58 MB/sec execute 420 sec latency 71.051 ms 2024-09-19T05:43:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:45 smithi060 ceph-mon[35058]: pgmap v1028: 129 pgs: 129 active+clean; 471 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-09-19T05:43:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:45 smithi082 ceph-mon[35195]: pgmap v1028: 129 pgs: 129 active+clean; 471 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-09-19T05:43:46.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:45 smithi001 ceph-mon[30968]: pgmap v1028: 129 pgs: 129 active+clean; 471 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 332 op/s 2024-09-19T05:43:46.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 166704 16.58 MB/sec execute 421 sec latency 130.860 ms 2024-09-19T05:43:47.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 166960 16.58 MB/sec execute 422 sec latency 295.118 ms 2024-09-19T05:43:48.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:47 smithi060 ceph-mon[35058]: pgmap v1029: 129 pgs: 129 active+clean; 470 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.8 MiB/s wr, 366 op/s 2024-09-19T05:43:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:47 smithi082 ceph-mon[35195]: pgmap v1029: 129 pgs: 129 active+clean; 470 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.8 MiB/s wr, 366 op/s 2024-09-19T05:43:48.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:47 smithi001 ceph-mon[30968]: pgmap v1029: 129 pgs: 129 active+clean; 470 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.8 MiB/s wr, 366 op/s 2024-09-19T05:43:48.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 167298 16.56 MB/sec execute 423 sec latency 157.640 ms 2024-09-19T05:43:49.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 167783 16.59 MB/sec execute 424 sec latency 52.650 ms 2024-09-19T05:43:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:49 smithi060 ceph-mon[35058]: pgmap v1030: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.2 MiB/s wr, 399 op/s 2024-09-19T05:43:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:49 smithi082 ceph-mon[35195]: pgmap v1030: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.2 MiB/s wr, 399 op/s 2024-09-19T05:43:50.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:49 smithi001 ceph-mon[30968]: pgmap v1030: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 7.2 MiB/s wr, 399 op/s 2024-09-19T05:43:50.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 168402 16.62 MB/sec execute 425 sec latency 61.342 ms 2024-09-19T05:43:51.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 168964 16.67 MB/sec execute 426 sec latency 65.655 ms 2024-09-19T05:43:52.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:51 smithi060 ceph-mon[35058]: pgmap v1031: 129 pgs: 129 active+clean; 450 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:43:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:51 smithi082 ceph-mon[35195]: pgmap v1031: 129 pgs: 129 active+clean; 450 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:43:52.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:51 smithi001 ceph-mon[30968]: pgmap v1031: 129 pgs: 129 active+clean; 450 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:43:52.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 169265 16.67 MB/sec execute 427 sec latency 236.062 ms 2024-09-19T05:43:53.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 169603 16.68 MB/sec execute 428 sec latency 87.645 ms 2024-09-19T05:43:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:53 smithi060 ceph-mon[35058]: pgmap v1032: 129 pgs: 129 active+clean; 452 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 366 op/s 2024-09-19T05:43:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:53 smithi082 ceph-mon[35195]: pgmap v1032: 129 pgs: 129 active+clean; 452 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 366 op/s 2024-09-19T05:43:54.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:53 smithi001 ceph-mon[30968]: pgmap v1032: 129 pgs: 129 active+clean; 452 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.9 MiB/s wr, 366 op/s 2024-09-19T05:43:54.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 169989 16.69 MB/sec execute 429 sec latency 80.587 ms 2024-09-19T05:43:55.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 170407 16.70 MB/sec execute 430 sec latency 88.148 ms 2024-09-19T05:43:56.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:55 smithi060 ceph-mon[35058]: pgmap v1033: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:43:56.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:55 smithi082 ceph-mon[35195]: pgmap v1033: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:43:56.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:55 smithi001 ceph-mon[30968]: pgmap v1033: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:43:56.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 170872 16.71 MB/sec execute 431 sec latency 82.294 ms 2024-09-19T05:43:57.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 171120 16.70 MB/sec execute 432 sec latency 259.190 ms 2024-09-19T05:43:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:43:58 smithi082 ceph-mon[35195]: pgmap v1034: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.7 MiB/s wr, 368 op/s 2024-09-19T05:43:58.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:43:58 smithi001 ceph-mon[30968]: pgmap v1034: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.7 MiB/s wr, 368 op/s 2024-09-19T05:43:58.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:43:58 smithi060 ceph-mon[35058]: pgmap v1034: 129 pgs: 129 active+clean; 459 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 6.7 MiB/s wr, 368 op/s 2024-09-19T05:43:58.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 171467 16.70 MB/sec execute 433 sec latency 113.800 ms 2024-09-19T05:43:59.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 172022 16.73 MB/sec execute 434 sec latency 69.700 ms 2024-09-19T05:44:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:00 smithi082 ceph-mon[35195]: pgmap v1035: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 377 op/s 2024-09-19T05:44:00.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:00 smithi001 ceph-mon[30968]: pgmap v1035: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 377 op/s 2024-09-19T05:44:00.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:00 smithi060 ceph-mon[35058]: pgmap v1035: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.3 MiB/s wr, 377 op/s 2024-09-19T05:44:00.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 172568 16.77 MB/sec execute 435 sec latency 69.175 ms 2024-09-19T05:44:01.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 173081 16.80 MB/sec execute 436 sec latency 58.976 ms 2024-09-19T05:44:02.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:02 smithi001 ceph-mon[30968]: pgmap v1036: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-19T05:44:02.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:02 smithi060 ceph-mon[35058]: pgmap v1036: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-19T05:44:02.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:02 smithi082 ceph-mon[35195]: pgmap v1036: 129 pgs: 129 active+clean; 464 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-09-19T05:44:02.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 173327 16.80 MB/sec execute 437 sec latency 250.359 ms 2024-09-19T05:44:03.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 173573 16.79 MB/sec execute 438 sec latency 158.799 ms 2024-09-19T05:44:04.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:04 smithi001 ceph-mon[30968]: pgmap v1037: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 396 op/s 2024-09-19T05:44:04.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:04 smithi060 ceph-mon[35058]: pgmap v1037: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 396 op/s 2024-09-19T05:44:04.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:04 smithi082 ceph-mon[35195]: pgmap v1037: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.8 MiB/s wr, 396 op/s 2024-09-19T05:44:04.659 INFO:tasks.workunit.client.0.smithi001.stdout: 10 173958 16.79 MB/sec execute 439 sec latency 78.065 ms 2024-09-19T05:44:05.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 174397 16.80 MB/sec execute 440 sec latency 85.125 ms 2024-09-19T05:44:06.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:06 smithi001 ceph-mon[30968]: pgmap v1038: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-19T05:44:06.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:06 smithi060 ceph-mon[35058]: pgmap v1038: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-19T05:44:06.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:06 smithi082 ceph-mon[35195]: pgmap v1038: 129 pgs: 129 active+clean; 469 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-19T05:44:06.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 174868 16.81 MB/sec execute 441 sec latency 74.987 ms 2024-09-19T05:44:07.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 175116 16.81 MB/sec execute 442 sec latency 321.384 ms 2024-09-19T05:44:08.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:08 smithi001 ceph-mon[30968]: pgmap v1039: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.2 MiB/s wr, 365 op/s 2024-09-19T05:44:08.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:08 smithi060 ceph-mon[35058]: pgmap v1039: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.2 MiB/s wr, 365 op/s 2024-09-19T05:44:08.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:08 smithi082 ceph-mon[35195]: pgmap v1039: 129 pgs: 129 active+clean; 462 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.2 MiB/s wr, 365 op/s 2024-09-19T05:44:08.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 175665 16.84 MB/sec execute 443 sec latency 77.025 ms 2024-09-19T05:44:09.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 176093 16.86 MB/sec execute 444 sec latency 83.080 ms 2024-09-19T05:44:10.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:10 smithi001 ceph-mon[30968]: pgmap v1040: 129 pgs: 129 active+clean; 457 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-19T05:44:10.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:10 smithi060 ceph-mon[35058]: pgmap v1040: 129 pgs: 129 active+clean; 457 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-19T05:44:10.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:10 smithi082 ceph-mon[35195]: pgmap v1040: 129 pgs: 129 active+clean; 457 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-19T05:44:10.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 176585 16.88 MB/sec execute 445 sec latency 61.884 ms 2024-09-19T05:44:11.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 176964 16.90 MB/sec execute 446 sec latency 66.565 ms 2024-09-19T05:44:12.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:12 smithi001 ceph-mon[30968]: pgmap v1041: 129 pgs: 129 active+clean; 452 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-19T05:44:12.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:12 smithi060 ceph-mon[35058]: pgmap v1041: 129 pgs: 129 active+clean; 452 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-19T05:44:12.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:12 smithi082 ceph-mon[35195]: pgmap v1041: 129 pgs: 129 active+clean; 452 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 307 op/s 2024-09-19T05:44:12.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 177210 16.88 MB/sec execute 447 sec latency 419.089 ms 2024-09-19T05:44:13.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 177553 16.89 MB/sec execute 448 sec latency 396.859 ms 2024-09-19T05:44:14.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:14 smithi001 ceph-mon[30968]: pgmap v1042: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 334 op/s 2024-09-19T05:44:14.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:14 smithi060 ceph-mon[35058]: pgmap v1042: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 334 op/s 2024-09-19T05:44:14.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:14 smithi082 ceph-mon[35195]: pgmap v1042: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.3 MiB/s wr, 334 op/s 2024-09-19T05:44:14.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 177847 16.88 MB/sec execute 449 sec latency 99.513 ms 2024-09-19T05:44:15.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 178376 16.90 MB/sec execute 450 sec latency 96.742 ms 2024-09-19T05:44:16.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:16 smithi001 ceph-mon[30968]: pgmap v1043: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 318 op/s 2024-09-19T05:44:16.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:16 smithi060 ceph-mon[35058]: pgmap v1043: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 318 op/s 2024-09-19T05:44:16.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:16 smithi082 ceph-mon[35195]: pgmap v1043: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 318 op/s 2024-09-19T05:44:16.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 178958 16.92 MB/sec execute 451 sec latency 75.614 ms 2024-09-19T05:44:17.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 179385 16.95 MB/sec execute 452 sec latency 242.022 ms 2024-09-19T05:44:18.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:18 smithi001 ceph-mon[30968]: pgmap v1044: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 341 op/s 2024-09-19T05:44:18.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:18 smithi060 ceph-mon[35058]: pgmap v1044: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 341 op/s 2024-09-19T05:44:18.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:18 smithi082 ceph-mon[35195]: pgmap v1044: 129 pgs: 129 active+clean; 456 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.4 MiB/s wr, 341 op/s 2024-09-19T05:44:18.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 179818 16.96 MB/sec execute 453 sec latency 384.901 ms 2024-09-19T05:44:19.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 180206 16.98 MB/sec execute 454 sec latency 78.547 ms 2024-09-19T05:44:20.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:20 smithi001 ceph-mon[30968]: pgmap v1045: 129 pgs: 129 active+clean; 463 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 357 op/s 2024-09-19T05:44:20.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:20 smithi060 ceph-mon[35058]: pgmap v1045: 129 pgs: 129 active+clean; 463 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 357 op/s 2024-09-19T05:44:20.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:20 smithi082 ceph-mon[35195]: pgmap v1045: 129 pgs: 129 active+clean; 463 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 6.5 MiB/s wr, 357 op/s 2024-09-19T05:44:20.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 180619 16.99 MB/sec execute 455 sec latency 73.494 ms 2024-09-19T05:44:21.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 180973 17.00 MB/sec execute 456 sec latency 71.261 ms 2024-09-19T05:44:22.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:22 smithi001 ceph-mon[30968]: pgmap v1046: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 377 op/s 2024-09-19T05:44:22.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:22 smithi060 ceph-mon[35058]: pgmap v1046: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 377 op/s 2024-09-19T05:44:22.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:22 smithi082 ceph-mon[35195]: pgmap v1046: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 377 op/s 2024-09-19T05:44:22.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 181305 17.01 MB/sec execute 457 sec latency 182.933 ms 2024-09-19T05:44:23.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:23 smithi060 ceph-mon[35058]: pgmap v1047: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 369 op/s 2024-09-19T05:44:23.508 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:23 smithi082 ceph-mon[35195]: pgmap v1047: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 369 op/s 2024-09-19T05:44:23.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:23 smithi001 ceph-mon[30968]: pgmap v1047: 129 pgs: 129 active+clean; 468 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.6 MiB/s wr, 369 op/s 2024-09-19T05:44:23.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 181680 16.99 MB/sec execute 458 sec latency 339.025 ms 2024-09-19T05:44:24.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 181937 16.98 MB/sec execute 459 sec latency 147.149 ms 2024-09-19T05:44:25.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:25 smithi001 ceph-mon[30968]: pgmap v1048: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:44:25.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 182470 17.01 MB/sec execute 460 sec latency 135.019 ms 2024-09-19T05:44:25.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:25 smithi060 ceph-mon[35058]: pgmap v1048: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:44:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:25 smithi082 ceph-mon[35195]: pgmap v1048: 129 pgs: 129 active+clean; 452 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-09-19T05:44:26.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 183148 17.05 MB/sec execute 461 sec latency 53.808 ms 2024-09-19T05:44:27.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:27 smithi001 ceph-mon[30968]: pgmap v1049: 129 pgs: 129 active+clean; 455 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:44:27.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 183640 17.08 MB/sec execute 462 sec latency 68.899 ms 2024-09-19T05:44:27.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:27 smithi060 ceph-mon[35058]: pgmap v1049: 129 pgs: 129 active+clean; 455 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:44:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:27 smithi082 ceph-mon[35195]: pgmap v1049: 129 pgs: 129 active+clean; 455 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.5 MiB/s wr, 366 op/s 2024-09-19T05:44:28.582 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.1 2024-09-19T05:44:28.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:44:28.660 INFO:tasks.workunit.client.0.smithi001.stdout: 10 183969 17.10 MB/sec execute 463 sec latency 339.654 ms 2024-09-19T05:44:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:44:29.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:29 smithi001 ceph-mon[30968]: pgmap v1050: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 381 op/s 2024-09-19T05:44:29.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184243 17.09 MB/sec execute 464 sec latency 95.722 ms 2024-09-19T05:44:29.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:29 smithi060 ceph-mon[35058]: pgmap v1050: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 381 op/s 2024-09-19T05:44:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:29 smithi082 ceph-mon[35195]: pgmap v1050: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 6.4 MiB/s wr, 381 op/s 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 -- 172.21.15.1:0/1517392634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641008d0 msgr2=0x7ffb64100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/1517392634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641008d0 0x7ffb64100d30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009930 tx=0x7ffb5802a420 comp rx=0 tx=0).stop 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 -- 172.21.15.1:0/1517392634 shutdown_connections 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/1517392634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 0x7ffb6410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/1517392634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641008d0 0x7ffb64100d30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/1517392634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641068d0 0x7ffb64106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 -- 172.21.15.1:0/1517392634 >> 172.21.15.1:0/1517392634 conn(0x7ffb640fc610 msgr2=0x7ffb640fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 -- 172.21.15.1:0/1517392634 shutdown_connections 2024-09-19T05:44:29.764 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.729+0000 7ffb68f9e640 1 -- 172.21.15.1:0/1517392634 wait complete. 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 Processor -- start 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 -- start start 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 0x7ffb64198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111df0 con 0x7ffb641068d0 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111c70 con 0x7ffb641008d0 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb68f9e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb64111f70 con 0x7ffb64101270 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.730+0000 7ffb63fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb62ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 0x7ffb64198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35874/0 (socket says 172.21.15.1:35874) 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 -- 172.21.15.1:0/3433245438 learned_addr learned my addr 172.21.15.1:0/3433245438 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54132/0 (socket says 172.21.15.1:54132) 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 -- 172.21.15.1:0/3433245438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 msgr2=0x7ffb64198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 0x7ffb64198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 -- 172.21.15.1:0/3433245438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 msgr2=0x7ffb641982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 -- 172.21.15.1:0/3433245438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6419d2a0 con 0x7ffb641068d0 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb637fe640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:29.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb63fff640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009fd0 tx=0x7ffb5c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c017070 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6419d590 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb5c003e50 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0106c0 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.731+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641a4e70 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.732+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64102010 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.734+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ffb5c003970 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.734+0000 7ffb60ff9640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 0x7ffb4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.734+0000 7ffb637fe640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 0x7ffb4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.734+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb5c0cf980 con 0x7ffb641068d0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.735+0000 7ffb637fe640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 0x7ffb4c0a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009f40 tx=0x7ffb54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:29.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:29.738+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb5c09bca0 con 0x7ffb641068d0 2024-09-19T05:44:30.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.053+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb64100d30 con 0x7ffb641068d0 2024-09-19T05:44:30.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.054+0000 7ffb60ff9640 1 -- 172.21.15.1:0/3433245438 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7ffb5c09ffa0 con 0x7ffb641068d0 2024-09-19T05:44:30.056 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:44:30.056 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:44:30.057 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:44:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 msgr2=0x7ffb4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 0x7ffb4c0a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009f40 tx=0x7ffb54005f90 comp rx=0 tx=0).stop 2024-09-19T05:44:30.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 msgr2=0x7ffb6419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009fd0 tx=0x7ffb5c00b260 comp rx=0 tx=0).stop 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 shutdown_connections 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb4c0a3240 0x7ffb4c0a5700 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb641068d0 0x7ffb6419cbc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb64101270 0x7ffb64198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 --2- 172.21.15.1:0/3433245438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb641008d0 0x7ffb641982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.057+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 >> 172.21.15.1:0/3433245438 conn(0x7ffb640fc610 msgr2=0x7ffb640fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.058+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 shutdown_connections 2024-09-19T05:44:30.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:30.058+0000 7ffb68f9e640 1 -- 172.21.15.1:0/3433245438 wait complete. 2024-09-19T05:44:30.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:30 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3433245438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:30.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184545 17.08 MB/sec execute 465 sec latency 93.351 ms 2024-09-19T05:44:30.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:30 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3433245438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:30.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:30 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3433245438' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:30.922 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 133.1 --await-for 45.0' 2024-09-19T05:44:30.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 133.1 --await-for 45.0 2024-09-19T05:44:31.206 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:44:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:31 smithi001 ceph-mon[30968]: pgmap v1051: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 316 op/s 2024-09-19T05:44:31.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184890 17.09 MB/sec execute 466 sec latency 87.800 ms 2024-09-19T05:44:31.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:31 smithi060 ceph-mon[35058]: pgmap v1051: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 316 op/s 2024-09-19T05:44:31.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:31 smithi082 ceph-mon[35195]: pgmap v1051: 129 pgs: 129 active+clean; 460 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.6 MiB/s wr, 316 op/s 2024-09-19T05:44:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 -- 172.21.15.1:0/7498717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674101de0 msgr2=0x7f96741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 --2- 172.21.15.1:0/7498717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674101de0 0x7f96741021c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9664009900 tx=0x7f966402a410 comp rx=0 tx=0).stop 2024-09-19T05:44:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 -- 172.21.15.1:0/7498717 shutdown_connections 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 --2- 172.21.15.1:0/7498717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674106f10 0x7f967410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 --2- 172.21.15.1:0/7498717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f96741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 --2- 172.21.15.1:0/7498717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674101de0 0x7f96741021c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 -- 172.21.15.1:0/7498717 >> 172.21.15.1:0/7498717 conn(0x7f96740fd8c0 msgr2=0x7f96740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 -- 172.21.15.1:0/7498717 shutdown_connections 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.817+0000 7f967a64d640 1 -- 172.21.15.1:0/7498717 wait complete. 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 Processor -- start 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 -- start start 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 0x7f96740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f9674074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9674111f70 con 0x7f9674106f10 2024-09-19T05:44:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9674111df0 con 0x7f9674102790 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f967a64d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96741120f0 con 0x7f9674101de0 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f9678bea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f9678bea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35900/0 (socket says 172.21.15.1:35900) 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f9678bea640 1 -- 172.21.15.1:0/1496383283 learned_addr learned my addr 172.21.15.1:0/1496383283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f9673fff640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 0x7f96740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.818+0000 7f96737fe640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f9674074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 -- 172.21.15.1:0/1496383283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 msgr2=0x7f96740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 0x7f96740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 -- 172.21.15.1:0/1496383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 msgr2=0x7f9674074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f9674074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 -- 172.21.15.1:0/1496383283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96741a68f0 con 0x7f9674106f10 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9673fff640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 0x7f96740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f96737fe640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f9674074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f9678bea640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f966c00eb10 tx=0x7f966c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f96717fa640 1 -- 172.21.15.1:0/1496383283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c004b20 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f96717fa640 1 -- 172.21.15.1:0/1496383283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966c004cc0 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96741a6be0 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f96717fa640 1 -- 172.21.15.1:0/1496383283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c010760 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.819+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96741a7120 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.822+0000 7f967ca26740 1 Processor -- start 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.822+0000 7f96717fa640 1 -- 172.21.15.1:0/1496383283 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f966c005020 con 0x7f9674106f10 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.822+0000 7f967ca26740 1 -- start start 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.822+0000 7f967ca26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfd6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f967ca26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cfe1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f967ca26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f967ca26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a8cf3c2a0 con 0x557a8cfe1940 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f967ca26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557a8cee3b10 con 0x557a8cfd6760 2024-09-19T05:44:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f967ca26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557a8cf38260 con 0x557a8cfd7080 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35916/0 (socket says 172.21.15.1:35916) 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 -- 172.21.15.1:0/901108259 learned_addr learned my addr 172.21.15.1:0/901108259 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f9673fff640 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cfe1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfd6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 -- 172.21.15.1:0/901108259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 msgr2=0x557a8cfe1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cfe1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 -- 172.21.15.1:0/901108259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 msgr2=0x557a8cfd6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfd6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 -- 172.21.15.1:0/901108259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a8ccadb90 con 0x557a8cfe1940 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96717fa640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 0x7f965c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96737fe640 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9668014a30 tx=0x7f966800c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4c5cd8ff9739aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f9673fff640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 0x7f965c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f96717fa640 1 -- 172.21.15.1:0/1496383283 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f966c0d0460 con 0x7f9674106f10 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f965a7fc640 1 -- 172.21.15.1:0/901108259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680142d0 con 0x557a8cfe1940 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.823+0000 7f965a7fc640 1 -- 172.21.15.1:0/901108259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966800f820 con 0x557a8cfe1940 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f965a7fc640 1 -- 172.21.15.1:0/901108259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668003850 con 0x557a8cfe1940 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 -- 172.21.15.1:0/901108259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 msgr2=0x557a8cfe3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f9673fff640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 0x7f965c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x557a8cfd3b50 tx=0x7f9664005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9668014a30 tx=0x7f966800c570 comp rx=0 tx=0).stop 2024-09-19T05:44:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 -- 172.21.15.1:0/901108259 shutdown_connections 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cfe3d30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cfe1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 --2- 172.21.15.1:0/901108259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfd6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 -- 172.21.15.1:0/901108259 >> 172.21.15.1:0/901108259 conn(0x557a8cfd2cf0 msgr2=0x557a8cfd30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 -- 172.21.15.1:0/901108259 shutdown_connections 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.824+0000 7f967ca26740 1 -- 172.21.15.1:0/901108259 wait complete. 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 -- start start 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 Processor -- start 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd7080 0x557a8cfdedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfe1940 0x557a8cfdf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557a8cfe4510 con 0x557a8cfd6760 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557a8cec46e0 con 0x557a8cfd7080 2024-09-19T05:44:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557a8cfe4690 con 0x557a8cfe1940 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f967ca26740 10 client.0 _ll_register_callbacks cb 0x557a8cee8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f9673fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f9673fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35928/0 (socket says 172.21.15.1:35928) 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f9673fff640 1 -- 172.21.15.1:0/3379822622 learned_addr learned my addr 172.21.15.1:0/3379822622 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f96737fe640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd7080 0x557a8cfdedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.825+0000 7f9678bea640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfe1940 0x557a8cfdf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 -- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfe1940 msgr2=0x557a8cfdf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfe1940 0x557a8cfdf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 -- 172.21.15.1:0/3379822622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd7080 msgr2=0x557a8cfdedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd7080 0x557a8cfdedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 -- 172.21.15.1:0/3379822622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a8cfedab0 con 0x557a8cfd6760 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f9673fff640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9664033000 tx=0x7f9664009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec81c2cec46f313 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f96537fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:44:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966404c070 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9664005460 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f966800f820 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9664058050 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f967ca26740 10 client.16119 fetch_fsmap learned FSMap version 21 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a8cff0420 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.826+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966800f820 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9664003710 con 0x557a8cfd6760 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 10 client.16119 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 10 client.16119 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 20 client.16119 populate_metadata read hostname 'smithi001' 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8cff3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 4 client.16119 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.827+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a8cf499d0 con 0x557a8cff18f0 2024-09-19T05:44:31.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.864+0000 7f96737fe640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8cff3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.865+0000 7f96737fe640 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8cff3d90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4295e986f5d6e0ec server_cookie=77cef0fb0723dcb1 in_seq=0 out_seq=0 2024-09-19T05:44:31.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.865+0000 7f96537fe640 10 client.16119 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.867+0000 7f96537fe640 1 -- 172.21.15.1:0/3379822622 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a8cf499d0 con 0x557a8cff18f0 2024-09-19T05:44:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.867+0000 7f96537fe640 10 client.16119 handle_command_reply: tid=0 2024-09-19T05:44:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.867+0000 7f967ca26740 1 client.16119 shutdown 2024-09-19T05:44:31.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 msgr2=0x557a8cfde890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9664033000 tx=0x7f9664009260 comp rx=0 tx=0).stop 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 shutdown_connections 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8cff3d90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f96537fe640 0 client.16119 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfe1940 0x557a8cfdf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd7080 0x557a8cfdedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 --2- 172.21.15.1:0/3379822622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd6760 0x557a8cfde890 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 >> 172.21.15.1:0/3379822622 conn(0x557a8cfd2cf0 msgr2=0x557a8cfd89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 shutdown_connections 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 1 -- 172.21.15.1:0/3379822622 wait complete. 2024-09-19T05:44:31.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.868+0000 7f967ca26740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.892+0000 7f967ca26740 1 Processor -- start 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.892+0000 7f967ca26740 1 -- start start 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cff9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cff9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f96741af000 con 0x557a8cfe1940 2024-09-19T05:44:31.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b1880 con 0x557a8cfd6760 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f967ca26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96741af670 con 0x557a8cfd7080 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f96737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cff9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:54180/0 (socket says 172.21.15.1:54180) 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 -- 172.21.15.1:0/458550938 learned_addr learned my addr 172.21.15.1:0/458550938 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9678bea640 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cff9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 -- 172.21.15.1:0/458550938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 msgr2=0x557a8cff9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cff9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 -- 172.21.15.1:0/458550938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 msgr2=0x557a8cff9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cff9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f9673fff640 1 -- 172.21.15.1:0/458550938 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a8cfce260 con 0x557a8cfd6760 2024-09-19T05:44:31.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.893+0000 7f96737fe640 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cff9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.894+0000 7f9673fff640 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9664003c50 tx=0x7f9664009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bab47d02543d866 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.894+0000 7f9659ffb640 1 -- 172.21.15.1:0/458550938 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664060070 con 0x557a8cfd6760 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.894+0000 7f9659ffb640 1 -- 172.21.15.1:0/458550938 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9664003cd0 con 0x557a8cfd6760 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.894+0000 7f9659ffb640 1 -- 172.21.15.1:0/458550938 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966404c050 con 0x557a8cfd6760 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- 172.21.15.1:0/458550938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 msgr2=0x557a8cfdd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9664003c50 tx=0x7f9664009520 comp rx=0 tx=0).stop 2024-09-19T05:44:31.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- 172.21.15.1:0/458550938 shutdown_connections 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfe1940 0x557a8cff9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd7080 0x557a8cff9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 --2- 172.21.15.1:0/458550938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfd6760 0x557a8cfdd740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- 172.21.15.1:0/458550938 >> 172.21.15.1:0/458550938 conn(0x557a8cfd2cf0 msgr2=0x557a8cfdd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- 172.21.15.1:0/458550938 shutdown_connections 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- 172.21.15.1:0/458550938 wait complete. 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.895+0000 7f967ca26740 1 -- start start 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 Processor -- start 2024-09-19T05:44:31.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd6760 0x557a8cfe9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 0x557a8cfe6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f96741afd40 con 0x557a8cfd7080 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b11b0 con 0x557a8cfe1940 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b0410 con 0x557a8cfd6760 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f967ca26740 10 client.0 _ll_register_callbacks cb 0x7f9664031a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f96737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f96737fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35952/0 (socket says 172.21.15.1:35952) 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f96737fe640 1 -- 172.21.15.1:0/3209885439 learned_addr learned my addr 172.21.15.1:0/3209885439 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:31.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f9678bea640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 0x557a8cfe6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.896+0000 7f9673fff640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd6760 0x557a8cfe9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 -- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd6760 msgr2=0x557a8cfe9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd6760 0x557a8cfe9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 -- 172.21.15.1:0/3209885439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 msgr2=0x557a8cfe6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 0x557a8cfe6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 -- 172.21.15.1:0/3209885439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a8cfe7310 con 0x557a8cfd7080 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f9678bea640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 0x557a8cfe6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96737fe640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9668014a00 tx=0x7f966800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c80e8dff46fb8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96537fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668014230 con 0x557a8cfd7080 2024-09-19T05:44:31.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9668004030 con 0x557a8cfd7080 2024-09-19T05:44:31.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9664003cd0 con 0x557a8cfd7080 2024-09-19T05:44:31.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.898+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f966803a050 con 0x557a8cfd7080 2024-09-19T05:44:31.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.899+0000 7f967ca26740 10 client.16125 fetch_fsmap learned FSMap version 21 2024-09-19T05:44:31.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.899+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a8d05d2f0 con 0x557a8cfd7080 2024-09-19T05:44:31.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9664003cd0 con 0x557a8cfd7080 2024-09-19T05:44:31.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9668003790 con 0x557a8cfd7080 2024-09-19T05:44:31.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 10 client.16125 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:44:31.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 10 client.16125 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:44:31.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 20 client.16125 populate_metadata read hostname 'smithi001' 2024-09-19T05:44:31.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8d05fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:31.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 4 client.16125 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.1, "await_for": 45.0}] 2024-09-19T05:44:31.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.902+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.1, "await_for": 45.0}) -- 0x557a8cf43d20 con 0x557a8cff18f0 2024-09-19T05:44:31.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.915+0000 7f9673fff640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8d05fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:31.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.921+0000 7f9673fff640 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8d05fa60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=552ecff493f39826 server_cookie=8123945a8936885 in_seq=0 out_seq=0 2024-09-19T05:44:31.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:31.921+0000 7f96537fe640 10 client.16125 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:32.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:32 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:44:32.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184914 17.05 MB/sec execute 467 sec latency 775.595 ms 2024-09-19T05:44:32.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:32 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:44:32.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:32 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:44:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:33 smithi001 ceph-mon[30968]: pgmap v1052: 129 pgs: 129 active+clean; 459 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2024-09-19T05:44:33.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:44:33.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:44:33.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:44:33.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 17.01 MB/sec execute 468 sec latency 1738.514 ms 2024-09-19T05:44:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:33 smithi060 ceph-mon[35058]: pgmap v1052: 129 pgs: 129 active+clean; 459 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2024-09-19T05:44:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:44:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:44:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:44:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:33 smithi082 ceph-mon[35195]: pgmap v1052: 129 pgs: 129 active+clean; 459 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.4 MiB/s wr, 288 op/s 2024-09-19T05:44:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:44:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:44:33.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:44:33.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f96537fe640 1 -- 172.21.15.1:0/3209885439 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557a8cf43d20 con 0x557a8cff18f0 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f96537fe640 10 client.16125 handle_command_reply: tid=0 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 client.16125 shutdown 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 msgr2=0x557a8cfea1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9668014a00 tx=0x7f966800ceb0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 shutdown_connections 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a8cfe1940 0x557a8cfe6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557a8cfd7080 0x557a8cfea1e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x557a8cff18f0 0x557a8d05fa60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 --2- 172.21.15.1:0/3209885439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557a8cfd6760 0x557a8cfe9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f96537fe640 0 client.16125 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 >> 172.21.15.1:0/3209885439 conn(0x557a8cfd2cf0 msgr2=0x557a8cfd1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 shutdown_connections 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.897+0000 7f967ca26740 1 -- 172.21.15.1:0/3209885439 wait complete. 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967ca26740 20 client.16125 trim_cache size 0 max 16384 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 78, 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "e5ffb63d": { 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 78, 2024-09-19T05:44:33.901 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 133.1, 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:33.902 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 msgr2=0x7f965c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 0x7f965c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x557a8cfd3b50 tx=0x7f9664005b50 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 msgr2=0x7f9674074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f966c00eb10 tx=0x7f966c00c2d0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 shutdown_connections 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f965c0a3240 0x7f965c0a5700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9674106f10 0x7f9674074f70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9674102790 0x7f9674074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 --2- 172.21.15.1:0/1496383283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9674101de0 0x7f96740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 >> 172.21.15.1:0/1496383283 conn(0x7f96740fd8c0 msgr2=0x7f96740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 shutdown_connections 2024-09-19T05:44:33.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:33.898+0000 7f967a64d640 1 -- 172.21.15.1:0/1496383283 wait complete. 2024-09-19T05:44:34.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.98 MB/sec execute 469 sec latency 2738.571 ms 2024-09-19T05:44:34.924 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e5ffb63d', quiesce took 6.3 seconds. Will release after: 6.8 2024-09-19T05:44:35.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:35 smithi001 ceph-mon[30968]: pgmap v1053: 129 pgs: 129 active+clean; 464 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 341 op/s 2024-09-19T05:44:35.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.94 MB/sec execute 470 sec latency 3739.053 ms 2024-09-19T05:44:35.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:35 smithi060 ceph-mon[35058]: pgmap v1053: 129 pgs: 129 active+clean; 464 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 341 op/s 2024-09-19T05:44:35.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:35 smithi082 ceph-mon[35195]: pgmap v1053: 129 pgs: 129 active+clean; 464 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.5 MiB/s wr, 341 op/s 2024-09-19T05:44:36.661 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.91 MB/sec execute 471 sec latency 4739.159 ms 2024-09-19T05:44:37.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.87 MB/sec execute 472 sec latency 5739.229 ms 2024-09-19T05:44:37.684 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:37 smithi001 ceph-mon[30968]: pgmap v1054: 129 pgs: 129 active+clean; 463 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 326 op/s 2024-09-19T05:44:37.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:37 smithi060 ceph-mon[35058]: pgmap v1054: 129 pgs: 129 active+clean; 463 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 326 op/s 2024-09-19T05:44:37.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:37 smithi082 ceph-mon[35195]: pgmap v1054: 129 pgs: 129 active+clean; 463 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 326 op/s 2024-09-19T05:44:38.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.83 MB/sec execute 473 sec latency 6739.279 ms 2024-09-19T05:44:39.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.80 MB/sec execute 474 sec latency 7739.338 ms 2024-09-19T05:44:39.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:39 smithi060 ceph-mon[35058]: pgmap v1055: 129 pgs: 129 active+clean; 461 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 309 op/s 2024-09-19T05:44:39.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:39 smithi082 ceph-mon[35195]: pgmap v1055: 129 pgs: 129 active+clean; 461 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 309 op/s 2024-09-19T05:44:39.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:39 smithi001 ceph-mon[30968]: pgmap v1055: 129 pgs: 129 active+clean; 461 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.1 MiB/s wr, 309 op/s 2024-09-19T05:44:40.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.76 MB/sec execute 475 sec latency 8739.449 ms 2024-09-19T05:44:41.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.73 MB/sec execute 476 sec latency 9739.596 ms 2024-09-19T05:44:41.726 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:44:41.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:41 smithi060 ceph-mon[35058]: pgmap v1056: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 255 op/s 2024-09-19T05:44:41.757 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:41 smithi001 ceph-mon[30968]: pgmap v1056: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 255 op/s 2024-09-19T05:44:41.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:41 smithi082 ceph-mon[35195]: pgmap v1056: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 255 op/s 2024-09-19T05:44:42.000 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:44:42.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 -- 172.21.15.1:0/2284682554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 msgr2=0x7f69c8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 --2- 172.21.15.1:0/2284682554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c8103110 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009cd0 tx=0x7f69b802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 -- 172.21.15.1:0/2284682554 shutdown_connections 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 --2- 172.21.15.1:0/2284682554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81082a0 0x7f69c810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 --2- 172.21.15.1:0/2284682554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81036e0 0x7f69c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 --2- 172.21.15.1:0/2284682554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c8103110 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 -- 172.21.15.1:0/2284682554 >> 172.21.15.1:0/2284682554 conn(0x7f69c80fc7d0 msgr2=0x7f69c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 -- 172.21.15.1:0/2284682554 shutdown_connections 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 -- 172.21.15.1:0/2284682554 wait complete. 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.484+0000 7f69cdb05640 1 Processor -- start 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 -- start start 2024-09-19T05:44:42.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81036e0 0x7f69c8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81082a0 0x7f69c819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81120a0 con 0x7f69c8102d30 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8111f20 con 0x7f69c81036e0 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69cdb05640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8112220 con 0x7f69c81082a0 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38768/0 (socket says 172.21.15.1:38768) 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 -- 172.21.15.1:0/132554360 learned_addr learned my addr 172.21.15.1:0/132554360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c7fff640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81082a0 0x7f69c819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c6ffd640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81036e0 0x7f69c8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 -- 172.21.15.1:0/132554360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81082a0 msgr2=0x7f69c819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81082a0 0x7f69c819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 -- 172.21.15.1:0/132554360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81036e0 msgr2=0x7f69c8198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81036e0 0x7f69c8198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 -- 172.21.15.1:0/132554360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c819d590 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.485+0000 7f69c77fe640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f69b802ae00 tx=0x7f69b8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.486+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8004040 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.486+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b80046c0 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.486+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c819d820 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.486+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8046480 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.486+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a5160 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.487+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c8103110 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.488+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f69b80305a0 con 0x7f69c8102d30 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.489+0000 7f69c4ff9640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:42.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.489+0000 7f69c6ffd640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.489+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f69b802e030 con 0x7f69c8102d30 2024-09-19T05:44:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.489+0000 7f69c6ffd640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 0x7f69b00a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005fd0 tx=0x7f69bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:42.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.492+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69b804b060 con 0x7f69c8102d30 2024-09-19T05:44:42.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.69 MB/sec execute 477 sec latency 10739.649 ms 2024-09-19T05:44:42.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.707+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69c810a2b0 con 0x7f69c8102d30 2024-09-19T05:44:42.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.708+0000 7f69c4ff9640 1 -- 172.21.15.1:0/132554360 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f69b8030890 con 0x7f69c8102d30 2024-09-19T05:44:42.710 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:44:42.710 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:44:42.710 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 msgr2=0x7f69b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 0x7f69b00a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005fd0 tx=0x7f69bc005850 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 msgr2=0x7f69c81985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f69b802ae00 tx=0x7f69b8003970 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 shutdown_connections 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69c81082a0 0x7f69c819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c81036e0 0x7f69c8198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 --2- 172.21.15.1:0/132554360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69c8102d30 0x7f69c81985e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:42.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 >> 172.21.15.1:0/132554360 conn(0x7f69c80fc7d0 msgr2=0x7f69c8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 shutdown_connections 2024-09-19T05:44:42.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:42.711+0000 7f69cdb05640 1 -- 172.21.15.1:0/132554360 wait complete. 2024-09-19T05:44:43.369 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id e5ffb63d --release --await' 2024-09-19T05:44:43.369 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id e5ffb63d --release --await 2024-09-19T05:44:43.433 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:43 smithi001 ceph-mon[30968]: pgmap v1057: 129 pgs: 129 active+clean; 459 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 246 op/s 2024-09-19T05:44:43.433 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:43 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/132554360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:43.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 184916 16.66 MB/sec execute 478 sec latency 11739.683 ms 2024-09-19T05:44:43.665 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:44:43.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:43 smithi060 ceph-mon[35058]: pgmap v1057: 129 pgs: 129 active+clean; 459 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 246 op/s 2024-09-19T05:44:43.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:43 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/132554360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:43.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:43 smithi082 ceph-mon[35195]: pgmap v1057: 129 pgs: 129 active+clean; 459 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 246 op/s 2024-09-19T05:44:43.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:43 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/132554360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:44:44.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 -- 172.21.15.1:0/641662182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208102d40 msgr2=0x7fa208103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/641662182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208102d40 0x7fa208103120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009900 tx=0x7fa1f802a480 comp rx=0 tx=0).stop 2024-09-19T05:44:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 -- 172.21.15.1:0/641662182 shutdown_connections 2024-09-19T05:44:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/641662182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa20810c170 0x7fa20810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/641662182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa208103660 0x7fa20810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/641662182 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208102d40 0x7fa208103120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 -- 172.21.15.1:0/641662182 >> 172.21.15.1:0/641662182 conn(0x7fa2080fc7a0 msgr2=0x7fa2080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 -- 172.21.15.1:0/641662182 shutdown_connections 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.203+0000 7fa20ea2d640 1 -- 172.21.15.1:0/641662182 wait complete. 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 Processor -- start 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 -- start start 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208102d40 0x7fa2081983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20810c170 0x7fa20819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa208111f70 con 0x7fa208103660 2024-09-19T05:44:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa208111df0 con 0x7fa208102d40 2024-09-19T05:44:44.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20ea2d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081120f0 con 0x7fa20810c170 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48736/0 (socket says 172.21.15.1:48736) 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa2077fe640 1 -- 172.21.15.1:0/2127018261 learned_addr learned my addr 172.21.15.1:0/2127018261 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa207fff640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208102d40 0x7fa2081983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.204+0000 7fa20cfca640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20810c170 0x7fa20819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 -- 172.21.15.1:0/2127018261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20810c170 msgr2=0x7fa20819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20810c170 0x7fa20819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 -- 172.21.15.1:0/2127018261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208102d40 msgr2=0x7fa2081983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208102d40 0x7fa2081983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 -- 172.21.15.1:0/2127018261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20819d380 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c970 tx=0x7fa1fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2057fa640 1 -- 172.21.15.1:0/2127018261 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc007bb0 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20819d670 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2057fa640 1 -- 172.21.15.1:0/2127018261 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1fc007d50 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa2057fa640 1 -- 172.21.15.1:0/2127018261 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc018820 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.205+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2081a4f50 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.207+0000 7fa2057fa640 1 -- 172.21.15.1:0/2127018261 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa1fc0189c0 con 0x7fa208103660 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 Processor -- start 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 -- start start 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6e162f620 con 0x55d6e16ca980 2024-09-19T05:44:44.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6e15d6e50 con 0x55d6e16ca060 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa210e06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6e162b5e0 con 0x55d6e16d5240 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48746/0 (socket says 172.21.15.1:48746) 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa207fff640 1 -- 172.21.15.1:0/593082291 learned_addr learned my addr 172.21.15.1:0/593082291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa2077fe640 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa20cfca640 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.208+0000 7fa2057fa640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 0x7fa1f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 -- 172.21.15.1:0/593082291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 msgr2=0x55d6e16d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 -- 172.21.15.1:0/593082291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 msgr2=0x55d6e16ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 -- 172.21.15.1:0/593082291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e15c7d40 con 0x55d6e16ca980 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa20cfca640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 0x7fa1f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa2057fa640 1 -- 172.21.15.1:0/2127018261 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa1fc0cfd80 con 0x7fa208103660 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa207fff640 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009900 tx=0x7fa1f8031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749c58e5b6b12458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa1ee7fc640 1 -- 172.21.15.1:0/593082291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8040070 con 0x55d6e16ca980 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa20cfca640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 0x7fa1f00a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa200005fd0 tx=0x7fa200004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa1ee7fc640 1 -- 172.21.15.1:0/593082291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f8005020 con 0x55d6e16ca980 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.209+0000 7fa1ee7fc640 1 -- 172.21.15.1:0/593082291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8035040 con 0x55d6e16ca980 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- 172.21.15.1:0/593082291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 msgr2=0x55d6e16d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009900 tx=0x7fa1f8031630 comp rx=0 tx=0).stop 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- 172.21.15.1:0/593082291 shutdown_connections 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca980 0x55d6e16d4d00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 --2- 172.21.15.1:0/593082291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- 172.21.15.1:0/593082291 >> 172.21.15.1:0/593082291 conn(0x55d6e16c65f0 msgr2=0x55d6e16c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- 172.21.15.1:0/593082291 shutdown_connections 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- 172.21.15.1:0/593082291 wait complete. 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.210+0000 7fa210e06740 1 -- start start 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 Processor -- start 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca980 0x55d6e16d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6e16d7e10 con 0x55d6e16ca060 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d6e15b7f10 con 0x55d6e16ca980 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6e16d7f90 con 0x55d6e16d5240 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa210e06740 10 client.0 _ll_register_callbacks cb 0x55d6e15dbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:44.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48748/0 (socket says 172.21.15.1:48748) 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 -- 172.21.15.1:0/2293540049 learned_addr learned my addr 172.21.15.1:0/2293540049 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca980 0x55d6e16d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa20cfca640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 -- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 msgr2=0x55d6e16d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 -- 172.21.15.1:0/2293540049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca980 msgr2=0x55d6e16d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca980 0x55d6e16d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.211+0000 7fa207fff640 1 -- 172.21.15.1:0/2293540049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e133e580 con 0x55d6e16ca060 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa207fff640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80096c0 tx=0x7fa1f8005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646497b9feb9b8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f804b070 con 0x55d6e16ca060 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa1f8004b60 con 0x55d6e16ca060 2024-09-19T05:44:44.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f8005020 con 0x55d6e16ca060 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1f8057050 con 0x55d6e16ca060 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 10 client.16143 fetch_fsmap learned FSMap version 21 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d6e1408960 con 0x55d6e16ca060 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f8005020 con 0x55d6e16ca060 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1f8044400 con 0x55d6e16ca060 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 10 client.16143 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 10 client.16143 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.212+0000 7fa210e06740 20 client.16143 populate_metadata read hostname 'smithi001' 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e16e4c20 0x55d6e16e7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa210e06740 4 client.16143 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e163cb90 con 0x55d6e16e4c20 2024-09-19T05:44:44.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e16e4c20 0x55d6e16e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa1e77fe640 10 client.16143 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.213+0000 7fa2077fe640 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e16e4c20 0x55d6e16e7010 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=186f9b51acbe366c server_cookie=32e4f083dd41c9a9 in_seq=0 out_seq=0 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa1e77fe640 1 -- 172.21.15.1:0/2293540049 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6e163cb90 con 0x55d6e16e4c20 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa1e77fe640 10 client.16143 handle_command_reply: tid=0 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 client.16143 shutdown 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 msgr2=0x55d6e16d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80096c0 tx=0x7fa1f8005480 comp rx=0 tx=0).stop 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 shutdown_connections 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e16e4c20 0x55d6e16e7010 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16d5240 0x55d6e16d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca980 0x55d6e16d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 --2- 172.21.15.1:0/2293540049 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16d2110 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa1e77fe640 0 client.16143 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 >> 172.21.15.1:0/2293540049 conn(0x55d6e16c65f0 msgr2=0x55d6e16cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 shutdown_connections 2024-09-19T05:44:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 1 -- 172.21.15.1:0/2293540049 wait complete. 2024-09-19T05:44:44.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.214+0000 7fa210e06740 20 client.16143 trim_cache size 0 max 16384 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 Processor -- start 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 -- start start 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 0x55d6e16ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081accf0 con 0x55d6e16ca060 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081af570 con 0x55d6e16d5240 2024-09-19T05:44:44.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa210e06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081ad360 con 0x55d6e16ca980 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa20cfca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 0x55d6e16ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa207fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48762/0 (socket says 172.21.15.1:48762) 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.231+0000 7fa207fff640 1 -- 172.21.15.1:0/3060252964 learned_addr learned my addr 172.21.15.1:0/3060252964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa2077fe640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 -- 172.21.15.1:0/3060252964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 msgr2=0x55d6e16ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 -- 172.21.15.1:0/3060252964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 msgr2=0x55d6e16c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 -- 172.21.15.1:0/3060252964 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e16d7f20 con 0x55d6e16d5240 2024-09-19T05:44:44.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa2077fe640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:44:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa207fff640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa20cfca640 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 0x55d6e16ecaf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2000142e0 tx=0x7fa2000097c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9d20a54d219659 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa1edffb640 1 -- 172.21.15.1:0/3060252964 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20001a040 con 0x55d6e16d5240 2024-09-19T05:44:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa1edffb640 1 -- 172.21.15.1:0/3060252964 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2000143d0 con 0x55d6e16d5240 2024-09-19T05:44:44.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.232+0000 7fa1edffb640 1 -- 172.21.15.1:0/3060252964 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200023cf0 con 0x55d6e16d5240 2024-09-19T05:44:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- 172.21.15.1:0/3060252964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 msgr2=0x55d6e16ecaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 0x55d6e16ecaf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2000142e0 tx=0x7fa2000097c0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- 172.21.15.1:0/3060252964 shutdown_connections 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16d5240 0x55d6e16ecaf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 --2- 172.21.15.1:0/3060252964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16ca060 0x55d6e16c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- 172.21.15.1:0/3060252964 >> 172.21.15.1:0/3060252964 conn(0x55d6e16c65f0 msgr2=0x55d6e16c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- 172.21.15.1:0/3060252964 shutdown_connections 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- 172.21.15.1:0/3060252964 wait complete. 2024-09-19T05:44:44.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 -- start start 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.233+0000 7fa210e06740 1 Processor -- start 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16d5240 0x55d6e16da1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081ada30 con 0x55d6e16d5240 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081aeea0 con 0x55d6e16ca060 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2081ae100 con 0x55d6e16ca980 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa210e06740 10 client.0 _ll_register_callbacks cb 0x7fa1f8009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa20cfca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16d5240 0x55d6e16da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:50250/0 (socket says 172.21.15.1:50250) 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 -- 172.21.15.1:0/607847204 learned_addr learned my addr 172.21.15.1:0/607847204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 -- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 msgr2=0x55d6e16dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16dd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 -- 172.21.15.1:0/607847204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16d5240 msgr2=0x55d6e16da1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16d5240 0x55d6e16da1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 -- 172.21.15.1:0/607847204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e16da850 con 0x55d6e16ca060 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa2077fe640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa207fff640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80096c0 tx=0x7fa1f8031b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfabb1ad03909a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa1e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f804b040 con 0x55d6e16ca060 2024-09-19T05:44:44.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.234+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fa1f8044a40 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6e16370a0 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1f8035030 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 10 client.25712 fetch_fsmap learned FSMap version 21 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d6e174ffb0 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d6e16370a0 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1f803c440 con 0x55d6e16ca060 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 10 client.25712 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 10 client.25712 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 20 client.25712 populate_metadata read hostname 'smithi001' 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e1750590 0x55d6e1752980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 4 client.25712 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e5ffb63d", "release": true, "await": true}] 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e5ffb63d", "release": true, "await": true}) -- 0x55d6e15b35a0 con 0x55d6e1750590 2024-09-19T05:44:44.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.235+0000 7fa2077fe640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e1750590 0x55d6e1752980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:44:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.236+0000 7fa2077fe640 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e1750590 0x55d6e1752980 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90be52693b31ed5d server_cookie=eb30f9238ba8f225 in_seq=0 out_seq=0 2024-09-19T05:44:44.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.236+0000 7fa1e77fe640 10 client.25712 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa1e77fe640 1 -- 172.21.15.1:0/607847204 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d6e15b35a0 con 0x55d6e1750590 2024-09-19T05:44:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa1e77fe640 10 client.25712 handle_command_reply: tid=0 2024-09-19T05:44:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 client.25712 shutdown 2024-09-19T05:44:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 msgr2=0x55d6e16dd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80096c0 tx=0x7fa1f8031b80 comp rx=0 tx=0).stop 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 shutdown_connections 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d6e16d5240 0x55d6e16da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d6e1750590 0x55d6e1752980 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6e16ca980 0x55d6e16dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 --2- 172.21.15.1:0/607847204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d6e16ca060 0x55d6e16dd3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.295+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 >> 172.21.15.1:0/607847204 conn(0x55d6e16c65f0 msgr2=0x55d6e16c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.296+0000 7fa1e77fe640 0 client.25712 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.296+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 shutdown_connections 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.296+0000 7fa210e06740 1 -- 172.21.15.1:0/607847204 wait complete. 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.296+0000 7fa210e06740 20 client.25712 trim_cache size 0 max 16384 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:44:44.299 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 80, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "e5ffb63d": { 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 80, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 133.1, 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:44:44.300 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:44:44.301 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.297+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 msgr2=0x7fa1f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.297+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 0x7fa1f00a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa200005fd0 tx=0x7fa200004ab0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.297+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 msgr2=0x7fa208198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.297+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c970 tx=0x7fa1fc00ce30 comp rx=0 tx=0).stop 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 shutdown_connections 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fa1f00a3240 0x7fa1f00a5700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa20810c170 0x7fa20819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa208103660 0x7fa208198910 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 --2- 172.21.15.1:0/2127018261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208102d40 0x7fa2081983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:44:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 >> 172.21.15.1:0/2127018261 conn(0x7fa2080fc7a0 msgr2=0x7fa2080fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:44:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 shutdown_connections 2024-09-19T05:44:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:44:44.298+0000 7fa20ea2d640 1 -- 172.21.15.1:0/2127018261 wait complete. 2024-09-19T05:44:44.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 185083 16.63 MB/sec execute 479 sec latency 12333.053 ms 2024-09-19T05:44:45.083 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e5ffb63d', total seconds elapsed: 16.5 2024-09-19T05:44:45.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 185568 16.65 MB/sec execute 480 sec latency 44.822 ms 2024-09-19T05:44:45.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:45 smithi060 ceph-mon[35058]: pgmap v1058: 129 pgs: 129 active+clean; 458 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-19T05:44:45.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:45 smithi082 ceph-mon[35195]: pgmap v1058: 129 pgs: 129 active+clean; 458 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-19T05:44:45.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:45 smithi001 ceph-mon[30968]: pgmap v1058: 129 pgs: 129 active+clean; 458 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-19T05:44:46.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 186111 16.67 MB/sec execute 481 sec latency 66.724 ms 2024-09-19T05:44:47.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 186643 16.71 MB/sec execute 482 sec latency 57.455 ms 2024-09-19T05:44:47.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:47 smithi060 ceph-mon[35058]: pgmap v1059: 129 pgs: 129 active+clean; 457 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-19T05:44:47.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:47 smithi082 ceph-mon[35195]: pgmap v1059: 129 pgs: 129 active+clean; 457 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-19T05:44:47.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:47 smithi001 ceph-mon[30968]: pgmap v1059: 129 pgs: 129 active+clean; 457 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-19T05:44:48.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 186945 16.71 MB/sec execute 483 sec latency 305.525 ms 2024-09-19T05:44:49.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 187251 16.71 MB/sec execute 484 sec latency 81.073 ms 2024-09-19T05:44:49.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:49 smithi060 ceph-mon[35058]: pgmap v1060: 129 pgs: 129 active+clean; 456 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-09-19T05:44:49.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:49 smithi082 ceph-mon[35195]: pgmap v1060: 129 pgs: 129 active+clean; 456 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-09-19T05:44:49.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:49 smithi001 ceph-mon[30968]: pgmap v1060: 129 pgs: 129 active+clean; 456 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 172 op/s 2024-09-19T05:44:50.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 187683 16.74 MB/sec execute 485 sec latency 58.240 ms 2024-09-19T05:44:51.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 188036 16.73 MB/sec execute 486 sec latency 109.262 ms 2024-09-19T05:44:51.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:51 smithi060 ceph-mon[35058]: pgmap v1061: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 230 op/s 2024-09-19T05:44:51.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:51 smithi082 ceph-mon[35195]: pgmap v1061: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 230 op/s 2024-09-19T05:44:51.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:51 smithi001 ceph-mon[30968]: pgmap v1061: 129 pgs: 129 active+clean; 460 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.1 MiB/s wr, 230 op/s 2024-09-19T05:44:52.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 188402 16.74 MB/sec execute 487 sec latency 71.203 ms 2024-09-19T05:44:53.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 188661 16.72 MB/sec execute 488 sec latency 183.924 ms 2024-09-19T05:44:53.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:53 smithi060 ceph-mon[35058]: pgmap v1062: 129 pgs: 129 active+clean; 453 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.0 MiB/s wr, 275 op/s 2024-09-19T05:44:53.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:53 smithi082 ceph-mon[35195]: pgmap v1062: 129 pgs: 129 active+clean; 453 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.0 MiB/s wr, 275 op/s 2024-09-19T05:44:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:53 smithi001 ceph-mon[30968]: pgmap v1062: 129 pgs: 129 active+clean; 453 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.0 MiB/s wr, 275 op/s 2024-09-19T05:44:54.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 189062 16.72 MB/sec execute 489 sec latency 110.167 ms 2024-09-19T05:44:55.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 189667 16.75 MB/sec execute 490 sec latency 64.430 ms 2024-09-19T05:44:55.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:55 smithi060 ceph-mon[35058]: pgmap v1063: 129 pgs: 129 active+clean; 439 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 292 op/s 2024-09-19T05:44:55.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:55 smithi082 ceph-mon[35195]: pgmap v1063: 129 pgs: 129 active+clean; 439 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 292 op/s 2024-09-19T05:44:55.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:55 smithi001 ceph-mon[30968]: pgmap v1063: 129 pgs: 129 active+clean; 439 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 5.3 MiB/s wr, 292 op/s 2024-09-19T05:44:56.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 190349 16.81 MB/sec execute 491 sec latency 34.041 ms 2024-09-19T05:44:57.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 190824 16.84 MB/sec execute 492 sec latency 62.277 ms 2024-09-19T05:44:57.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:57 smithi060 ceph-mon[35058]: pgmap v1064: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 6.6 MiB/s wr, 381 op/s 2024-09-19T05:44:57.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:57 smithi082 ceph-mon[35195]: pgmap v1064: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 6.6 MiB/s wr, 381 op/s 2024-09-19T05:44:57.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:57 smithi001 ceph-mon[30968]: pgmap v1064: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 6.6 MiB/s wr, 381 op/s 2024-09-19T05:44:58.662 INFO:tasks.workunit.client.0.smithi001.stdout: 10 191131 16.85 MB/sec execute 493 sec latency 294.633 ms 2024-09-19T05:44:59.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 191331 16.83 MB/sec execute 494 sec latency 304.320 ms 2024-09-19T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:44:59 smithi060 ceph-mon[35058]: pgmap v1065: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 6.2 MiB/s wr, 378 op/s 2024-09-19T05:44:59.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:44:59 smithi082 ceph-mon[35195]: pgmap v1065: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 6.2 MiB/s wr, 378 op/s 2024-09-19T05:44:59.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:44:59 smithi001 ceph-mon[30968]: pgmap v1065: 129 pgs: 129 active+clean; 447 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 6.2 MiB/s wr, 378 op/s 2024-09-19T05:45:00.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 191675 16.82 MB/sec execute 495 sec latency 69.348 ms 2024-09-19T05:45:01.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 192073 16.82 MB/sec execute 496 sec latency 70.993 ms 2024-09-19T05:45:01.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:01 smithi060 ceph-mon[35058]: pgmap v1066: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-19T05:45:01.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:01 smithi082 ceph-mon[35195]: pgmap v1066: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-19T05:45:01.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:01 smithi001 ceph-mon[30968]: pgmap v1066: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-19T05:45:02.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 192570 16.83 MB/sec execute 497 sec latency 91.622 ms 2024-09-19T05:45:03.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 193061 16.86 MB/sec execute 498 sec latency 146.586 ms 2024-09-19T05:45:03.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:03 smithi060 ceph-mon[35058]: pgmap v1067: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 347 op/s 2024-09-19T05:45:03.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:03 smithi082 ceph-mon[35195]: pgmap v1067: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 347 op/s 2024-09-19T05:45:03.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:03 smithi001 ceph-mon[30968]: pgmap v1067: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 347 op/s 2024-09-19T05:45:04.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 193556 16.88 MB/sec execute 499 sec latency 71.481 ms 2024-09-19T05:45:05.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 194048 16.90 MB/sec execute 500 sec latency 50.130 ms 2024-09-19T05:45:05.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:05 smithi060 ceph-mon[35058]: pgmap v1068: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:45:05.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:05 smithi082 ceph-mon[35195]: pgmap v1068: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:45:05.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:05 smithi001 ceph-mon[30968]: pgmap v1068: 129 pgs: 129 active+clean; 448 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.1 MiB/s wr, 327 op/s 2024-09-19T05:45:06.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 194502 16.93 MB/sec execute 501 sec latency 108.484 ms 2024-09-19T05:45:07.642 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:07 smithi001 ceph-mon[30968]: pgmap v1069: 129 pgs: 129 active+clean; 456 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 379 op/s 2024-09-19T05:45:07.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 194836 16.94 MB/sec execute 502 sec latency 132.095 ms 2024-09-19T05:45:07.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:07 smithi060 ceph-mon[35058]: pgmap v1069: 129 pgs: 129 active+clean; 456 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 379 op/s 2024-09-19T05:45:07.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:07 smithi082 ceph-mon[35195]: pgmap v1069: 129 pgs: 129 active+clean; 456 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 379 op/s 2024-09-19T05:45:08.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 195203 16.93 MB/sec execute 503 sec latency 80.852 ms 2024-09-19T05:45:09.413 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T05:45:09.413 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2024-09-19T05:45:09.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:45:09.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:09 smithi001 ceph-mon[30968]: pgmap v1070: 129 pgs: 129 active+clean; 441 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.1 MiB/s wr, 296 op/s 2024-09-19T05:45:09.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 195563 16.94 MB/sec execute 504 sec latency 124.164 ms 2024-09-19T05:45:09.714 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:09 smithi060 ceph-mon[35058]: pgmap v1070: 129 pgs: 129 active+clean; 441 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.1 MiB/s wr, 296 op/s 2024-09-19T05:45:09.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:09 smithi082 ceph-mon[35195]: pgmap v1070: 129 pgs: 129 active+clean; 441 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.1 MiB/s wr, 296 op/s 2024-09-19T05:45:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 -- 172.21.15.1:0/600980093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c103ff0 msgr2=0x7f2a7c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/600980093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c1043d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009900 tx=0x7f2a7002a410 comp rx=0 tx=0).stop 2024-09-19T05:45:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 -- 172.21.15.1:0/600980093 shutdown_connections 2024-09-19T05:45:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/600980093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c109120 0x7f2a7c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/600980093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c1049a0 0x7f2a7c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/600980093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c1043d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 -- 172.21.15.1:0/600980093 >> 172.21.15.1:0/600980093 conn(0x7f2a7c0ffab0 msgr2=0x7f2a7c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 -- 172.21.15.1:0/600980093 shutdown_connections 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.396+0000 7f2a82ffc640 1 -- 172.21.15.1:0/600980093 wait complete. 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 Processor -- start 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 -- start start 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c110bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c1049a0 0x7f2a7c10dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:10.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c114120 con 0x7f2a7c1049a0 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c113fa0 con 0x7f2a7c109120 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a82ffc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c1142a0 con 0x7f2a7c103ff0 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a81599640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a81599640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:37562/0 (socket says 172.21.15.1:37562) 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a81599640 1 -- 172.21.15.1:0/2155253539 learned_addr learned my addr 172.21.15.1:0/2155253539 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a80d98640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c110bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a7bfff640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c1049a0 0x7f2a7c10dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.397+0000 7f2a81599640 1 -- 172.21.15.1:0/2155253539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c103ff0 msgr2=0x7f2a7c110bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a81599640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c110bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a81599640 1 -- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c1049a0 msgr2=0x7f2a7c10dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:10.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a81599640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c1049a0 0x7f2a7c10dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a81599640 1 -- 172.21.15.1:0/2155253539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c1aae60 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a81599640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400eb10 tx=0x7f2a7400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74004b20 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a74004cc0 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1ab090 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74010760 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.398+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1ab5a0 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.400+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c1043d0 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.401+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2a74005020 con 0x7f2a7c109120 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.402+0000 7f2a79ffb640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 0x7f2a6c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.402+0000 7f2a80d98640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 0x7f2a6c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:10.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.402+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f2a740d01b0 con 0x7f2a7c109120 2024-09-19T05:45:10.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.403+0000 7f2a80d98640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 0x7f2a6c0a5800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009230 tx=0x7f2a700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:10.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.406+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a7409cac0 con 0x7f2a7c109120 2024-09-19T05:45:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.649+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a7c077d40 con 0x7f2a7c109120 2024-09-19T05:45:10.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.650+0000 7f2a79ffb640 1 -- 172.21.15.1:0/2155253539 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f2a7409c3c0 con 0x7f2a7c109120 2024-09-19T05:45:10.654 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:45:10.654 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:45:10.654 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 msgr2=0x7f2a6c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 0x7f2a6c0a5800 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009230 tx=0x7f2a700058d0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 msgr2=0x7f2a7c10e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400eb10 tx=0x7f2a7400c2d0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 shutdown_connections 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f2a6c0a3340 0x7f2a6c0a5800 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7c109120 0x7f2a7c10e330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a7c1049a0 0x7f2a7c10dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 --2- 172.21.15.1:0/2155253539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a7c103ff0 0x7f2a7c110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 >> 172.21.15.1:0/2155253539 conn(0x7f2a7c0ffab0 msgr2=0x7f2a7c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 shutdown_connections 2024-09-19T05:45:10.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:10.653+0000 7f2a82ffc640 1 -- 172.21.15.1:0/2155253539 wait complete. 2024-09-19T05:45:10.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 196047 16.94 MB/sec execute 505 sec latency 62.821 ms 2024-09-19T05:45:11.484 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0' 2024-09-19T05:45:11.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0 2024-09-19T05:45:11.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 196519 16.96 MB/sec execute 506 sec latency 101.193 ms 2024-09-19T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:11 smithi060 ceph-mon[35058]: pgmap v1071: 129 pgs: 129 active+clean; 439 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2024-09-19T05:45:11.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:11 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2155253539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:11 smithi082 ceph-mon[35195]: pgmap v1071: 129 pgs: 129 active+clean; 439 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2024-09-19T05:45:11.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:11 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2155253539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:11.777 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:11.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:11 smithi001 ceph-mon[30968]: pgmap v1071: 129 pgs: 129 active+clean; 439 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.7 MiB/s wr, 303 op/s 2024-09-19T05:45:11.843 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:11 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2155253539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:12.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197073 16.99 MB/sec execute 507 sec latency 56.126 ms 2024-09-19T05:45:12.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 -- 172.21.15.1:0/2210973200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb74106f20 msgr2=0x7ffb7410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 --2- 172.21.15.1:0/2210973200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb74106f20 0x7ffb7410eaa0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009ca0 tx=0x7ffb6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 -- 172.21.15.1:0/2210973200 shutdown_connections 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 --2- 172.21.15.1:0/2210973200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb74106f20 0x7ffb7410eaa0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 --2- 172.21.15.1:0/2210973200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb741027a0 0x7ffb741067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 --2- 172.21.15.1:0/2210973200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 0x7ffb741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 -- 172.21.15.1:0/2210973200 >> 172.21.15.1:0/2210973200 conn(0x7ffb740fd8f0 msgr2=0x7ffb740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 -- 172.21.15.1:0/2210973200 shutdown_connections 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.804+0000 7ffb7c625640 1 -- 172.21.15.1:0/2210973200 wait complete. 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 Processor -- start 2024-09-19T05:45:12.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 -- start start 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 0x7ffb740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb74106f20 0x7ffb74074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74111f80 con 0x7ffb741027a0 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74111e00 con 0x7ffb74106f20 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7c625640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74112100 con 0x7ffb74101df0 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb79bc0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb79bc0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51316/0 (socket says 172.21.15.1:51316) 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb79bc0640 1 -- 172.21.15.1:0/3472377361 learned_addr learned my addr 172.21.15.1:0/3472377361 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb74106f20 0x7ffb74074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.805+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 0x7ffb740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 -- 172.21.15.1:0/3472377361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 msgr2=0x7ffb740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 0x7ffb740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 -- 172.21.15.1:0/3472377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb74106f20 msgr2=0x7ffb74074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb74106f20 0x7ffb74074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 -- 172.21.15.1:0/3472377361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb741a68a0 con 0x7ffb741027a0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d950 tx=0x7ffb6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb6b7fe640 1 -- 172.21.15.1:0/3472377361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64017070 con 0x7ffb741027a0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb6b7fe640 1 -- 172.21.15.1:0/3472377361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb64009c30 con 0x7ffb741027a0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb741a6b90 con 0x7ffb741027a0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb6b7fe640 1 -- 172.21.15.1:0/3472377361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400f6b0 con 0x7ffb741027a0 2024-09-19T05:45:12.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.806+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb741a7120 con 0x7ffb741027a0 2024-09-19T05:45:12.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 Processor -- start 2024-09-19T05:45:12.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 -- start start 2024-09-19T05:45:12.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb6b7fe640 1 -- 172.21.15.1:0/3472377361 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ffb640109d0 con 0x7ffb741027a0 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 0x558e231dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e231332a0 con 0x558e231cd760 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558e230dab10 con 0x558e231ce080 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.810+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e2312f260 con 0x558e231d8940 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51320/0 (socket says 172.21.15.1:51320) 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3399277250 learned_addr learned my addr 172.21.15.1:0/3399277250 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 0x558e231dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3399277250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 msgr2=0x558e231dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 0x558e231dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3399277250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 msgr2=0x558e231d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3399277250 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e22ea4b90 con 0x558e231cd760 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 0x558e231dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c004af0 tx=0x7ffb6c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b00ebe026f92248 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.811+0000 7ffb6b7fe640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 0x7ffb600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.812+0000 7ffb68ff9640 1 -- 172.21.15.1:0/3399277250 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c003970 con 0x558e231cd760 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.812+0000 7ffb6b7fe640 1 -- 172.21.15.1:0/3472377361 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb640cf730 con 0x7ffb741027a0 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.812+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 0x7ffb600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.812+0000 7ffb68ff9640 1 -- 172.21.15.1:0/3399277250 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb6c036040 con 0x558e231cd760 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.812+0000 7ffb68ff9640 1 -- 172.21.15.1:0/3399277250 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0043a0 con 0x558e231cd760 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3399277250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 msgr2=0x558e231cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 0x7ffb600a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x558e231cab50 tx=0x7ffb7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c004af0 tx=0x7ffb6c0098b0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3399277250 shutdown_connections 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231d8940 0x558e231dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3399277250 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231cdb40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3399277250 >> 172.21.15.1:0/3399277250 conn(0x558e231c9cf0 msgr2=0x558e231ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3399277250 shutdown_connections 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3399277250 wait complete. 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 -- start start 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 Processor -- start 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.813+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231cd760 0x558e231d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e231db390 con 0x558e231d8940 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558e230bb6e0 con 0x558e231ce080 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e231db510 con 0x558e231cd760 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7e9fe740 10 client.0 _ll_register_callbacks cb 0x558e230dfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7a3c1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231cd760 0x558e231d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51322/0 (socket says 172.21.15.1:51322) 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3113165271 learned_addr learned my addr 172.21.15.1:0/3113165271 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231cd760 msgr2=0x558e231d5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231cd760 0x558e231d5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3113165271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 msgr2=0x558e231d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 -- 172.21.15.1:0/3113165271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e231e4860 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005e30 tx=0x7ffb6c003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714ef46427e38d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c003ec0 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.814+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb6c004330 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb6c036040 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb6c004570 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 10 client.16167 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558e231db390 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb6c036040 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb6c057050 con 0x558e231d8940 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 10 client.16167 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 10 client.16167 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 20 client.16167 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:12.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231e8370 0x558e231ea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 4 client.16167 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e231409d0 con 0x558e231e8370 2024-09-19T05:45:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.815+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231e8370 0x558e231ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.816+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231e8370 0x558e231ea760 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63234b4d37bdd931 server_cookie=321341ee544f12d in_seq=0 out_seq=0 2024-09-19T05:45:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.816+0000 7ffb5dffb640 10 client.16167 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb5dffb640 1 -- 172.21.15.1:0/3113165271 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e231409d0 con 0x558e231e8370 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb5dffb640 10 client.16167 handle_command_reply: tid=0 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 client.16167 shutdown 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 msgr2=0x558e231d61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005e30 tx=0x7ffb6c003ca0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 shutdown_connections 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231d8940 0x558e231d61f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231ce080 0x558e231d5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231e8370 0x558e231ea760 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/3113165271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231cd760 0x558e231d5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.820+0000 7ffb5dffb640 0 client.16167 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.821+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 >> 172.21.15.1:0/3113165271 conn(0x558e231c9cf0 msgr2=0x558e231cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.821+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 shutdown_connections 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.821+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/3113165271 wait complete. 2024-09-19T05:45:12.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.821+0000 7ffb7e9fe740 20 client.16167 trim_cache size 0 max 16384 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 Processor -- start 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 -- start start 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231f0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.838+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741aeeb0 con 0x558e231cd760 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b1730 con 0x558e231c9cf0 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741af520 con 0x558e231ce080 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51334/0 (socket says 172.21.15.1:51334) 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 -- 172.21.15.1:0/2376643786 learned_addr learned my addr 172.21.15.1:0/2376643786 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb7abc2640 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 -- 172.21.15.1:0/2376643786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 msgr2=0x558e231f0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231f0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 -- 172.21.15.1:0/2376643786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 msgr2=0x558e231d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 -- 172.21.15.1:0/2376643786 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e231cdeb0 con 0x558e231cd760 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffb64097eb0 tx=0x7ffb64005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d2f8c44c4986fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb5ffff640 1 -- 172.21.15.1:0/2376643786 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64020040 con 0x558e231cd760 2024-09-19T05:45:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb5ffff640 1 -- 172.21.15.1:0/2376643786 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb640a4610 con 0x558e231cd760 2024-09-19T05:45:12.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.839+0000 7ffb5ffff640 1 -- 172.21.15.1:0/2376643786 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb640cfbe0 con 0x558e231cd760 2024-09-19T05:45:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2376643786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 msgr2=0x558e231f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:12.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ffb64097eb0 tx=0x7ffb64005f90 comp rx=0 tx=0).stop 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2376643786 shutdown_connections 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231f0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231f0030 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2376643786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2376643786 >> 172.21.15.1:0/2376643786 conn(0x558e231d7b10 msgr2=0x558e231cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2376643786 shutdown_connections 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2376643786 wait complete. 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.840+0000 7ffb7e9fe740 1 -- start start 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 Processor -- start 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231e1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231ddb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741afbf0 con 0x558e231cd760 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b1060 con 0x558e231c9cf0 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b02c0 con 0x558e231ce080 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7e9fe740 10 client.0 _ll_register_callbacks cb 0x7ffb6c0095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231ddb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7abc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231ddb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:50042/0 (socket says 172.21.15.1:50042) 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7abc2640 1 -- 172.21.15.1:0/2552306092 learned_addr learned my addr 172.21.15.1:0/2552306092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 -- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 msgr2=0x558e231ddb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231ddb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 -- 172.21.15.1:0/2552306092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 msgr2=0x558e231dd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231dd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:12.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.841+0000 7ffb7a3c1640 1 -- 172.21.15.1:0/2552306092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e23253010 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb7a3c1640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231e1060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x558e231d8850 tx=0x7ffb700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1dede7d564a00f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7001ea10 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ffb7001ebb0 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb640a4610 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb7003c050 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb7e9fe740 10 client.25736 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558e232541a0 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb7001edb0 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ffb700336d0 con 0x558e231c9cf0 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.842+0000 7ffb7e9fe740 10 client.25736 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb7e9fe740 10 client.25736 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb7e9fe740 20 client.25736 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:12.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231d8940 0x558e232568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb7e9fe740 4 client.25736 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}] 2024-09-19T05:45:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}) -- 0x7ffb640a4610 con 0x558e231d8940 2024-09-19T05:45:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231d8940 0x558e232568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb79bc0640 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231d8940 0x558e232568f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1791126a0c9620b server_cookie=4daddd60ec8bf751 in_seq=0 out_seq=0 2024-09-19T05:45:12.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:12.843+0000 7ffb5dffb640 10 client.25736 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:13.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197185 16.96 MB/sec execute 508 sec latency 822.352 ms 2024-09-19T05:45:13.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:13 smithi060 ceph-mon[35058]: pgmap v1072: 129 pgs: 129 active+clean; 433 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 292 op/s 2024-09-19T05:45:13.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:13 smithi082 ceph-mon[35195]: pgmap v1072: 129 pgs: 129 active+clean; 433 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 292 op/s 2024-09-19T05:45:13.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:13 smithi001 ceph-mon[30968]: pgmap v1072: 129 pgs: 129 active+clean; 433 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 292 op/s 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb5dffb640 1 -- 172.21.15.1:0/2552306092 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7ffb640a4610 con 0x558e231d8940 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb5dffb640 10 client.25736 handle_command_reply: tid=0 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb7e9fe740 1 client.25736 shutdown 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 msgr2=0x558e231e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231e1060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x558e231d8850 tx=0x7ffb700046c0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 shutdown_connections 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.102+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x558e231d8940 0x558e232568f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e231ce080 0x558e231ddb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e231cd760 0x558e231dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 --2- 172.21.15.1:0/2552306092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558e231c9cf0 0x558e231e1060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb5dffb640 0 client.25736 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 >> 172.21.15.1:0/2552306092 conn(0x558e231d7b10 msgr2=0x558e231c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 shutdown_connections 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 1 -- 172.21.15.1:0/2552306092 wait complete. 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7e9fe740 20 client.25736 trim_cache size 0 max 16384 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:45:14.107 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 82, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "480f63e6": { 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 82, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 138.5, 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:45:14.108 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:14.109 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 msgr2=0x7ffb600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 0x7ffb600a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x558e231cab50 tx=0x7ffb7000b390 comp rx=0 tx=0).stop 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 msgr2=0x7ffb74074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d950 tx=0x7ffb6400de10 comp rx=0 tx=0).stop 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 shutdown_connections 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ffb600a32c0 0x7ffb600a5780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb74106f20 0x7ffb74074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffb741027a0 0x7ffb74074a30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 --2- 172.21.15.1:0/3472377361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb74101df0 0x7ffb740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:14.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.103+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 >> 172.21.15.1:0/3472377361 conn(0x7ffb740fd8f0 msgr2=0x7ffb740fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:14.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.104+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 shutdown_connections 2024-09-19T05:45:14.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:14.104+0000 7ffb7c625640 1 -- 172.21.15.1:0/3472377361 wait complete. 2024-09-19T05:45:14.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.93 MB/sec execute 509 sec latency 971.446 ms 2024-09-19T05:45:15.178 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '480f63e6', quiesce took 5.8 seconds. Will release after: 12.7 2024-09-19T05:45:15.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.90 MB/sec execute 510 sec latency 1952.408 ms 2024-09-19T05:45:15.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:15 smithi060 ceph-mon[35058]: pgmap v1073: 129 pgs: 129 active+clean; 438 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-09-19T05:45:15.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:15 smithi082 ceph-mon[35195]: pgmap v1073: 129 pgs: 129 active+clean; 438 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-09-19T05:45:15.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:15 smithi001 ceph-mon[30968]: pgmap v1073: 129 pgs: 129 active+clean; 438 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-09-19T05:45:16.663 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.86 MB/sec execute 511 sec latency 2952.538 ms 2024-09-19T05:45:17.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.83 MB/sec execute 512 sec latency 3952.673 ms 2024-09-19T05:45:17.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:17 smithi060 ceph-mon[35058]: pgmap v1074: 129 pgs: 129 active+clean; 443 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.2 MiB/s wr, 294 op/s 2024-09-19T05:45:17.760 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:17 smithi082 ceph-mon[35195]: pgmap v1074: 129 pgs: 129 active+clean; 443 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.2 MiB/s wr, 294 op/s 2024-09-19T05:45:17.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:17 smithi001 ceph-mon[30968]: pgmap v1074: 129 pgs: 129 active+clean; 443 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.2 MiB/s wr, 294 op/s 2024-09-19T05:45:18.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.80 MB/sec execute 513 sec latency 4952.788 ms 2024-09-19T05:45:19.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.76 MB/sec execute 514 sec latency 5952.896 ms 2024-09-19T05:45:19.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:19 smithi060 ceph-mon[35058]: pgmap v1075: 129 pgs: 129 active+clean; 443 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-09-19T05:45:19.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:19 smithi082 ceph-mon[35195]: pgmap v1075: 129 pgs: 129 active+clean; 443 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-09-19T05:45:19.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:19 smithi001 ceph-mon[30968]: pgmap v1075: 129 pgs: 129 active+clean; 443 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-09-19T05:45:20.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.73 MB/sec execute 515 sec latency 6953.003 ms 2024-09-19T05:45:21.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.70 MB/sec execute 516 sec latency 7953.122 ms 2024-09-19T05:45:21.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:21 smithi060 ceph-mon[35058]: pgmap v1076: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 191 op/s 2024-09-19T05:45:21.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:21 smithi082 ceph-mon[35195]: pgmap v1076: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 191 op/s 2024-09-19T05:45:21.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:21 smithi001 ceph-mon[30968]: pgmap v1076: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 191 op/s 2024-09-19T05:45:22.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.67 MB/sec execute 517 sec latency 8953.252 ms 2024-09-19T05:45:23.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.63 MB/sec execute 518 sec latency 9953.363 ms 2024-09-19T05:45:23.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:23 smithi060 ceph-mon[35058]: pgmap v1077: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:45:23.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:23 smithi082 ceph-mon[35195]: pgmap v1077: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:45:23.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:23 smithi001 ceph-mon[30968]: pgmap v1077: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 169 op/s 2024-09-19T05:45:24.664 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.60 MB/sec execute 519 sec latency 10953.431 ms 2024-09-19T05:45:25.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.57 MB/sec execute 520 sec latency 11953.516 ms 2024-09-19T05:45:25.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:25 smithi060 ceph-mon[35058]: pgmap v1078: 129 pgs: 129 active+clean; 459 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 164 op/s 2024-09-19T05:45:25.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:25 smithi082 ceph-mon[35195]: pgmap v1078: 129 pgs: 129 active+clean; 459 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 164 op/s 2024-09-19T05:45:25.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:25 smithi001 ceph-mon[30968]: pgmap v1078: 129 pgs: 129 active+clean; 459 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 164 op/s 2024-09-19T05:45:26.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.54 MB/sec execute 521 sec latency 12953.571 ms 2024-09-19T05:45:27.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.51 MB/sec execute 522 sec latency 13953.680 ms 2024-09-19T05:45:27.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:27 smithi060 ceph-mon[35058]: pgmap v1079: 129 pgs: 129 active+clean; 453 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2024-09-19T05:45:27.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:27 smithi082 ceph-mon[35195]: pgmap v1079: 129 pgs: 129 active+clean; 453 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2024-09-19T05:45:27.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:27 smithi001 ceph-mon[30968]: pgmap v1079: 129 pgs: 129 active+clean; 453 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 834 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2024-09-19T05:45:27.879 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:45:28.154 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 -- 172.21.15.1:0/931829919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c105a90 msgr2=0x7f9f7c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 --2- 172.21.15.1:0/931829919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c105a90 0x7f9f7c105e70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009900 tx=0x7f9f6c02a410 comp rx=0 tx=0).stop 2024-09-19T05:45:28.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 -- 172.21.15.1:0/931829919 shutdown_connections 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 --2- 172.21.15.1:0/931829919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c101bc0 0x7f9f7c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 --2- 172.21.15.1:0/931829919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101240 0x7f9f7c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 --2- 172.21.15.1:0/931829919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c105a90 0x7f9f7c105e70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 -- 172.21.15.1:0/931829919 >> 172.21.15.1:0/931829919 conn(0x7f9f7c077210 msgr2=0x7f9f7c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 -- 172.21.15.1:0/931829919 shutdown_connections 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.637+0000 7f9f8080f640 1 -- 172.21.15.1:0/931829919 wait complete. 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 Processor -- start 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 -- start start 2024-09-19T05:45:28.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101bc0 0x7f9f7c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c105a90 0x7f9f7c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c110fc0 con 0x7f9f7c101240 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c110e40 con 0x7f9f7c105a90 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f8080f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c111140 con 0x7f9f7c101bc0 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:28.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60770/0 (socket says 172.21.15.1:60770) 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 -- 172.21.15.1:0/4102017502 learned_addr learned my addr 172.21.15.1:0/4102017502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7ad9d640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c105a90 0x7f9f7c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f79d9b640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101bc0 0x7f9f7c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 -- 172.21.15.1:0/4102017502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101bc0 msgr2=0x7f9f7c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101bc0 0x7f9f7c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 -- 172.21.15.1:0/4102017502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c105a90 msgr2=0x7f9f7c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c105a90 0x7f9f7c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.638+0000 7f9f7a59c640 1 -- 172.21.15.1:0/4102017502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c19f660 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f7a59c640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c02aa00 tx=0x7f9f6c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c03f070 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c19f8f0 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f6c031c20 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c035030 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.639+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c1a7230 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.640+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c101680 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.641+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9f6c042070 con 0x7f9f7c101240 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.642+0000 7f9f6b7fe640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 0x7f9f640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:28.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.642+0000 7f9f79d9b640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 0x7f9f640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.642+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9f6c0f0a30 con 0x7f9f7c101240 2024-09-19T05:45:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.642+0000 7f9f79d9b640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 0x7f9f640a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005fd0 tx=0x7f9f70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:28.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.645+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f6c0bd3a0 con 0x7f9f7c101240 2024-09-19T05:45:28.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.48 MB/sec execute 523 sec latency 14953.744 ms 2024-09-19T05:45:28.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.861+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7c0fdcd0 con 0x7f9f7c101240 2024-09-19T05:45:28.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.862+0000 7f9f6b7fe640 1 -- 172.21.15.1:0/4102017502 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f9f6c031dd0 con 0x7f9f7c101240 2024-09-19T05:45:28.864 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:45:28.864 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:45:28.864 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 msgr2=0x7f9f640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 0x7f9f640a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9f70005fd0 tx=0x7f9f70005850 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 msgr2=0x7f9f7c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c02aa00 tx=0x7f9f6c003b60 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 shutdown_connections 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9f640a3240 0x7f9f640a5700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c105a90 0x7f9f7c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f7c101bc0 0x7f9f7c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 --2- 172.21.15.1:0/4102017502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9f7c101240 0x7f9f7c19a6b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 >> 172.21.15.1:0/4102017502 conn(0x7f9f7c077210 msgr2=0x7f9f7c1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 shutdown_connections 2024-09-19T05:45:28.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:28.864+0000 7f9f8080f640 1 -- 172.21.15.1:0/4102017502 wait complete. 2024-09-19T05:45:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:29 smithi001 ceph-mon[30968]: pgmap v1080: 129 pgs: 129 active+clean; 452 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.9 MiB/s wr, 83 op/s 2024-09-19T05:45:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:29 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4102017502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:29.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197193 16.44 MB/sec execute 524 sec latency 15953.830 ms 2024-09-19T05:45:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:29 smithi060 ceph-mon[35058]: pgmap v1080: 129 pgs: 129 active+clean; 452 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.9 MiB/s wr, 83 op/s 2024-09-19T05:45:29.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:29 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4102017502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:29 smithi082 ceph-mon[35195]: pgmap v1080: 129 pgs: 129 active+clean; 452 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 2.9 MiB/s wr, 83 op/s 2024-09-19T05:45:29.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:29 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4102017502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:29.790 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id 480f63e6 --release --await' 2024-09-19T05:45:29.790 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id 480f63e6 --release --await 2024-09-19T05:45:30.047 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:30.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 -- 172.21.15.1:0/2669663666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c100a80 msgr2=0x7fe52c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 --2- 172.21.15.1:0/2669663666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c100a80 0x7fe52c100ee0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe518009930 tx=0x7fe51802a420 comp rx=0 tx=0).stop 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 -- 172.21.15.1:0/2669663666 shutdown_connections 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 --2- 172.21.15.1:0/2669663666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c101420 0x7fe52c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 --2- 172.21.15.1:0/2669663666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c100a80 0x7fe52c100ee0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 --2- 172.21.15.1:0/2669663666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c106a80 0x7fe52c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 -- 172.21.15.1:0/2669663666 >> 172.21.15.1:0/2669663666 conn(0x7fe52c0fc7a0 msgr2=0x7fe52c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 -- 172.21.15.1:0/2669663666 shutdown_connections 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.545+0000 7fe532b77640 1 -- 172.21.15.1:0/2669663666 wait complete. 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 Processor -- start 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 -- start start 2024-09-19T05:45:30.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 0x7fe52c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c106a80 0x7fe52c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c110e80 con 0x7fe52c101420 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c110d00 con 0x7fe52c106a80 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe532b77640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c111000 con 0x7fe52c100a80 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60802/0 (socket says 172.21.15.1:60802) 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.546+0000 7fe52bfff640 1 -- 172.21.15.1:0/152980929 learned_addr learned my addr 172.21.15.1:0/152980929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe531114640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c106a80 0x7fe52c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe530913640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 0x7fe52c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 -- 172.21.15.1:0/152980929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 msgr2=0x7fe52c198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 0x7fe52c198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 -- 172.21.15.1:0/152980929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c106a80 msgr2=0x7fe52c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c106a80 0x7fe52c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 -- 172.21.15.1:0/152980929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c19d4b0 con 0x7fe52c101420 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe530913640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 0x7fe52c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe52bfff640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe518009230 tx=0x7fe518004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe529ffb640 1 -- 172.21.15.1:0/152980929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51803f030 con 0x7fe52c101420 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52c19d740 con 0x7fe52c101420 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe529ffb640 1 -- 172.21.15.1:0/152980929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe518003ad0 con 0x7fe52c101420 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe529ffb640 1 -- 172.21.15.1:0/152980929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518035070 con 0x7fe52c101420 2024-09-19T05:45:30.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.547+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52c1a5080 con 0x7fe52c101420 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe529ffb640 1 -- 172.21.15.1:0/152980929 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe518042030 con 0x7fe52c101420 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 Processor -- start 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 -- start start 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 0x5584fd2c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584fd21d620 con 0x5584fd2b8060 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584fd1c4e50 con 0x5584fd2c3240 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe534f50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584fd2195e0 con 0x5584fd2b8980 2024-09-19T05:45:30.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.550+0000 7fe531114640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60812/0 (socket says 172.21.15.1:60812) 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 -- 172.21.15.1:0/2898527896 learned_addr learned my addr 172.21.15.1:0/2898527896 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe530913640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe52bfff640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 0x5584fd2c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 -- 172.21.15.1:0/2898527896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 msgr2=0x5584fd2c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 -- 172.21.15.1:0/2898527896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 msgr2=0x5584fd2c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe529ffb640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 0x7fe51c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 0x5584fd2c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 -- 172.21.15.1:0/2898527896 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584fd1b5d40 con 0x5584fd2b8060 2024-09-19T05:45:30.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe530913640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe52bfff640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 0x5584fd2c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe529ffb640 1 -- 172.21.15.1:0/152980929 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe5180f01b0 con 0x7fe52c101420 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe5240039f0 tx=0x7fe524003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5539bab92fcae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe531114640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 0x7fe51c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.551+0000 7fe516ffd640 1 -- 172.21.15.1:0/2898527896 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524022070 con 0x5584fd2b8060 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe516ffd640 1 -- 172.21.15.1:0/2898527896 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe524015070 con 0x5584fd2b8060 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe516ffd640 1 -- 172.21.15.1:0/2898527896 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524010ac0 con 0x5584fd2b8060 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe531114640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 0x7fe51c0a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe52401f000 tx=0x7fe524020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 -- 172.21.15.1:0/2898527896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 msgr2=0x5584fd2b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe5240039f0 tx=0x7fe524003eb0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 -- 172.21.15.1:0/2898527896 shutdown_connections 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2c3240 0x5584fd2c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 --2- 172.21.15.1:0/2898527896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2b8440 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 -- 172.21.15.1:0/2898527896 >> 172.21.15.1:0/2898527896 conn(0x5584fd2b45f0 msgr2=0x5584fd2b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 -- 172.21.15.1:0/2898527896 shutdown_connections 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.552+0000 7fe534f50740 1 -- 172.21.15.1:0/2898527896 wait complete. 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 -- start start 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 Processor -- start 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd2c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 0x5584fd2c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5584fd2c5e10 con 0x5584fd2b8060 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5584fd1a5f10 con 0x5584fd2b8980 2024-09-19T05:45:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584fd2c5f90 con 0x5584fd2c3240 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe534f50740 10 client.0 _ll_register_callbacks cb 0x5584fd1c9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe530913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe530913640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60820/0 (socket says 172.21.15.1:60820) 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.553+0000 7fe530913640 1 -- 172.21.15.1:0/3540111468 learned_addr learned my addr 172.21.15.1:0/3540111468 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe52bfff640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd2c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 -- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 msgr2=0x5584fd2c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe531114640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 0x5584fd2c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 0x5584fd2c0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 -- 172.21.15.1:0/3540111468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 msgr2=0x5584fd2c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd2c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 -- 172.21.15.1:0/3540111468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584fcf2c580 con 0x5584fd2b8060 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe52bfff640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd2c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe531114640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 0x5584fd2c0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:30.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe530913640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe52000f670 tx=0x7fe52000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d248eb821a4cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe50bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520016070 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe52000bb00 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe524015070 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe520025050 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe534f50740 10 client.16191 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584fcff6960 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.554+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe524015070 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe52001a400 con 0x5584fd2b8060 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 10 client.16191 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 10 client.16191 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 20 client.16191 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:30.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2d2f30 0x5584fd2d53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 4 client.16191 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584fd22ab90 con 0x5584fd2d2f30 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe52bfff640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2d2f30 0x5584fd2d53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe50bfff640 10 client.16191 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.555+0000 7fe52bfff640 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2d2f30 0x5584fd2d53f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=807591884b76f89f server_cookie=45960a6b64b511e7 in_seq=0 out_seq=0 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.556+0000 7fe50bfff640 1 -- 172.21.15.1:0/3540111468 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584fd22ab90 con 0x5584fd2d2f30 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.556+0000 7fe50bfff640 10 client.16191 handle_command_reply: tid=0 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.556+0000 7fe534f50740 1 client.16191 shutdown 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 msgr2=0x5584fd2c01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe52000f670 tx=0x7fe52000fb30 comp rx=0 tx=0).stop 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 shutdown_connections 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2d2f30 0x5584fd2d53f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2c3240 0x5584fd2c0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd2c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 --2- 172.21.15.1:0/3540111468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c01b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 >> 172.21.15.1:0/3540111468 conn(0x5584fd2b45f0 msgr2=0x5584fd2ba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe50bfff640 0 client.16191 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 shutdown_connections 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 1 -- 172.21.15.1:0/3540111468 wait complete. 2024-09-19T05:45:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.557+0000 7fe534f50740 20 client.16191 trim_cache size 0 max 16384 2024-09-19T05:45:30.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 Processor -- start 2024-09-19T05:45:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 -- start start 2024-09-19T05:45:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b45f0 0x5584fd2bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1acd20 con 0x5584fd2b8060 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1af5a0 con 0x5584fd2b45f0 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe534f50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1ad390 con 0x5584fd2b8980 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60834/0 (socket says 172.21.15.1:60834) 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.574+0000 7fe52bfff640 1 -- 172.21.15.1:0/204515188 learned_addr learned my addr 172.21.15.1:0/204515188 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe530913640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b45f0 0x5584fd2bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe531114640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 -- 172.21.15.1:0/204515188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 msgr2=0x5584fd2db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 -- 172.21.15.1:0/204515188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b45f0 msgr2=0x5584fd2bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b45f0 0x5584fd2bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 -- 172.21.15.1:0/204515188 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584fd2b7e90 con 0x5584fd2b8060 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe531114640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe52bfff640 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe518009a50 tx=0x7fe5180ed7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4792dd3757a866e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe5167fc640 1 -- 172.21.15.1:0/204515188 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518049040 con 0x5584fd2b8060 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe5167fc640 1 -- 172.21.15.1:0/204515188 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5180bc420 con 0x5584fd2b8060 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.575+0000 7fe5167fc640 1 -- 172.21.15.1:0/204515188 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518003c80 con 0x5584fd2b8060 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- 172.21.15.1:0/204515188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 msgr2=0x5584fd2dad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe518009a50 tx=0x7fe5180ed7d0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- 172.21.15.1:0/204515188 shutdown_connections 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b8980 0x5584fd2db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2dad10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 --2- 172.21.15.1:0/204515188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b45f0 0x5584fd2bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- 172.21.15.1:0/204515188 >> 172.21.15.1:0/204515188 conn(0x5584fd2b51a0 msgr2=0x5584fd2c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- 172.21.15.1:0/204515188 shutdown_connections 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- 172.21.15.1:0/204515188 wait complete. 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 -- start start 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.576+0000 7fe534f50740 1 Processor -- start 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b45f0 0x5584fd2c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd33cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1ada60 con 0x5584fd2b8060 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1aeed0 con 0x5584fd2b8980 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c1ae130 con 0x5584fd2b45f0 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe534f50740 10 client.0 _ll_register_callbacks cb 0x7fe52000de40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60848/0 (socket says 172.21.15.1:60848) 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 -- 172.21.15.1:0/24281918 learned_addr learned my addr 172.21.15.1:0/24281918 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe531114640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd33cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe530913640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b45f0 0x5584fd2c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 -- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b45f0 msgr2=0x5584fd2c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b45f0 0x5584fd2c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 -- 172.21.15.1:0/24281918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 msgr2=0x5584fd33cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd33cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 -- 172.21.15.1:0/24281918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584fd2d1ad0 con 0x5584fd2b8060 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe52bfff640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe5180ed950 tx=0x7fe518005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28123e856b450f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.577+0000 7fe50bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe518049070 con 0x5584fd2b8060 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fe5180b8a90 con 0x5584fd2b8060 2024-09-19T05:45:30.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5180bc420 con 0x5584fd2b8060 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe5180c07d0 con 0x5584fd2b8060 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 10 client.16197 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5584fd33e0e0 con 0x5584fd2b8060 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5180bc420 con 0x5584fd2b8060 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe5180c4c00 con 0x5584fd2b8060 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 10 client.16197 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 10 client.16197 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 20 client.16197 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2c3240 0x5584fd340760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 4 client.16197 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "480f63e6", "release": true, "await": true}] 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.578+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "480f63e6", "release": true, "await": true}) -- 0x5584fd2250a0 con 0x5584fd2c3240 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.579+0000 7fe530913640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2c3240 0x5584fd340760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.579+0000 7fe530913640 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2c3240 0x5584fd340760 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2c1f1faeae6281b server_cookie=53af74aef96ea406 in_seq=0 out_seq=0 2024-09-19T05:45:30.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.579+0000 7fe50bfff640 10 client.16197 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:30.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197196 16.41 MB/sec execute 525 sec latency 16905.310 ms 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe50bfff640 1 -- 172.21.15.1:0/24281918 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5584fd2250a0 con 0x5584fd2c3240 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe50bfff640 10 client.16197 handle_command_reply: tid=0 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 client.16197 shutdown 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 msgr2=0x5584fd2c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe5180ed950 tx=0x7fe518005e50 comp rx=0 tx=0).stop 2024-09-19T05:45:30.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 shutdown_connections 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5584fd2b8980 0x5584fd33cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5584fd2b8060 0x5584fd2c7820 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x5584fd2c3240 0x5584fd340760 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 --2- 172.21.15.1:0/24281918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584fd2b45f0 0x5584fd2c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 >> 172.21.15.1:0/24281918 conn(0x5584fd2b51a0 msgr2=0x5584fd2b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe50bfff640 0 client.16197 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 shutdown_connections 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 1 -- 172.21.15.1:0/24281918 wait complete. 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.681+0000 7fe534f50740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T05:45:30.684 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 84, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "480f63e6": { 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 84, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:45:30.685 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 138.5, 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:45:30.686 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:30.688 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:30.690 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:30.690 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 msgr2=0x7fe51c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 0x7fe51c0a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe52401f000 tx=0x7fe524020000 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 msgr2=0x7fe52c198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe518009230 tx=0x7fe518004270 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 shutdown_connections 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fe51c0a3240 0x7fe51c0a5700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe52c106a80 0x7fe52c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe52c101420 0x7fe52c198a40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 --2- 172.21.15.1:0/152980929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe52c100a80 0x7fe52c198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:30.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 >> 172.21.15.1:0/152980929 conn(0x7fe52c0fc7a0 msgr2=0x7fe52c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:30.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 shutdown_connections 2024-09-19T05:45:30.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:30.682+0000 7fe532b77640 1 -- 172.21.15.1:0/152980929 wait complete. 2024-09-19T05:45:31.493 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '480f63e6', total seconds elapsed: 22.1 2024-09-19T05:45:31.493 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.5 2024-09-19T05:45:31.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:45:31.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:31 smithi001 ceph-mon[30968]: pgmap v1081: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-19T05:45:31.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197470 16.42 MB/sec execute 526 sec latency 16928.014 ms 2024-09-19T05:45:31.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:31 smithi060 ceph-mon[35058]: pgmap v1081: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-19T05:45:31.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:31 smithi082 ceph-mon[35195]: pgmap v1081: 129 pgs: 129 active+clean; 453 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-19T05:45:31.853 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 -- 172.21.15.1:0/2740968406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 msgr2=0x7f3b1c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2740968406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c1067f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009900 tx=0x7f3b1002a410 comp rx=0 tx=0).stop 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 -- 172.21.15.1:0/2740968406 shutdown_connections 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2740968406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 0x7f3b1c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2740968406 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c1067f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2740968406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 -- 172.21.15.1:0/2740968406 >> 172.21.15.1:0/2740968406 conn(0x7f3b1c0fd8f0 msgr2=0x7f3b1c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 -- 172.21.15.1:0/2740968406 shutdown_connections 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.356+0000 7f3b219b7640 1 -- 172.21.15.1:0/2740968406 wait complete. 2024-09-19T05:45:32.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 Processor -- start 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 -- start start 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 0x7f3b1c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c111f40 con 0x7f3b1c1027a0 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c111dc0 con 0x7f3b1c106f20 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b219b7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1120c0 con 0x7f3b1c101df0 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60866/0 (socket says 172.21.15.1:60866) 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b1a7fc640 1 -- 172.21.15.1:0/2165532641 learned_addr learned my addr 172.21.15.1:0/2165532641 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b1b7fe640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 0x7f3b1c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.357+0000 7f3b1affd640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 -- 172.21.15.1:0/2165532641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 msgr2=0x7f3b1c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 -- 172.21.15.1:0/2165532641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 msgr2=0x7f3b1c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 0x7f3b1c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 -- 172.21.15.1:0/2165532641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c1a68e0 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1affd640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b1a7fc640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3b10006010 tx=0x7f3b100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1003f030 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1a6b70 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b10003ce0 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10035070 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.358+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a7050 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.359+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c1021d0 con 0x7f3b1c1027a0 2024-09-19T05:45:32.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.361+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3b10042030 con 0x7f3b1c1027a0 2024-09-19T05:45:32.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.362+0000 7f3b209b5640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 0x7f3b040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:32.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.362+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f3b100f0510 con 0x7f3b1c1027a0 2024-09-19T05:45:32.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.362+0000 7f3b1affd640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 0x7f3b040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:32.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.363+0000 7f3b1affd640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 0x7f3b040a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c005d00 tx=0x7f3b0c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:32.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.365+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b100bc890 con 0x7f3b1c1027a0 2024-09-19T05:45:32.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.608+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b1c10a100 con 0x7f3b1c1027a0 2024-09-19T05:45:32.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.609+0000 7f3b209b5640 1 -- 172.21.15.1:0/2165532641 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f3b100c0b90 con 0x7f3b1c1027a0 2024-09-19T05:45:32.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:45:32.611 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:45:32.611 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 msgr2=0x7f3b040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 0x7f3b040a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c005d00 tx=0x7f3b0c00b410 comp rx=0 tx=0).stop 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 msgr2=0x7f3b1c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3b10006010 tx=0x7f3b100042f0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 shutdown_connections 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f3b040a3240 0x7f3b040a5700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b1c106f20 0x7f3b1c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b1c1027a0 0x7f3b1c074a30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 --2- 172.21.15.1:0/2165532641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b1c101df0 0x7f3b1c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 >> 172.21.15.1:0/2165532641 conn(0x7f3b1c0fd8f0 msgr2=0x7f3b1c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 shutdown_connections 2024-09-19T05:45:32.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:32.611+0000 7f3b219b7640 1 -- 172.21.15.1:0/2165532641 wait complete. 2024-09-19T05:45:32.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 197938 16.45 MB/sec execute 527 sec latency 105.057 ms 2024-09-19T05:45:33.514 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0' 2024-09-19T05:45:33.515 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db / --timeout 90 --expiration 138.5 --await-for 45.0 2024-09-19T05:45:33.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198265 16.45 MB/sec execute 528 sec latency 114.934 ms 2024-09-19T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:33 smithi060 ceph-mon[35058]: pgmap v1082: 129 pgs: 129 active+clean; 454 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 4.0 MiB/s wr, 118 op/s 2024-09-19T05:45:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:33 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2165532641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:33.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:33 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:45:33.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:33 smithi082 ceph-mon[35195]: pgmap v1082: 129 pgs: 129 active+clean; 454 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 4.0 MiB/s wr, 118 op/s 2024-09-19T05:45:33.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:33 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2165532641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:33.761 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:33 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:45:33.836 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:33.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:33 smithi001 ceph-mon[30968]: pgmap v1082: 129 pgs: 129 active+clean; 454 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 4.0 MiB/s wr, 118 op/s 2024-09-19T05:45:33.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:33 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2165532641' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:33.844 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:33 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:45:34.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 -- 172.21.15.1:0/1711464804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac105ec0 msgr2=0x7f61ac106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 --2- 172.21.15.1:0/1711464804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac105ec0 0x7f61ac106340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f619c009890 tx=0x7f619c02a3b0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 -- 172.21.15.1:0/1711464804 shutdown_connections 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 --2- 172.21.15.1:0/1711464804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac105ec0 0x7f61ac106340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 --2- 172.21.15.1:0/1711464804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac1011e0 0x7f61ac105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 --2- 172.21.15.1:0/1711464804 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1008c0 0x7f61ac100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.418+0000 7f61b31de640 1 -- 172.21.15.1:0/1711464804 >> 172.21.15.1:0/1711464804 conn(0x7f61ac0fc7d0 msgr2=0x7f61ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.419+0000 7f61b31de640 1 -- 172.21.15.1:0/1711464804 shutdown_connections 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.419+0000 7f61b31de640 1 -- 172.21.15.1:0/1711464804 wait complete. 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.419+0000 7f61b31de640 1 Processor -- start 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.419+0000 7f61b31de640 1 -- start start 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1008c0 0x7f61ac072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac10e0c0 0x7f61ac1151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac1098c0 con 0x7f61ac1008c0 2024-09-19T05:45:34.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac109740 con 0x7f61ac1011e0 2024-09-19T05:45:34.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61b31de640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac109a40 con 0x7f61ac10e0c0 2024-09-19T05:45:34.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.420+0000 7f61abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56882/0 (socket says 172.21.15.1:56882) 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 -- 172.21.15.1:0/2354712257 learned_addr learned my addr 172.21.15.1:0/2354712257 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61b177b640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac10e0c0 0x7f61ac1151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 -- 172.21.15.1:0/2354712257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac10e0c0 msgr2=0x7f61ac1151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac10e0c0 0x7f61ac1151b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 -- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1008c0 msgr2=0x7f61ac072970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1008c0 0x7f61ac072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 -- 172.21.15.1:0/2354712257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac10e730 con 0x7f61ac1011e0 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.421+0000 7f61abfff640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61a401fbc0 tx=0x7f61a401d750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.422+0000 7f61a9ffb640 1 -- 172.21.15.1:0/2354712257 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a402c070 con 0x7f61ac1011e0 2024-09-19T05:45:34.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.423+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac10ea20 con 0x7f61ac1011e0 2024-09-19T05:45:34.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.423+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac19aa10 con 0x7f61ac1011e0 2024-09-19T05:45:34.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.423+0000 7f61a9ffb640 1 -- 172.21.15.1:0/2354712257 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61a401ca60 con 0x7f61ac1011e0 2024-09-19T05:45:34.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.425+0000 7f61a9ffb640 1 -- 172.21.15.1:0/2354712257 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4027cb0 con 0x7f61ac1011e0 2024-09-19T05:45:34.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.432+0000 7f61a9ffb640 1 -- 172.21.15.1:0/2354712257 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f61a402f070 con 0x7f61ac1011e0 2024-09-19T05:45:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.434+0000 7f61a9ffb640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 0x7f61980a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.434+0000 7f61a9ffb640 1 -- 172.21.15.1:0/2354712257 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f61a40e0c50 con 0x7f61ac1011e0 2024-09-19T05:45:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.435+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 0x7f61980a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.438+0000 7f61b55b7740 1 Processor -- start 2024-09-19T05:45:34.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.438+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 0x7f61980a5910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6194009710 tx=0x7f6194006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.440+0000 7f61b55b7740 1 -- start start 2024-09-19T05:45:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.440+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.440+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:55328/0 (socket says 172.21.15.1:55328) 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42950/0 (socket says 172.21.15.1:42950) 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b0f7a640 1 -- 172.21.15.1:0/2365954604 learned_addr learned my addr 172.21.15.1:0/2365954604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b55b7740 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d88e30c2a0 con 0x55d88e3a7080 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d88e2b3b10 con 0x55d88e3b1940 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b177b640 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.441+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d88e308260 con 0x55d88e3a6760 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.446+0000 7f61b0f7a640 1 -- 172.21.15.1:0/2365954604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 msgr2=0x55d88e3b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.446+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.446+0000 7f61b0f7a640 1 -- 172.21.15.1:0/2365954604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 msgr2=0x55d88e3b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.446+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.446+0000 7f61b0f7a640 1 -- 172.21.15.1:0/2365954604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e07db90 con 0x55d88e3a6760 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.447+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6194015890 tx=0x7f619400e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf136d892cadd76f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.448+0000 7f61a2ffd640 1 -- 172.21.15.1:0/2365954604 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194023070 con 0x55d88e3a6760 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.448+0000 7f61a2ffd640 1 -- 172.21.15.1:0/2365954604 <== mon.1 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f619400be60 con 0x55d88e3a6760 2024-09-19T05:45:34.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.448+0000 7f61a2ffd640 1 -- 172.21.15.1:0/2365954604 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194013cc0 con 0x55d88e3a6760 2024-09-19T05:45:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.449+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 msgr2=0x55d88e3a6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.449+0000 7f61b55b7740 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6194015890 tx=0x7f619400e000 comp rx=0 tx=0).stop 2024-09-19T05:45:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.450+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 shutdown_connections 2024-09-19T05:45:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.450+0000 7f61b55b7740 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.451+0000 7f61b55b7740 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.451+0000 7f61b55b7740 1 --2- 172.21.15.1:0/2365954604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3a6b40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.451+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 >> 172.21.15.1:0/2365954604 conn(0x55d88e3a2cf0 msgr2=0x55d88e3a30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.453+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 shutdown_connections 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.454+0000 7f61b55b7740 1 -- 172.21.15.1:0/2365954604 wait complete. 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.454+0000 7f61b55b7740 1 -- start start 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 Processor -- start 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d88e3b4560 con 0x55d88e3a7080 2024-09-19T05:45:34.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d88e2946e0 con 0x55d88e3b1940 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d88e3b46e0 con 0x55d88e3a6760 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.455+0000 7f61b55b7740 10 client.0 _ll_register_callbacks cb 0x55d88e2b8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.456+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.456+0000 7f61abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.456+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:55344/0 (socket says 172.21.15.1:55344) 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.456+0000 7f61b0f7a640 1 -- 172.21.15.1:0/1165189636 learned_addr learned my addr 172.21.15.1:0/1165189636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.456+0000 7f61abfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42962/0 (socket says 172.21.15.1:42962) 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b177b640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b0f7a640 1 -- 172.21.15.1:0/1165189636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 msgr2=0x55d88e3af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b0f7a640 1 -- 172.21.15.1:0/1165189636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 msgr2=0x55d88e3aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.458+0000 7f61b0f7a640 1 -- 172.21.15.1:0/1165189636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d88e3bdab0 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.460+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f619400bbb0 tx=0x7f619400bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879f90ffdb54ff03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.460+0000 7f618bfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.460+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194023040 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.460+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6194013900 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.461+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f619400be60 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.461+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6194036050 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.461+0000 7f61b55b7740 10 client.25729 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.461+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d88e3e2450 con 0x55d88e3a6760 2024-09-19T05:45:34.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.461+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f619400be60 con 0x55d88e3a6760 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6194031030 con 0x55d88e3a6760 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 10 client.25729 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 10 client.25729 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 20 client.25729 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e3e3c70 0x55d88e3e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 4 client.25729 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d88e3199d0 con 0x55d88e3e3c70 2024-09-19T05:45:34.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.462+0000 7f61abfff640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e3e3c70 0x55d88e3e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.463+0000 7f61abfff640 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e3e3c70 0x55d88e3e60d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e7e0eff52446fe server_cookie=dbe38361fc02925e in_seq=0 out_seq=0 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.463+0000 7f618bfff640 10 client.25729 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.464+0000 7f618bfff640 1 -- 172.21.15.1:0/1165189636 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d88e3199d0 con 0x55d88e3e3c70 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.464+0000 7f618bfff640 10 client.25729 handle_command_reply: tid=0 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.464+0000 7f61b55b7740 1 client.25729 shutdown 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.464+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 msgr2=0x55d88e3ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.464+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f619400bbb0 tx=0x7f619400bbe0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 shutdown_connections 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3b1940 0x55d88e3af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3a7080 0x55d88e3aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e3e3c70 0x55d88e3e60d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1165189636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ae7f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 >> 172.21.15.1:0/1165189636 conn(0x55d88e3a2cf0 msgr2=0x55d88e3a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.465+0000 7f618bfff640 0 client.25729 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.466+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 shutdown_connections 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.466+0000 7f61b55b7740 1 -- 172.21.15.1:0/1165189636 wait complete. 2024-09-19T05:45:34.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.466+0000 7f61b55b7740 20 client.25729 trim_cache size 0 max 16384 2024-09-19T05:45:34.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b55b7740 1 Processor -- start 2024-09-19T05:45:34.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b55b7740 1 -- start start 2024-09-19T05:45:34.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:45:34.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:45:34.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.499+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:55358/0 (socket says 172.21.15.1:55358) 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56904/0 (socket says 172.21.15.1:56904) 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61b0f7a640 1 -- 172.21.15.1:0/1229408977 learned_addr learned my addr 172.21.15.1:0/1229408977 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f618c00dc50 con 0x55d88e3b1940 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0104d0 con 0x55d88e3a7080 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.500+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f618c00e2c0 con 0x55d88e3a6760 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61b177b640 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61abfff640 1 -- 172.21.15.1:0/1229408977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 msgr2=0x55d88e3ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61abfff640 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61abfff640 1 -- 172.21.15.1:0/1229408977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 msgr2=0x55d88e3eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61abfff640 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3eb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.501+0000 7f61abfff640 1 -- 172.21.15.1:0/1229408977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d88e3a2b20 con 0x55d88e3a7080 2024-09-19T05:45:34.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.502+0000 7f61abfff640 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61a401dc50 tx=0x7f61a4033040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ddf7e0a401a914d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.502+0000 7f61a27fc640 1 -- 172.21.15.1:0/1229408977 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a40cb070 con 0x55d88e3a7080 2024-09-19T05:45:34.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.502+0000 7f61a27fc640 1 -- 172.21.15.1:0/1229408977 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61a4027e50 con 0x55d88e3a7080 2024-09-19T05:45:34.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.502+0000 7f61a27fc640 1 -- 172.21.15.1:0/1229408977 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a401cc10 con 0x55d88e3a7080 2024-09-19T05:45:34.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.503+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 msgr2=0x55d88e3af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.503+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61a401dc50 tx=0x7f61a4033040 comp rx=0 tx=0).stop 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.503+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 shutdown_connections 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.503+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.504+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a7080 0x55d88e3af0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.504+0000 7f61b55b7740 1 --2- 172.21.15.1:0/1229408977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a6760 0x55d88e3ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.504+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 >> 172.21.15.1:0/1229408977 conn(0x55d88e3a2cf0 msgr2=0x55d88e3b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.504+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 shutdown_connections 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.504+0000 7f61b55b7740 1 -- 172.21.15.1:0/1229408977 wait complete. 2024-09-19T05:45:34.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.505+0000 7f61b55b7740 1 -- start start 2024-09-19T05:45:34.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.505+0000 7f61b55b7740 1 Processor -- start 2024-09-19T05:45:34.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 0x55d88e3b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b55b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 0x55d88e3ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 0x55d88e3b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b0f7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 0x55d88e3b9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:56916/0 (socket says 172.21.15.1:56916) 2024-09-19T05:45:34.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b0f7a640 1 -- 172.21.15.1:0/3001161196 learned_addr learned my addr 172.21.15.1:0/3001161196 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:34.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61abfff640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 0x55d88e3ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.506+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3ab040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.507+0000 7f61b177b640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.507+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f618c00e990 con 0x55d88e3b1940 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.507+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f618c00fe00 con 0x55d88e3a6760 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.507+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f618c00f060 con 0x55d88e3a7080 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.507+0000 7f61b55b7740 10 client.0 _ll_register_callbacks cb 0x7f6194015760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:34.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.508+0000 7f61abfff640 1 -- 172.21.15.1:0/3001161196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 msgr2=0x55d88e3b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.508+0000 7f61abfff640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 0x55d88e3b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.508+0000 7f61abfff640 1 -- 172.21.15.1:0/3001161196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 msgr2=0x55d88e3ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.508+0000 7f61abfff640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.508+0000 7f61abfff640 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d88e3a95d0 con 0x55d88e3a7080 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.509+0000 7f61abfff640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 0x55d88e3ba1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55d88e3e3bc0 tx=0x7f61a40aafc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe4270ceff1ae44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.509+0000 7f618bfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mon.1 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a40b9020 con 0x55d88e3a7080 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mon.1 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f61a401cc10 con 0x55d88e3a7080 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a4027e50 con 0x55d88e3a7080 2024-09-19T05:45:34.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mon.1 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f61a40cb040 con 0x55d88e3a7080 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f61b55b7740 10 client.25735 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.510+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d88e44e2b0 con 0x55d88e3a7080 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mon.1 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61a4027e50 con 0x55d88e3a7080 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mon.1 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f61a408bb60 con 0x55d88e3a7080 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f61b55b7740 10 client.25735 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f61b55b7740 10 client.25735 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:34.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f61b55b7740 20 client.25735 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.511+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e44e9d0 0x55d88e450df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.512+0000 7f61b55b7740 4 client.25735 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}] 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.512+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.5, "await_for": 45.0}) -- 0x55d88e313d20 con 0x55d88e44e9d0 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.512+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e44e9d0 0x55d88e450df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.512+0000 7f61b0f7a640 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e44e9d0 0x55d88e450df0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dea035a055cb869 server_cookie=f4eac10a6ca7f9e5 in_seq=0 out_seq=0 2024-09-19T05:45:34.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:34.512+0000 7f618bfff640 10 client.25735 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:34.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198466 16.44 MB/sec execute 529 sec latency 463.245 ms 2024-09-19T05:45:34.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:45:34.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:45:34.751 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:45:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:45:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:45:34.758 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:45:35.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198469 16.41 MB/sec execute 530 sec latency 1230.579 ms 2024-09-19T05:45:35.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f618bfff640 1 -- 172.21.15.1:0/3001161196 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d88e313d20 con 0x55d88e44e9d0 2024-09-19T05:45:35.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f618bfff640 10 client.25735 handle_command_reply: tid=0 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 client.25735 shutdown 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 msgr2=0x55d88e3ba1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 0x55d88e3ba1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55d88e3e3bc0 tx=0x7f61a40aafc0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 shutdown_connections 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d88e3b1940 0x55d88e3ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.715+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55d88e44e9d0 0x55d88e450df0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d88e3a7080 0x55d88e3ba1b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f618bfff640 0 client.25735 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 1 --2- 172.21.15.1:0/3001161196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d88e3a6760 0x55d88e3b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 >> 172.21.15.1:0/3001161196 conn(0x55d88e3a2cf0 msgr2=0x55d88e3b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 shutdown_connections 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 1 -- 172.21.15.1:0/3001161196 wait complete. 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.716+0000 7f61b55b7740 20 client.25735 trim_cache size 0 max 16384 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:45:35.719 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 86, 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "ad93ad5b": { 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 86, 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:35.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 138.5, 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:35.721 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:35.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:35.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:35.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:35.722 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 msgr2=0x7f61980a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 0x7f61980a5910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6194009710 tx=0x7f6194006c90 comp rx=0 tx=0).stop 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 msgr2=0x7f61ac072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f61a401fbc0 tx=0x7f61a401d750 comp rx=0 tx=0).stop 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 shutdown_connections 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f61980a3450 0x7f61980a5910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61ac10e0c0 0x7f61ac1151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61ac1011e0 0x7f61ac072eb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 --2- 172.21.15.1:0/2354712257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1008c0 0x7f61ac072970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 >> 172.21.15.1:0/2354712257 conn(0x7f61ac0fc7d0 msgr2=0x7f61ac0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 shutdown_connections 2024-09-19T05:45:35.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:35.719+0000 7f61b31de640 1 -- 172.21.15.1:0/2354712257 wait complete. 2024-09-19T05:45:36.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:35 smithi060 ceph-mon[35058]: pgmap v1083: 129 pgs: 129 active+clean; 449 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 4.1 MiB/s wr, 156 op/s 2024-09-19T05:45:36.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:35 smithi082 ceph-mon[35195]: pgmap v1083: 129 pgs: 129 active+clean; 449 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 4.1 MiB/s wr, 156 op/s 2024-09-19T05:45:36.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:35 smithi001 ceph-mon[30968]: pgmap v1083: 129 pgs: 129 active+clean; 449 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 4.1 MiB/s wr, 156 op/s 2024-09-19T05:45:36.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.38 MB/sec execute 531 sec latency 2116.243 ms 2024-09-19T05:45:36.669 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ad93ad5b', quiesce took 5.2 seconds. Will release after: 13.3 2024-09-19T05:45:37.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.35 MB/sec execute 532 sec latency 3116.307 ms 2024-09-19T05:45:38.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:37 smithi060 ceph-mon[35058]: pgmap v1084: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2024-09-19T05:45:38.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:37 smithi082 ceph-mon[35195]: pgmap v1084: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2024-09-19T05:45:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:37 smithi001 ceph-mon[30968]: pgmap v1084: 129 pgs: 129 active+clean; 445 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 218 op/s 2024-09-19T05:45:38.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.31 MB/sec execute 533 sec latency 4116.413 ms 2024-09-19T05:45:39.665 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.28 MB/sec execute 534 sec latency 5116.443 ms 2024-09-19T05:45:40.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:39 smithi060 ceph-mon[35058]: pgmap v1085: 129 pgs: 129 active+clean; 444 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-09-19T05:45:40.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:39 smithi082 ceph-mon[35195]: pgmap v1085: 129 pgs: 129 active+clean; 444 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-09-19T05:45:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:39 smithi001 ceph-mon[30968]: pgmap v1085: 129 pgs: 129 active+clean; 444 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 227 op/s 2024-09-19T05:45:40.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.25 MB/sec execute 535 sec latency 6116.548 ms 2024-09-19T05:45:41.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.22 MB/sec execute 536 sec latency 7116.676 ms 2024-09-19T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:41 smithi060 ceph-mon[35058]: pgmap v1086: 129 pgs: 129 active+clean; 448 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 256 op/s 2024-09-19T05:45:42.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:41 smithi082 ceph-mon[35195]: pgmap v1086: 129 pgs: 129 active+clean; 448 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 256 op/s 2024-09-19T05:45:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:41 smithi001 ceph-mon[30968]: pgmap v1086: 129 pgs: 129 active+clean; 448 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 256 op/s 2024-09-19T05:45:42.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.19 MB/sec execute 537 sec latency 8116.792 ms 2024-09-19T05:45:43.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.16 MB/sec execute 538 sec latency 9116.916 ms 2024-09-19T05:45:44.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:43 smithi060 ceph-mon[35058]: pgmap v1087: 129 pgs: 129 active+clean; 452 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 254 op/s 2024-09-19T05:45:44.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:43 smithi082 ceph-mon[35195]: pgmap v1087: 129 pgs: 129 active+clean; 452 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 254 op/s 2024-09-19T05:45:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:43 smithi001 ceph-mon[30968]: pgmap v1087: 129 pgs: 129 active+clean; 452 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 254 op/s 2024-09-19T05:45:44.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.13 MB/sec execute 539 sec latency 10117.010 ms 2024-09-19T05:45:45.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.10 MB/sec execute 540 sec latency 11117.125 ms 2024-09-19T05:45:46.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:45 smithi060 ceph-mon[35058]: pgmap v1088: 129 pgs: 129 active+clean; 459 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-09-19T05:45:46.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:45 smithi082 ceph-mon[35195]: pgmap v1088: 129 pgs: 129 active+clean; 459 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-09-19T05:45:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:45 smithi001 ceph-mon[30968]: pgmap v1088: 129 pgs: 129 active+clean; 459 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.5 MiB/s wr, 236 op/s 2024-09-19T05:45:46.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.07 MB/sec execute 541 sec latency 12117.253 ms 2024-09-19T05:45:47.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.04 MB/sec execute 542 sec latency 13117.375 ms 2024-09-19T05:45:48.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:47 smithi060 ceph-mon[35058]: pgmap v1089: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 219 op/s 2024-09-19T05:45:48.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:47 smithi082 ceph-mon[35195]: pgmap v1089: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 219 op/s 2024-09-19T05:45:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:47 smithi001 ceph-mon[30968]: pgmap v1089: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 219 op/s 2024-09-19T05:45:48.666 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 16.01 MB/sec execute 543 sec latency 14117.479 ms 2024-09-19T05:45:49.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 15.98 MB/sec execute 544 sec latency 15117.598 ms 2024-09-19T05:45:49.970 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:45:50.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:49 smithi060 ceph-mon[35058]: pgmap v1090: 129 pgs: 129 active+clean; 438 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:45:50.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:49 smithi001 ceph-mon[30968]: pgmap v1090: 129 pgs: 129 active+clean; 438 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:45:50.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:49 smithi082 ceph-mon[35195]: pgmap v1090: 129 pgs: 129 active+clean; 438 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2024-09-19T05:45:50.248 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:50.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 15.96 MB/sec execute 545 sec latency 16117.656 ms 2024-09-19T05:45:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/1852106039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 msgr2=0x7f8dc410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/1852106039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc410ea90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009ca0 tx=0x7f8dbc02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/1852106039 shutdown_connections 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/1852106039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc410ea90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/1852106039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 0x7f8dc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/1852106039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 0x7f8dc41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/1852106039 >> 172.21.15.1:0/1852106039 conn(0x7f8dc40fd8c0 msgr2=0x7f8dc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/1852106039 shutdown_connections 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.713+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/1852106039 wait complete. 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 Processor -- start 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 -- start start 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 0x7f8dc4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 0x7f8dc4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4111f70 con 0x7f8dc4106f10 2024-09-19T05:45:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4111df0 con 0x7f8dc4101de0 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc8ad9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41120f0 con 0x7f8dc4102790 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56782/0 (socket says 172.21.15.1:56782) 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 0x7f8dc4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc2d9d640 1 -- 172.21.15.1:0/2203969422 learned_addr learned my addr 172.21.15.1:0/2203969422 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.714+0000 7f8dc1d9b640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 0x7f8dc4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 -- 172.21.15.1:0/2203969422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 msgr2=0x7f8dc4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 0x7f8dc4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 -- 172.21.15.1:0/2203969422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 msgr2=0x7f8dc4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 0x7f8dc4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 -- 172.21.15.1:0/2203969422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc419d2e0 con 0x7f8dc4106f10 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.715+0000 7f8dc2d9d640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc031a60 tx=0x7f8dbc031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.717+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc003b70 con 0x7f8dc4106f10 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.717+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dbc003d10 con 0x7f8dc4106f10 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.717+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004770 con 0x7f8dc4106f10 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.717+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc419d570 con 0x7f8dc4106f10 2024-09-19T05:45:50.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.717+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc41a4eb0 con 0x7f8dc4106f10 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.718+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc41032c0 con 0x7f8dc4106f10 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.719+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8dbc02f790 con 0x7f8dc4106f10 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.720+0000 7f8db37fe640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 0x7f8dac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.720+0000 7f8dc259c640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 0x7f8dac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.720+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f8dbc0f0f50 con 0x7f8dc4106f10 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.720+0000 7f8dc259c640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 0x7f8dac0a5780 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8db400abe0 tx=0x7f8db400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:50.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.724+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dbc0bd860 con 0x7f8dc4106f10 2024-09-19T05:45:50.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.936+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dc410a0f0 con 0x7f8dc4106f10 2024-09-19T05:45:50.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.937+0000 7f8db37fe640 1 -- 172.21.15.1:0/2203969422 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f8dbc0bd160 con 0x7f8dc4106f10 2024-09-19T05:45:50.940 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:45:50.940 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:45:50.941 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.939+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 msgr2=0x7f8dac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 0x7f8dac0a5780 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8db400abe0 tx=0x7f8db400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 msgr2=0x7f8dc419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc031a60 tx=0x7f8dbc031a90 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 shutdown_connections 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f8dac0a32c0 0x7f8dac0a5780 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8dc4106f10 0x7f8dc419cc00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc4102790 0x7f8dc4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 --2- 172.21.15.1:0/2203969422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dc4101de0 0x7f8dc4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:50.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 >> 172.21.15.1:0/2203969422 conn(0x7f8dc40fd8c0 msgr2=0x7f8dc40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 shutdown_connections 2024-09-19T05:45:50.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:50.940+0000 7f8dc8ad9640 1 -- 172.21.15.1:0/2203969422 wait complete. 2024-09-19T05:45:51.659 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --set-id ad93ad5b --release --await' 2024-09-19T05:45:51.659 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --set-id ad93ad5b --release --await 2024-09-19T05:45:51.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 15.93 MB/sec execute 546 sec latency 17117.952 ms 2024-09-19T05:45:51.936 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:45:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:51 smithi060 ceph-mon[35058]: pgmap v1091: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2024-09-19T05:45:52.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:51 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2203969422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:51 smithi082 ceph-mon[35195]: pgmap v1091: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2024-09-19T05:45:52.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:51 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2203969422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:52.058 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:51 smithi001 ceph-mon[30968]: pgmap v1091: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2024-09-19T05:45:52.059 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:51 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2203969422' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:45:52.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198477 15.90 MB/sec execute 547 sec latency 18118.000 ms 2024-09-19T05:45:52.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/180758359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68100a80 msgr2=0x7f7f68100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/180758359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68100a80 0x7f7f68100ee0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009930 tx=0x7f7f5c02a420 comp rx=0 tx=0).stop 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/180758359 shutdown_connections 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/180758359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68101420 0x7f7f6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/180758359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68100a80 0x7f7f68100ee0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/180758359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68106a80 0x7f7f68106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/180758359 >> 172.21.15.1:0/180758359 conn(0x7f7f680fc7a0 msgr2=0x7f7f680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.689+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/180758359 shutdown_connections 2024-09-19T05:45:52.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.690+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/180758359 wait complete. 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.690+0000 7f7f6cd9b640 1 Processor -- start 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.690+0000 7f7f6cd9b640 1 -- start start 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.690+0000 7f7f6cd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68100a80 0x7f7f680fce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68101420 0x7f7f680fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68110e80 con 0x7f7f68106a80 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68110d00 con 0x7f7f68100a80 2024-09-19T05:45:52.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68111000 con 0x7f7f68101420 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56808/0 (socket says 172.21.15.1:56808) 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 -- 172.21.15.1:0/1069559902 learned_addr learned my addr 172.21.15.1:0/1069559902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6659c640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68100a80 0x7f7f680fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68101420 0x7f7f680fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 -- 172.21.15.1:0/1069559902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68101420 msgr2=0x7f7f680fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68101420 0x7f7f680fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 -- 172.21.15.1:0/1069559902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68100a80 msgr2=0x7f7f680fce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68100a80 0x7f7f680fce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 -- 172.21.15.1:0/1069559902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681a6980 con 0x7f7f68106a80 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f66d9d640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000eaa0 tx=0x7f7f6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f577fe640 1 -- 172.21.15.1:0/1069559902 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000cdb0 con 0x7f7f68106a80 2024-09-19T05:45:52.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f577fe640 1 -- 172.21.15.1:0/1069559902 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f60005020 con 0x7f7f68106a80 2024-09-19T05:45:52.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f681a6c70 con 0x7f7f68106a80 2024-09-19T05:45:52.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.691+0000 7f7f577fe640 1 -- 172.21.15.1:0/1069559902 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f600116b0 con 0x7f7f68106a80 2024-09-19T05:45:52.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.692+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f681a71b0 con 0x7f7f68106a80 2024-09-19T05:45:52.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.694+0000 7f7f577fe640 1 -- 172.21.15.1:0/1069559902 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7f60005560 con 0x7f7f68106a80 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.694+0000 7f7f6f174740 1 Processor -- start 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.694+0000 7f7f6f174740 1 -- start start 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda7194440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda719f240 0x55eda71a1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eda70f9620 con 0x55eda7194980 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55eda70a0e50 con 0x55eda7194060 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6f174740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eda70f55e0 con 0x55eda719f240 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f65d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda7194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f577fe640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 0x7f7f500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56818/0 (socket says 172.21.15.1:56818) 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 -- 172.21.15.1:0/3459424801 learned_addr learned my addr 172.21.15.1:0/3459424801 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda719f240 0x55eda71a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f66d9d640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 0x7f7f500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f577fe640 1 -- 172.21.15.1:0/1069559902 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f7f600cfef0 con 0x7f7f68106a80 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 -- 172.21.15.1:0/3459424801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda719f240 msgr2=0x55eda71a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda719f240 0x55eda71a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 -- 172.21.15.1:0/3459424801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 msgr2=0x55eda7194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda7194440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f6659c640 1 -- 172.21.15.1:0/3459424801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda7091d40 con 0x55eda7194980 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.695+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda7194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f6659c640 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009ca0 tx=0x7f7f58011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46299e21942ee24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f66d9d640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 0x7f7f500a5780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f60098560 tx=0x7f7f600bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f54ff9640 1 -- 172.21.15.1:0/3459424801 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5801e070 con 0x55eda7194980 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f54ff9640 1 -- 172.21.15.1:0/3459424801 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f58019b10 con 0x55eda7194980 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f54ff9640 1 -- 172.21.15.1:0/3459424801 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5800eaa0 con 0x55eda7194980 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f6f174740 1 -- 172.21.15.1:0/3459424801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 msgr2=0x55eda719ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.696+0000 7f7f6f174740 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009ca0 tx=0x7f7f58011810 comp rx=0 tx=0).stop 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- 172.21.15.1:0/3459424801 shutdown_connections 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda719f240 0x55eda71a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719ed00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- 172.21.15.1:0/3459424801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda7194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- 172.21.15.1:0/3459424801 >> 172.21.15.1:0/3459424801 conn(0x55eda71905f0 msgr2=0x55eda71909d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- 172.21.15.1:0/3459424801 shutdown_connections 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- 172.21.15.1:0/3459424801 wait complete. 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- start start 2024-09-19T05:45:52.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 Processor -- start 2024-09-19T05:45:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194060 0x55eda719c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda719cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eda71a1e10 con 0x55eda7194980 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55eda7081f10 con 0x55eda719f240 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55eda71a1f90 con 0x55eda7194060 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.697+0000 7f7f6f174740 10 client.0 _ll_register_callbacks cb 0x55eda70a5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56832/0 (socket says 172.21.15.1:56832) 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 -- 172.21.15.1:0/75191720 learned_addr learned my addr 172.21.15.1:0/75191720 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194060 0x55eda719c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda719cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 -- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194060 msgr2=0x55eda719c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194060 0x55eda719c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 -- 172.21.15.1:0/75191720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 msgr2=0x55eda719cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda719cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 -- 172.21.15.1:0/75191720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda6e08580 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6659c640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009c70 tx=0x7f7f58019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70707dba10de0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5801e070 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f7f58004020 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.698+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f58019b10 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f58030050 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 10 client.16233 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55eda6ed2960 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f58019b10 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f5800e7e0 con 0x55eda7194980 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 10 client.16233 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 10 client.16233 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:52.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 20 client.16233 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda71aedd0 0x55eda71b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 4 client.16233 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.699+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eda7106b90 con 0x55eda71aedd0 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.700+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda71aedd0 0x55eda71b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.700+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda71aedd0 0x55eda71b11c0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56eb2ffa798a6daa server_cookie=1033e9b73f9ac7d1 in_seq=0 out_seq=0 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.700+0000 7f7f4dffb640 10 client.16233 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f4dffb640 1 -- 172.21.15.1:0/75191720 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eda7106b90 con 0x55eda71aedd0 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f4dffb640 10 client.16233 handle_command_reply: tid=0 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 client.16233 shutdown 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 msgr2=0x55eda719c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009c70 tx=0x7f7f58019660 comp rx=0 tx=0).stop 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 shutdown_connections 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda719cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194980 0x55eda719c6c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda71aedd0 0x55eda71b11c0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 --2- 172.21.15.1:0/75191720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194060 0x55eda719c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 >> 172.21.15.1:0/75191720 conn(0x55eda71905f0 msgr2=0x55eda718f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f4dffb640 0 client.16233 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 shutdown_connections 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 1 -- 172.21.15.1:0/75191720 wait complete. 2024-09-19T05:45:52.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.701+0000 7f7f6f174740 20 client.16233 trim_cache size 0 max 16384 2024-09-19T05:45:52.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.718+0000 7f7f6f174740 1 Processor -- start 2024-09-19T05:45:52.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.718+0000 7f7f6f174740 1 -- start start 2024-09-19T05:45:52.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71b6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda71b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681af080 con 0x55eda7194060 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681b1900 con 0x55eda719f240 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6f174740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681af6f0 con 0x55eda7194980 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56844/0 (socket says 172.21.15.1:56844) 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 -- 172.21.15.1:0/2804158562 learned_addr learned my addr 172.21.15.1:0/2804158562 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f6659c640 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda71b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 -- 172.21.15.1:0/2804158562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 msgr2=0x55eda71b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71b6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 -- 172.21.15.1:0/2804158562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 msgr2=0x55eda71b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda71b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 -- 172.21.15.1:0/2804158562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda7197d70 con 0x55eda7194060 2024-09-19T05:45:52.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c001eb0 tx=0x7f7f5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8d9c5255f13f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f4ffff640 1 -- 172.21.15.1:0/2804158562 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c050070 con 0x55eda7194060 2024-09-19T05:45:52.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.719+0000 7f7f4ffff640 1 -- 172.21.15.1:0/2804158562 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c0035f0 con 0x55eda7194060 2024-09-19T05:45:52.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f4ffff640 1 -- 172.21.15.1:0/2804158562 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c035040 con 0x55eda7194060 2024-09-19T05:45:52.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 -- 172.21.15.1:0/2804158562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 msgr2=0x55eda719b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c001eb0 tx=0x7f7f5c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 -- 172.21.15.1:0/2804158562 shutdown_connections 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda719f240 0x55eda71b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 --2- 172.21.15.1:0/2804158562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda7194060 0x55eda719b030 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 -- 172.21.15.1:0/2804158562 >> 172.21.15.1:0/2804158562 conn(0x55eda71905f0 msgr2=0x55eda719a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 -- 172.21.15.1:0/2804158562 shutdown_connections 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.720+0000 7f7f6f174740 1 -- 172.21.15.1:0/2804158562 wait complete. 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 -- start start 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 Processor -- start 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda71a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681afdc0 con 0x55eda719f240 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681b1230 con 0x55eda7194060 2024-09-19T05:45:52.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681b0490 con 0x55eda7194980 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6f174740 10 client.0 _ll_register_callbacks cb 0x7f7f5c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56860/0 (socket says 172.21.15.1:56860) 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 -- 172.21.15.1:0/841580003 learned_addr learned my addr 172.21.15.1:0/841580003 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f6659c640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda71a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 -- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 msgr2=0x55eda71a34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71a34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.721+0000 7f7f65d9b640 1 -- 172.21.15.1:0/841580003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 msgr2=0x55eda71a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda71a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f65d9b640 1 -- 172.21.15.1:0/841580003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda7218920 con 0x55eda719f240 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6659c640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:45:52.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f65d9b640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c032d30 tx=0x7f7f5c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cc505f68317395 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c035070 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f7f5c0037a0 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5c0035f0 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c062050 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6f174740 10 client.16239 fetch_fsmap learned FSMap version 21 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55eda7219c40 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c0035f0 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f5c056070 con 0x55eda719f240 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6f174740 10 client.16239 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.722+0000 7f7f6f174740 10 client.16239 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6f174740 20 client.16239 populate_metadata read hostname 'smithi001' 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda721a200 0x55eda721c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:45:52.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6f174740 4 client.16239 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ad93ad5b", "release": true, "await": true}] 2024-09-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ad93ad5b", "release": true, "await": true}) -- 0x55eda71010a0 con 0x55eda721a200 2024-09-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6659c640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda721a200 0x55eda721c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f6659c640 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda721a200 0x55eda721c620 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3e285c689f2984c server_cookie=bbceec55acc320b2 in_seq=0 out_seq=0 2024-09-19T05:45:52.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.723+0000 7f7f4dffb640 10 client.16239 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f4dffb640 1 -- 172.21.15.1:0/841580003 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eda71010a0 con 0x55eda721a200 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f4dffb640 10 client.16239 handle_command_reply: tid=0 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 client.16239 shutdown 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 msgr2=0x55eda71a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c032d30 tx=0x7f7f5c003f90 comp rx=0 tx=0).stop 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 shutdown_connections 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eda719f240 0x55eda71a39e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55eda721a200 0x55eda721c620 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55eda7194980 0x55eda71a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f4dffb640 0 client.16239 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:45:52.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 --2- 172.21.15.1:0/841580003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55eda7194060 0x55eda71a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 >> 172.21.15.1:0/841580003 conn(0x55eda71905f0 msgr2=0x55eda7196240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.794+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 shutdown_connections 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6f174740 1 -- 172.21.15.1:0/841580003 wait complete. 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6f174740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 88, 2024-09-19T05:45:52.798 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "ad93ad5b": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 88, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 138.5, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T05:45:52.799 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:45:52.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 msgr2=0x7f7f500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 0x7f7f500a5780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f60098560 tx=0x7f7f600bc040 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 msgr2=0x7f7f680fd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000eaa0 tx=0x7f7f6000ef60 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 shutdown_connections 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f7f500a32c0 0x7f7f500a5780 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f68106a80 0x7f7f680fd880 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f68101420 0x7f7f680fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 --2- 172.21.15.1:0/1069559902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f68100a80 0x7f7f680fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 >> 172.21.15.1:0/1069559902 conn(0x7f7f680fc7a0 msgr2=0x7f7f6806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 shutdown_connections 2024-09-19T05:45:52.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:45:52.795+0000 7f7f6cd9b640 1 -- 172.21.15.1:0/1069559902 wait complete. 2024-09-19T05:45:53.621 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ad93ad5b', total seconds elapsed: 22.1 2024-09-19T05:45:53.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 198788 15.90 MB/sec execute 548 sec latency 18243.785 ms 2024-09-19T05:45:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:53 smithi001 ceph-mon[30968]: pgmap v1092: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.2 MiB/s wr, 94 op/s 2024-09-19T05:45:54.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:53 smithi060 ceph-mon[35058]: pgmap v1092: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.2 MiB/s wr, 94 op/s 2024-09-19T05:45:54.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:53 smithi082 ceph-mon[35195]: pgmap v1092: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.2 MiB/s wr, 94 op/s 2024-09-19T05:45:54.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 199191 15.90 MB/sec execute 549 sec latency 63.532 ms 2024-09-19T05:45:55.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 199530 15.90 MB/sec execute 550 sec latency 92.501 ms 2024-09-19T05:45:56.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:55 smithi060 ceph-mon[35058]: pgmap v1093: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:45:56.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:55 smithi082 ceph-mon[35195]: pgmap v1093: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:45:56.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:55 smithi001 ceph-mon[30968]: pgmap v1093: 129 pgs: 129 active+clean; 437 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:45:56.671 INFO:tasks.workunit.client.0.smithi001.stdout: 10 199933 15.91 MB/sec execute 551 sec latency 95.642 ms 2024-09-19T05:45:57.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 200503 15.94 MB/sec execute 552 sec latency 50.423 ms 2024-09-19T05:45:58.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:57 smithi060 ceph-mon[35058]: pgmap v1094: 129 pgs: 129 active+clean; 435 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-09-19T05:45:58.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:57 smithi082 ceph-mon[35195]: pgmap v1094: 129 pgs: 129 active+clean; 435 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-09-19T05:45:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:57 smithi001 ceph-mon[30968]: pgmap v1094: 129 pgs: 129 active+clean; 435 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-09-19T05:45:58.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 200944 15.95 MB/sec execute 553 sec latency 109.439 ms 2024-09-19T05:45:59.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 201434 15.98 MB/sec execute 554 sec latency 57.035 ms 2024-09-19T05:46:00.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:45:59 smithi060 ceph-mon[35058]: pgmap v1095: 129 pgs: 129 active+clean; 433 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-09-19T05:46:00.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:45:59 smithi082 ceph-mon[35195]: pgmap v1095: 129 pgs: 129 active+clean; 433 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-09-19T05:46:00.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:45:59 smithi001 ceph-mon[30968]: pgmap v1095: 129 pgs: 129 active+clean; 433 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-09-19T05:46:00.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 201824 16.00 MB/sec execute 555 sec latency 74.252 ms 2024-09-19T05:46:01.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 202211 16.00 MB/sec execute 556 sec latency 70.700 ms 2024-09-19T05:46:02.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:01 smithi060 ceph-mon[35058]: pgmap v1096: 129 pgs: 129 active+clean; 418 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 923 KiB/s wr, 96 op/s 2024-09-19T05:46:02.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:01 smithi082 ceph-mon[35195]: pgmap v1096: 129 pgs: 129 active+clean; 418 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 923 KiB/s wr, 96 op/s 2024-09-19T05:46:02.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:01 smithi001 ceph-mon[30968]: pgmap v1096: 129 pgs: 129 active+clean; 418 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 923 KiB/s wr, 96 op/s 2024-09-19T05:46:02.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 202590 16.01 MB/sec execute 557 sec latency 81.105 ms 2024-09-19T05:46:03.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 203048 16.01 MB/sec execute 558 sec latency 75.618 ms 2024-09-19T05:46:04.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:03 smithi060 ceph-mon[35058]: pgmap v1097: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-19T05:46:04.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:03 smithi082 ceph-mon[35195]: pgmap v1097: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-19T05:46:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:03 smithi001 ceph-mon[30968]: pgmap v1097: 129 pgs: 129 active+clean; 425 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 179 op/s 2024-09-19T05:46:04.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 203509 16.03 MB/sec execute 559 sec latency 97.579 ms 2024-09-19T05:46:05.667 INFO:tasks.workunit.client.0.smithi001.stdout: 10 203966 16.04 MB/sec execute 560 sec latency 165.639 ms 2024-09-19T05:46:06.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:05 smithi060 ceph-mon[35058]: pgmap v1098: 129 pgs: 129 active+clean; 430 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2024-09-19T05:46:06.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:05 smithi082 ceph-mon[35195]: pgmap v1098: 129 pgs: 129 active+clean; 430 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2024-09-19T05:46:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:05 smithi001 ceph-mon[30968]: pgmap v1098: 129 pgs: 129 active+clean; 430 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 2.0 MiB/s wr, 233 op/s 2024-09-19T05:46:06.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 204417 16.07 MB/sec execute 561 sec latency 131.158 ms 2024-09-19T05:46:07.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 204946 16.09 MB/sec execute 562 sec latency 38.212 ms 2024-09-19T05:46:08.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:07 smithi060 ceph-mon[35058]: pgmap v1099: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-19T05:46:08.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:07 smithi082 ceph-mon[35195]: pgmap v1099: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-19T05:46:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:07 smithi001 ceph-mon[30968]: pgmap v1099: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-19T05:46:08.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 205290 16.11 MB/sec execute 563 sec latency 181.464 ms 2024-09-19T05:46:09.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 205684 16.11 MB/sec execute 564 sec latency 84.014 ms 2024-09-19T05:46:10.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:09 smithi060 ceph-mon[35058]: pgmap v1100: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-09-19T05:46:10.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:09 smithi082 ceph-mon[35195]: pgmap v1100: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-09-19T05:46:10.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:09 smithi001 ceph-mon[30968]: pgmap v1100: 129 pgs: 129 active+clean; 445 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.8 MiB/s wr, 269 op/s 2024-09-19T05:46:10.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 206011 16.11 MB/sec execute 565 sec latency 96.032 ms 2024-09-19T05:46:11.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 206429 16.11 MB/sec execute 566 sec latency 90.287 ms 2024-09-19T05:46:12.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:11 smithi060 ceph-mon[35058]: pgmap v1101: 129 pgs: 129 active+clean; 449 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.4 MiB/s wr, 300 op/s 2024-09-19T05:46:12.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:11 smithi082 ceph-mon[35195]: pgmap v1101: 129 pgs: 129 active+clean; 449 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.4 MiB/s wr, 300 op/s 2024-09-19T05:46:12.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:11 smithi001 ceph-mon[30968]: pgmap v1101: 129 pgs: 129 active+clean; 449 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.4 MiB/s wr, 300 op/s 2024-09-19T05:46:12.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 206867 16.13 MB/sec execute 567 sec latency 51.710 ms 2024-09-19T05:46:13.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 207400 16.14 MB/sec execute 568 sec latency 88.730 ms 2024-09-19T05:46:14.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:13 smithi060 ceph-mon[35058]: pgmap v1102: 129 pgs: 129 active+clean; 443 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-09-19T05:46:14.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:13 smithi082 ceph-mon[35195]: pgmap v1102: 129 pgs: 129 active+clean; 443 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-09-19T05:46:14.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:13 smithi001 ceph-mon[30968]: pgmap v1102: 129 pgs: 129 active+clean; 443 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-09-19T05:46:14.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 207929 16.18 MB/sec execute 569 sec latency 52.589 ms 2024-09-19T05:46:15.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 208421 16.20 MB/sec execute 570 sec latency 74.483 ms 2024-09-19T05:46:16.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:15 smithi060 ceph-mon[35058]: pgmap v1103: 129 pgs: 129 active+clean; 447 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-09-19T05:46:16.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:15 smithi082 ceph-mon[35195]: pgmap v1103: 129 pgs: 129 active+clean; 447 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-09-19T05:46:16.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:15 smithi001 ceph-mon[30968]: pgmap v1103: 129 pgs: 129 active+clean; 447 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.2 MiB/s wr, 268 op/s 2024-09-19T05:46:16.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 208804 16.21 MB/sec execute 571 sec latency 108.597 ms 2024-09-19T05:46:17.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 209238 16.22 MB/sec execute 572 sec latency 76.246 ms 2024-09-19T05:46:18.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:17 smithi060 ceph-mon[35058]: pgmap v1104: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 283 op/s 2024-09-19T05:46:18.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:17 smithi082 ceph-mon[35195]: pgmap v1104: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 283 op/s 2024-09-19T05:46:18.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:17 smithi001 ceph-mon[30968]: pgmap v1104: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.5 MiB/s wr, 283 op/s 2024-09-19T05:46:18.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 209565 16.22 MB/sec execute 573 sec latency 115.906 ms 2024-09-19T05:46:19.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 210012 16.22 MB/sec execute 574 sec latency 60.321 ms 2024-09-19T05:46:20.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:19 smithi060 ceph-mon[35058]: pgmap v1105: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.9 MiB/s wr, 219 op/s 2024-09-19T05:46:20.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:19 smithi082 ceph-mon[35195]: pgmap v1105: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.9 MiB/s wr, 219 op/s 2024-09-19T05:46:20.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:19 smithi001 ceph-mon[30968]: pgmap v1105: 129 pgs: 129 active+clean; 455 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.9 MiB/s wr, 219 op/s 2024-09-19T05:46:20.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 210547 16.24 MB/sec execute 575 sec latency 67.713 ms 2024-09-19T05:46:21.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 211034 16.26 MB/sec execute 576 sec latency 108.418 ms 2024-09-19T05:46:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:21 smithi082 ceph-mon[35195]: pgmap v1106: 129 pgs: 129 active+clean; 444 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-09-19T05:46:22.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:21 smithi001 ceph-mon[30968]: pgmap v1106: 129 pgs: 129 active+clean; 444 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-09-19T05:46:22.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:21 smithi060 ceph-mon[35058]: pgmap v1106: 129 pgs: 129 active+clean; 444 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-09-19T05:46:22.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 211579 16.29 MB/sec execute 577 sec latency 60.115 ms 2024-09-19T05:46:23.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 212060 16.31 MB/sec execute 578 sec latency 100.093 ms 2024-09-19T05:46:24.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:23 smithi082 ceph-mon[35195]: pgmap v1107: 129 pgs: 129 active+clean; 442 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-09-19T05:46:24.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:23 smithi001 ceph-mon[30968]: pgmap v1107: 129 pgs: 129 active+clean; 442 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-09-19T05:46:24.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:23 smithi060 ceph-mon[35058]: pgmap v1107: 129 pgs: 129 active+clean; 442 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2024-09-19T05:46:24.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 212430 16.32 MB/sec execute 579 sec latency 87.517 ms 2024-09-19T05:46:25.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 212747 16.32 MB/sec execute 580 sec latency 172.143 ms 2024-09-19T05:46:26.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:25 smithi082 ceph-mon[35195]: pgmap v1108: 129 pgs: 129 active+clean; 450 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-09-19T05:46:26.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:25 smithi001 ceph-mon[30968]: pgmap v1108: 129 pgs: 129 active+clean; 450 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-09-19T05:46:26.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:25 smithi060 ceph-mon[35058]: pgmap v1108: 129 pgs: 129 active+clean; 450 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.8 MiB/s wr, 264 op/s 2024-09-19T05:46:26.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 213053 16.32 MB/sec execute 581 sec latency 110.964 ms 2024-09-19T05:46:27.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 213442 16.32 MB/sec execute 582 sec latency 122.834 ms 2024-09-19T05:46:28.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:27 smithi082 ceph-mon[35195]: pgmap v1109: 129 pgs: 129 active+clean; 455 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2024-09-19T05:46:28.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:27 smithi001 ceph-mon[30968]: pgmap v1109: 129 pgs: 129 active+clean; 455 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2024-09-19T05:46:28.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:27 smithi060 ceph-mon[35058]: pgmap v1109: 129 pgs: 129 active+clean; 455 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2024-09-19T05:46:28.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 213898 16.33 MB/sec execute 583 sec latency 94.525 ms 2024-09-19T05:46:29.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 214451 16.35 MB/sec execute 584 sec latency 69.204 ms 2024-09-19T05:46:30.053 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:29 smithi060 ceph-mon[35058]: pgmap v1110: 129 pgs: 129 active+clean; 458 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-09-19T05:46:30.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:29 smithi001 ceph-mon[30968]: pgmap v1110: 129 pgs: 129 active+clean; 458 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-09-19T05:46:30.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:29 smithi082 ceph-mon[35195]: pgmap v1110: 129 pgs: 129 active+clean; 458 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-09-19T05:46:30.668 INFO:tasks.workunit.client.0.smithi001.stdout: 10 214942 16.37 MB/sec execute 585 sec latency 171.183 ms 2024-09-19T05:46:31.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 215184 16.37 MB/sec execute 586 sec latency 369.411 ms 2024-09-19T05:46:32.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:31 smithi001 ceph-mon[30968]: pgmap v1111: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 275 op/s 2024-09-19T05:46:32.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:31 smithi060 ceph-mon[35058]: pgmap v1111: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 275 op/s 2024-09-19T05:46:32.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:31 smithi082 ceph-mon[35195]: pgmap v1111: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.1 MiB/s wr, 275 op/s 2024-09-19T05:46:32.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 215640 16.38 MB/sec execute 587 sec latency 109.492 ms 2024-09-19T05:46:33.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 216007 16.40 MB/sec execute 588 sec latency 79.930 ms 2024-09-19T05:46:34.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:33 smithi001 ceph-mon[30968]: pgmap v1112: 129 pgs: 129 active+clean; 472 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 266 op/s 2024-09-19T05:46:34.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:33 smithi060 ceph-mon[35058]: pgmap v1112: 129 pgs: 129 active+clean; 472 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 266 op/s 2024-09-19T05:46:34.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:33 smithi082 ceph-mon[35195]: pgmap v1112: 129 pgs: 129 active+clean; 472 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 266 op/s 2024-09-19T05:46:34.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 216406 16.40 MB/sec execute 589 sec latency 82.595 ms 2024-09-19T05:46:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:46:35.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:46:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:46:35.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:34 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:46:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:46:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:46:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:46:35.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:34 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:46:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:46:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:46:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:46:35.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:34 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' 2024-09-19T05:46:35.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 216793 16.41 MB/sec execute 590 sec latency 102.444 ms 2024-09-19T05:46:36.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:35 smithi001 ceph-mon[30968]: pgmap v1113: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 301 op/s 2024-09-19T05:46:36.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:35 smithi060 ceph-mon[35058]: pgmap v1113: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 301 op/s 2024-09-19T05:46:36.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:35 smithi082 ceph-mon[35195]: pgmap v1113: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 301 op/s 2024-09-19T05:46:36.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 217018 16.39 MB/sec execute 591 sec latency 319.412 ms 2024-09-19T05:46:37.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 217438 16.40 MB/sec execute 592 sec latency 120.993 ms 2024-09-19T05:46:38.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:37 smithi001 ceph-mon[30968]: pgmap v1114: 129 pgs: 129 active+clean; 480 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-19T05:46:38.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:37 smithi060 ceph-mon[35058]: pgmap v1114: 129 pgs: 129 active+clean; 480 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-19T05:46:38.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:37 smithi082 ceph-mon[35195]: pgmap v1114: 129 pgs: 129 active+clean; 480 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-19T05:46:38.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 217907 16.41 MB/sec execute 593 sec latency 77.874 ms 2024-09-19T05:46:39.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 218438 16.43 MB/sec execute 594 sec latency 75.741 ms 2024-09-19T05:46:40.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:39 smithi001 ceph-mon[30968]: pgmap v1115: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-19T05:46:40.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:39 smithi060 ceph-mon[35058]: pgmap v1115: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-19T05:46:40.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:39 smithi082 ceph-mon[35195]: pgmap v1115: 129 pgs: 129 active+clean; 475 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 318 op/s 2024-09-19T05:46:40.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 218973 16.46 MB/sec execute 595 sec latency 90.700 ms 2024-09-19T05:46:41.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 219221 16.46 MB/sec execute 596 sec latency 330.568 ms 2024-09-19T05:46:42.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:41 smithi001 ceph-mon[30968]: pgmap v1116: 129 pgs: 129 active+clean; 459 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-19T05:46:42.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:41 smithi060 ceph-mon[35058]: pgmap v1116: 129 pgs: 129 active+clean; 459 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-19T05:46:42.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:41 smithi082 ceph-mon[35195]: pgmap v1116: 129 pgs: 129 active+clean; 459 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-19T05:46:42.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 219553 16.47 MB/sec execute 597 sec latency 98.620 ms 2024-09-19T05:46:43.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 219984 16.48 MB/sec execute 598 sec latency 56.977 ms 2024-09-19T05:46:44.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:43 smithi001 ceph-mon[30968]: pgmap v1117: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.7 MiB/s wr, 372 op/s 2024-09-19T05:46:44.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:43 smithi060 ceph-mon[35058]: pgmap v1117: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.7 MiB/s wr, 372 op/s 2024-09-19T05:46:44.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:43 smithi082 ceph-mon[35195]: pgmap v1117: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 6.7 MiB/s wr, 372 op/s 2024-09-19T05:46:44.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 220285 16.47 MB/sec execute 599 sec latency 120.085 ms 2024-09-19T05:46:45.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 600 sec 2024-09-19T05:46:46.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:45 smithi001 ceph-mon[30968]: pgmap v1118: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-09-19T05:46:46.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:45 smithi060 ceph-mon[35058]: pgmap v1118: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-09-19T05:46:46.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:45 smithi082 ceph-mon[35195]: pgmap v1118: 129 pgs: 129 active+clean; 456 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.0 MiB/s wr, 348 op/s 2024-09-19T05:46:46.669 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 601 sec 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: 0 cleanup 602 sec 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Operation Count AvgLat MaxLat 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: ---------------------------------------- 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: NTCreateX 316782 8.483 32372.488 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Close 232528 0.002 0.172 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Rename 13439 36.806 32628.916 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Unlink 64086 14.593 31814.456 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Qpathinfo 287150 4.169 1102.065 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Qfileinfo 50093 0.001 1.658 2024-09-19T05:46:47.414 INFO:tasks.workunit.client.0.smithi001.stdout: Qfsinfo 52765 0.206 32.560 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: Sfileinfo 25799 8.143 32573.961 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: Find 111090 0.587 856.503 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: WriteX 156584 0.801 22707.259 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: ReadX 497770 0.039 314.068 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: LockX 1038 8.513 81.563 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: UnlockX 1038 7.675 56.674 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: Flush 22221 14.336 396.855 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T05:46:47.415 INFO:tasks.workunit.client.0.smithi001.stdout:Throughput 16.469 MB/sec 10 clients 10 procs max_latency=32628.922 ms 2024-09-19T05:46:47.415 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T05:46:47.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T05:46:48.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:47 smithi001 ceph-mon[30968]: pgmap v1119: 129 pgs: 129 active+clean; 463 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.4 MiB/s wr, 403 op/s 2024-09-19T05:46:48.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:47 smithi060 ceph-mon[35058]: pgmap v1119: 129 pgs: 129 active+clean; 463 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.4 MiB/s wr, 403 op/s 2024-09-19T05:46:48.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:47 smithi082 ceph-mon[35195]: pgmap v1119: 129 pgs: 129 active+clean; 463 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.4 MiB/s wr, 403 op/s 2024-09-19T05:46:48.888 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-09-19T05:46:48.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T05:46:49.228 DEBUG:teuthology.parallel:result is None 2024-09-19T05:46:49.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:46:49.264 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:46:49.264 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T05:46:49.275 INFO:tasks.quiescer:joining Quiescers 2024-09-19T05:46:49.275 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T05:46:49.275 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:46:49.559 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:46:50.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:49 smithi001 ceph-mon[30968]: pgmap v1120: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 302 op/s 2024-09-19T05:46:50.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:49 smithi060 ceph-mon[35058]: pgmap v1120: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 302 op/s 2024-09-19T05:46:50.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:49 smithi082 ceph-mon[35195]: pgmap v1120: 129 pgs: 129 active+clean; 462 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 302 op/s 2024-09-19T05:46:50.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- 172.21.15.1:0/3908684340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50106a60 msgr2=0x7fcd50106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3908684340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50106a60 0x7fcd50106e40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009930 tx=0x7fcd4002a420 comp rx=0 tx=0).stop 2024-09-19T05:46:50.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- 172.21.15.1:0/3908684340 shutdown_connections 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3908684340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50101400 0x7fcd5010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3908684340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50100a60 0x7fcd50100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3908684340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50106a60 0x7fcd50106e40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- 172.21.15.1:0/3908684340 >> 172.21.15.1:0/3908684340 conn(0x7fcd500fc780 msgr2=0x7fcd500feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- 172.21.15.1:0/3908684340 shutdown_connections 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- 172.21.15.1:0/3908684340 wait complete. 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 Processor -- start 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.617+0000 7fcd565a2640 1 -- start start 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50100a60 0x7fcd50198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50106a60 0x7fcd5019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50110e60 con 0x7fcd50101400 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50110ce0 con 0x7fcd50100a60 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd565a2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50110fe0 con 0x7fcd50106a60 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52734/0 (socket says 172.21.15.1:52734) 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 -- 172.21.15.1:0/3806892068 learned_addr learned my addr 172.21.15.1:0/3806892068 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:50.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4ffff640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50100a60 0x7fcd50198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd54b3f640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50106a60 0x7fcd5019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 -- 172.21.15.1:0/3806892068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50106a60 msgr2=0x7fcd5019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50106a60 0x7fcd5019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 -- 172.21.15.1:0/3806892068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50100a60 msgr2=0x7fcd50198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50100a60 0x7fcd50198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.618+0000 7fcd4f7fe640 1 -- 172.21.15.1:0/3806892068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5019d440 con 0x7fcd50101400 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd4f7fe640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400d950 tx=0x7fcd4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:50.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd44017070 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd44009c30 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400f6b0 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5019d730 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.619+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd50102560 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.620+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd50100ec0 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.621+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fcd440109d0 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.622+0000 7fcd4d7fa640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.622+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fcd440cf850 con 0x7fcd50101400 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.622+0000 7fcd4ffff640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.623+0000 7fcd4ffff640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 0x7fcd380a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009900 tx=0x7fcd400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:50.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.626+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd44009de0 con 0x7fcd50101400 2024-09-19T05:46:50.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.841+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd501027f0 con 0x7fcd50101400 2024-09-19T05:46:50.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.842+0000 7fcd4d7fa640 1 -- 172.21.15.1:0/3806892068 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fcd4409bb70 con 0x7fcd50101400 2024-09-19T05:46:50.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:46:50.845 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:46:50.845 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 msgr2=0x7fcd380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 0x7fcd380a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009900 tx=0x7fcd400058d0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 msgr2=0x7fcd501989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400d950 tx=0x7fcd4400de10 comp rx=0 tx=0).stop 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 shutdown_connections 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd50106a60 0x7fcd5019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd50101400 0x7fcd501989d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 --2- 172.21.15.1:0/3806892068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd50100a60 0x7fcd50198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 >> 172.21.15.1:0/3806892068 conn(0x7fcd500fc780 msgr2=0x7fcd5006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 shutdown_connections 2024-09-19T05:46:50.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:50.844+0000 7fcd565a2640 1 -- 172.21.15.1:0/3806892068 wait complete. 2024-09-19T05:46:51.628 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24472 quiesce db --cancel --all' 2024-09-19T05:46:51.629 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24472 quiesce db --cancel --all 2024-09-19T05:46:51.891 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:46:52.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:51 smithi001 ceph-mon[30968]: pgmap v1121: 129 pgs: 129 active+clean; 433 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 331 op/s 2024-09-19T05:46:52.014 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:51 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3806892068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:46:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:51 smithi060 ceph-mon[35058]: pgmap v1121: 129 pgs: 129 active+clean; 433 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 331 op/s 2024-09-19T05:46:52.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:51 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3806892068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:46:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:51 smithi082 ceph-mon[35195]: pgmap v1121: 129 pgs: 129 active+clean; 433 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.9 MiB/s wr, 331 op/s 2024-09-19T05:46:52.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:51 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3806892068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 -- 172.21.15.1:0/2238103961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10101de0 msgr2=0x7f6b101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 --2- 172.21.15.1:0/2238103961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10101de0 0x7f6b101021c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009900 tx=0x7f6b0002a410 comp rx=0 tx=0).stop 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 -- 172.21.15.1:0/2238103961 shutdown_connections 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 --2- 172.21.15.1:0/2238103961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10106f10 0x7f6b1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 --2- 172.21.15.1:0/2238103961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 0x7f6b101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 --2- 172.21.15.1:0/2238103961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10101de0 0x7f6b101021c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 -- 172.21.15.1:0/2238103961 >> 172.21.15.1:0/2238103961 conn(0x7f6b100fd8c0 msgr2=0x7f6b100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 -- 172.21.15.1:0/2238103961 shutdown_connections 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.449+0000 7f6b15531640 1 -- 172.21.15.1:0/2238103961 wait complete. 2024-09-19T05:46:52.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 Processor -- start 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 -- start start 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10101de0 0x7f6b1019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 0x7f6b1019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10111f30 con 0x7f6b10106f10 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10111db0 con 0x7f6b10101de0 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b15531640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101120b0 con 0x7f6b10102790 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52764/0 (socket says 172.21.15.1:52764) 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 -- 172.21.15.1:0/2150343806 learned_addr learned my addr 172.21.15.1:0/2150343806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:52.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 0x7f6b1019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10101de0 0x7f6b1019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 -- 172.21.15.1:0/2150343806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 msgr2=0x7f6b1019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 0x7f6b1019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 -- 172.21.15.1:0/2150343806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10101de0 msgr2=0x7f6b1019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10101de0 0x7f6b1019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.450+0000 7f6b0f7fe640 1 -- 172.21.15.1:0/2150343806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1019f6a0 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b0f7fe640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800eaa0 tx=0x7f6b0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b0cff9640 1 -- 172.21.15.1:0/2150343806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800cdb0 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1019f990 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b0cff9640 1 -- 172.21.15.1:0/2150343806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b08005020 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b0cff9640 1 -- 172.21.15.1:0/2150343806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b080116b0 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.451+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b101a7270 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.453+0000 7f6b0cff9640 1 -- 172.21.15.1:0/2150343806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f6b08005560 con 0x7f6b10106f10 2024-09-19T05:46:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.453+0000 7f6b1790a740 1 Processor -- start 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 -- start start 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e805200 con 0x55fa0e8abbe0 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e7abdc0 con 0x55fa0e8a1320 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b1790a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e8011c0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b0cff9640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 0x7f6afc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52780/0 (socket says 172.21.15.1:52780) 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b07fff640 1 -- 172.21.15.1:0/1865354251 learned_addr learned my addr 172.21.15.1:0/1865354251 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:52.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b07fff640 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b0f7fe640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 0x7f6afc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.454+0000 7f6b0cff9640 1 -- 172.21.15.1:0/2150343806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6b080cff10 con 0x7f6b10106f10 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 -- 172.21.15.1:0/1865354251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a0a00 msgr2=0x55fa0e8a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 -- 172.21.15.1:0/1865354251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 msgr2=0x55fa0e8ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 -- 172.21.15.1:0/1865354251 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0e576620 con 0x55fa0e8abbe0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b0effd640 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b07fff640 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b6c0 tx=0x7f6af800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f043b9ca1e271c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b0f7fe640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 0x7f6afc0a5700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b0809c0b0 tx=0x7f6b0806efa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b057fa640 1 -- 172.21.15.1:0/1865354251 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8012d00 con 0x55fa0e8abbe0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b057fa640 1 -- 172.21.15.1:0/1865354251 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af8010770 con 0x55fa0e8abbe0 2024-09-19T05:46:52.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.455+0000 7f6b057fa640 1 -- 172.21.15.1:0/1865354251 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80037f0 con 0x55fa0e8abbe0 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- 172.21.15.1:0/1865354251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 msgr2=0x55fa0e8adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6af800b6c0 tx=0x7f6af800b650 comp rx=0 tx=0).stop 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- 172.21.15.1:0/1865354251 shutdown_connections 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8adfd0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 --2- 172.21.15.1:0/1865354251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- 172.21.15.1:0/1865354251 >> 172.21.15.1:0/1865354251 conn(0x55fa0e89cf90 msgr2=0x55fa0e89d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- 172.21.15.1:0/1865354251 shutdown_connections 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- 172.21.15.1:0/1865354251 wait complete. 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 -- start start 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.456+0000 7f6b1790a740 1 Processor -- start 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e8ae7b0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e79fc50 con 0x55fa0e8abbe0 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fa0e8ae930 con 0x55fa0e8a1320 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 10 client.0 _ll_register_callbacks cb 0x55fa0e7b1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24472, 2024-09-19T05:46:52.877 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 88, 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": {} 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52796/0 (socket says 172.21.15.1:52796) 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 -- 172.21.15.1:0/2794086578 learned_addr learned my addr 172.21.15.1:0/2794086578 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 -- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 msgr2=0x55fa0e8a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 -- 172.21.15.1:0/2794086578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8abbe0 msgr2=0x55fa0e8a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 -- 172.21.15.1:0/2794086578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0e8a9590 con 0x55fa0e8a0a00 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bfd0 tx=0x7f6af8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea9e166eb738ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6af67fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8010db0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6af8005040 con 0x55fa0e8a0a00 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.457+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6af8010770 con 0x55fa0e8a0a00 2024-09-19T05:46:52.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6af8033050 con 0x55fa0e8a0a00 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 10 client.16257 fetch_fsmap learned FSMap version 21 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fa0e8ba360 con 0x55fa0e8a0a00 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af8010770 con 0x55fa0e8a0a00 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6af80035f0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 10 client.16257 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 10 client.16257 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 20 client.16257 populate_metadata read hostname 'smithi001' 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8bb6b0 0x55fa0e8bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 4 client.16257 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa0e812770 con 0x55fa0e8bb6b0 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.458+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8bb6b0 0x55fa0e8bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.459+0000 7f6af67fc640 10 client.16257 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:46:52.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.459+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8bb6b0 0x55fa0e8bdaa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754cb4c928b0ddaa server_cookie=53513bb9270c4a89 in_seq=0 out_seq=0 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.459+0000 7f6af67fc640 1 -- 172.21.15.1:0/2794086578 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa0e812770 con 0x55fa0e8bb6b0 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.459+0000 7f6af67fc640 10 client.16257 handle_command_reply: tid=0 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.459+0000 7f6b1790a740 1 client.16257 shutdown 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 msgr2=0x55fa0e8ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6af800bfd0 tx=0x7f6af8001e70 comp rx=0 tx=0).stop 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 shutdown_connections 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8abbe0 0x55fa0e8a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8bb6b0 0x55fa0e8bdaa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2794086578 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8ab550 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6af67fc640 0 client.16257 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 >> 172.21.15.1:0/2794086578 conn(0x55fa0e89cf90 msgr2=0x55fa0e89c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 shutdown_connections 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 1 -- 172.21.15.1:0/2794086578 wait complete. 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.460+0000 7f6b1790a740 20 client.16257 trim_cache size 0 max 16384 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 Processor -- start 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 -- start start 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101af030 con 0x55fa0e8a0a00 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b18b0 con 0x55fa0e89cf90 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b1790a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101af6a0 con 0x55fa0e8a1320 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52810/0 (socket says 172.21.15.1:52810) 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b0effd640 1 -- 172.21.15.1:0/3648251093 learned_addr learned my addr 172.21.15.1:0/3648251093 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:52.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.477+0000 7f6b07fff640 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 -- 172.21.15.1:0/3648251093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 msgr2=0x55fa0e8c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b07fff640 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 -- 172.21.15.1:0/3648251093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e89cf90 msgr2=0x55fa0e8b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 -- 172.21.15.1:0/3648251093 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0e8a1150 con 0x55fa0e8a0a00 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b0effd640 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a930 tx=0x7f6b000058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53672d81681dc815 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b04ff9640 1 -- 172.21.15.1:0/3648251093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0004a070 con 0x55fa0e8a0a00 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b04ff9640 1 -- 172.21.15.1:0/3648251093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b000044b0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b04ff9640 1 -- 172.21.15.1:0/3648251093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00035040 con 0x55fa0e8a0a00 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.478+0000 7f6b1790a740 1 -- 172.21.15.1:0/3648251093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 msgr2=0x55fa0e8c3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6b0002a930 tx=0x7f6b000058b0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- 172.21.15.1:0/3648251093 shutdown_connections 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e8a1320 0x55fa0e8c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8c3190 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- 172.21.15.1:0/3648251093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- 172.21.15.1:0/3648251093 >> 172.21.15.1:0/3648251093 conn(0x55fa0e898520 msgr2=0x55fa0e8aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- 172.21.15.1:0/3648251093 shutdown_connections 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- 172.21.15.1:0/3648251093 wait complete. 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- start start 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 Processor -- start 2024-09-19T05:46:52.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101afd70 con 0x55fa0e8a0a00 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b11e0 con 0x55fa0e8a1320 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b0440 con 0x55fa0e89cf90 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b1790a740 10 client.0 _ll_register_callbacks cb 0x7f6b00009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52820/0 (socket says 172.21.15.1:52820) 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.479+0000 7f6b0effd640 1 -- 172.21.15.1:0/2664097994 learned_addr learned my addr 172.21.15.1:0/2664097994 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 -- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e89cf90 msgr2=0x55fa0e8b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 -- 172.21.15.1:0/2664097994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 msgr2=0x55fa0e8afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 -- 172.21.15.1:0/2664097994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa0e8b02f0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b0effd640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009230 tx=0x7f6b000043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d38d7a448c94bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6af67fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0004a040 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f6b00004ba0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b000044b0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6b00035040 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b1790a740 10 client.16263 fetch_fsmap learned FSMap version 21 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fa0e926140 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.480+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b000044b0 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6b00031870 con 0x55fa0e8a0a00 2024-09-19T05:46:52.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 10 client.16263 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 10 client.16263 resolve_mds: validated gid 24472 aka daemon mds.i 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 20 client.16263 populate_metadata read hostname 'smithi001' 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8abbe0 0x55fa0e9288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 4 client.16263 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 --> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55fa0e80cc80 con 0x55fa0e8abbe0 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8abbe0 0x55fa0e9288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6af67fc640 10 client.16263 ms_handle_connect on v2:172.21.15.82:6838/1656123730 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b07fff640 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8abbe0 0x55fa0e9288d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60c50146c8c6b5a server_cookie=59ec0f55ca16d3c in_seq=0 out_seq=0 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6af67fc640 1 -- 172.21.15.1:0/2664097994 <== mds.0 v2:172.21.15.82:6838/1656123730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55fa0e80cc80 con 0x55fa0e8abbe0 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6af67fc640 10 client.16263 handle_command_reply: tid=0 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.481+0000 7f6b1790a740 1 client.16263 shutdown 2024-09-19T05:46:52.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 msgr2=0x55fa0e8af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009230 tx=0x7f6b000043a0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 shutdown_connections 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa0e8a1320 0x55fa0e8afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fa0e8a0a00 0x55fa0e8af580 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:6838/1656123730,v1:172.21.15.82:6839/1656123730] conn(0x55fa0e8abbe0 0x55fa0e9288d0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 --2- 172.21.15.1:0/2664097994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fa0e89cf90 0x55fa0e8b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6af67fc640 0 client.16263 ms_handle_reset on v2:172.21.15.82:6838/1656123730 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 >> 172.21.15.1:0/2664097994 conn(0x55fa0e898520 msgr2=0x55fa0e8a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 shutdown_connections 2024-09-19T05:46:52.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 1 -- 172.21.15.1:0/2664097994 wait complete. 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b1790a740 20 client.16263 trim_cache size 0 max 16384 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 msgr2=0x7f6afc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 0x7f6afc0a5700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b0809c0b0 tx=0x7f6b0806efa0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 msgr2=0x7f6b1019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800eaa0 tx=0x7f6b0800ef60 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 shutdown_connections 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f6afc0a3240 0x7f6afc0a5700 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b10106f10 0x7f6b1019efc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b10102790 0x7f6b1019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 --2- 172.21.15.1:0/2150343806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b10101de0 0x7f6b1019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 >> 172.21.15.1:0/2150343806 conn(0x7f6b100fd8c0 msgr2=0x7f6b100fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:52.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 shutdown_connections 2024-09-19T05:46:52.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:52.482+0000 7f6b15531640 1 -- 172.21.15.1:0/2150343806 wait complete. 2024-09-19T05:46:53.615 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T05:46:53.615 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T05:46:53.625 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:46:53.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.765+0000 7fb96127b640 1 -- 172.21.15.1:0/3786440367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 msgr2=0x7fb95c100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.765+0000 7fb96127b640 1 --2- 172.21.15.1:0/3786440367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c100e50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009900 tx=0x7fb94c02a410 comp rx=0 tx=0).stop 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 -- 172.21.15.1:0/3786440367 shutdown_connections 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 --2- 172.21.15.1:0/3786440367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c102600 0x7fb95c108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 --2- 172.21.15.1:0/3786440367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c101c40 0x7fb95c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 --2- 172.21.15.1:0/3786440367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c100e50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 -- 172.21.15.1:0/3786440367 >> 172.21.15.1:0/3786440367 conn(0x7fb95c0fc1f0 msgr2=0x7fb95c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 -- 172.21.15.1:0/3786440367 shutdown_connections 2024-09-19T05:46:53.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 -- 172.21.15.1:0/3786440367 wait complete. 2024-09-19T05:46:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.766+0000 7fb96127b640 1 Processor -- start 2024-09-19T05:46:53.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 -- start start 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c101c40 0x7fb95c109890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c102600 0x7fb95c109dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c10d860 con 0x7fb95c100a50 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c10d6e0 con 0x7fb95c102600 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb96127b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c10d9e0 con 0x7fb95c101c40 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52832/0 (socket says 172.21.15.1:52832) 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 -- 172.21.15.1:0/408188547 learned_addr learned my addr 172.21.15.1:0/408188547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95b7fe640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c102600 0x7fb95c109dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95a7fc640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c101c40 0x7fb95c109890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 -- 172.21.15.1:0/408188547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c101c40 msgr2=0x7fb95c109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c101c40 0x7fb95c109890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 -- 172.21.15.1:0/408188547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c102600 msgr2=0x7fb95c109dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c102600 0x7fb95c109dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.767+0000 7fb95affd640 1 -- 172.21.15.1:0/408188547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c10a660 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb95affd640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb94c031440 tx=0x7fb94c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c03f030 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb94c003ce0 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c1a1f30 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c035070 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.768+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1a2340 con 0x7fb95c100a50 2024-09-19T05:46:53.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.769+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c107d90 con 0x7fb95c100a50 2024-09-19T05:46:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.771+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb94c042030 con 0x7fb95c100a50 2024-09-19T05:46:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.771+0000 7fb943fff640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 0x7fb9440a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.772+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fb94c0f0530 con 0x7fb95c100a50 2024-09-19T05:46:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.772+0000 7fb95a7fc640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 0x7fb9440a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:53.773 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.772+0000 7fb95a7fc640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 0x7fb9440a5710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb95c10afc0 tx=0x7fb950005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:53.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.775+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb94c0bc850 con 0x7fb95c100a50 2024-09-19T05:46:53.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:53 smithi001 ceph-mon[30968]: pgmap v1122: 129 pgs: 129 active+clean; 356 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 387 op/s 2024-09-19T05:46:53.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.954+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb95c02da10 con 0x7fb95c100a50 2024-09-19T05:46:53.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.956+0000 7fb943fff640 1 -- 172.21.15.1:0/408188547 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24749 (secure 0 0 0) 0x7fb94c0c0b50 con 0x7fb95c100a50 2024-09-19T05:46:53.958 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:46:53.958 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":91,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:21:11.868828+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:46:53.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 msgr2=0x7fb9440a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 0x7fb9440a5710 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb95c10afc0 tx=0x7fb950005f90 comp rx=0 tx=0).stop 2024-09-19T05:46:53.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 msgr2=0x7fb95c10b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb94c031440 tx=0x7fb94c032ce0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 shutdown_connections 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb9440a3250 0x7fb9440a5710 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb95c102600 0x7fb95c109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb95c101c40 0x7fb95c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 --2- 172.21.15.1:0/408188547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb95c100a50 0x7fb95c10b250 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 >> 172.21.15.1:0/408188547 conn(0x7fb95c0fc1f0 msgr2=0x7fb95c104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.958+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 shutdown_connections 2024-09-19T05:46:53.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:53.959+0000 7fb96127b640 1 -- 172.21.15.1:0/408188547 wait complete. 2024-09-19T05:46:53.972 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:14:26.275871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T05:18:58.627182+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T05:19:00.914639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T05:19:07.429054+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T05:46:53.972 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:46:54.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 -- 172.21.15.1:0/4030405681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b41025e0 msgr2=0x7f68b4108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 --2- 172.21.15.1:0/4030405681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b41025e0 0x7f68b4108e70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009ca0 tx=0x7f68ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 -- 172.21.15.1:0/4030405681 shutdown_connections 2024-09-19T05:46:54.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 --2- 172.21.15.1:0/4030405681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b41025e0 0x7f68b4108e70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 --2- 172.21.15.1:0/4030405681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4101c20 0x7f68b41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 --2- 172.21.15.1:0/4030405681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b4100a30 0x7f68b4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 -- 172.21.15.1:0/4030405681 >> 172.21.15.1:0/4030405681 conn(0x7f68b40fc190 msgr2=0x7f68b40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 -- 172.21.15.1:0/4030405681 shutdown_connections 2024-09-19T05:46:54.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.080+0000 7f68b8de4640 1 -- 172.21.15.1:0/4030405681 wait complete. 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 Processor -- start 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 -- start start 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4100a30 0x7f68b4197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b41025e0 0x7f68b419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68b410d800 con 0x7f68b4101c20 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68b410d680 con 0x7f68b4100a30 2024-09-19T05:46:54.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b8de4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68b410d980 con 0x7f68b41025e0 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55318/0 (socket says 172.21.15.1:55318) 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b1d9b640 1 -- 172.21.15.1:0/3939811032 learned_addr learned my addr 172.21.15.1:0/3939811032 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b2d9d640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b41025e0 0x7f68b419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.081+0000 7f68b259c640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4100a30 0x7f68b4197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 -- 172.21.15.1:0/3939811032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b41025e0 msgr2=0x7f68b419f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b41025e0 0x7f68b419f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 -- 172.21.15.1:0/3939811032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4100a30 msgr2=0x7f68b4197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4100a30 0x7f68b4197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 -- 172.21.15.1:0/3939811032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b419f990 con 0x7f68b4101c20 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b1d9b640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c920 tx=0x7f68a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8007c70 con 0x7f68b4101c20 2024-09-19T05:46:54.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a8007e10 con 0x7f68b4101c20 2024-09-19T05:46:54.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b419fc80 con 0x7f68b4101c20 2024-09-19T05:46:54.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8018890 con 0x7f68b4101c20 2024-09-19T05:46:54.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.082+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b41a01d0 con 0x7f68b4101c20 2024-09-19T05:46:54.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.083+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b4107d50 con 0x7f68b4101c20 2024-09-19T05:46:54.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.084+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f68a8018a50 con 0x7f68b4101c20 2024-09-19T05:46:54.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.085+0000 7f68a37fe640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 0x7f689c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.085+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f68a80cfff0 con 0x7f68b4101c20 2024-09-19T05:46:54.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.085+0000 7f68b259c640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 0x7f689c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.086+0000 7f68b259c640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 0x7f689c0a5710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f68b4101a80 tx=0x7f68a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.088+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68a8014030 con 0x7f68b4101c20 2024-09-19T05:46:54.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:53 smithi060 ceph-mon[35058]: pgmap v1122: 129 pgs: 129 active+clean; 356 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 387 op/s 2024-09-19T05:46:54.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:53 smithi082 ceph-mon[35195]: pgmap v1122: 129 pgs: 129 active+clean; 356 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.6 MiB/s wr, 387 op/s 2024-09-19T05:46:54.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.264+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f68b402d7c0 con 0x7f68b4101c20 2024-09-19T05:46:54.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.264+0000 7f68a37fe640 1 -- 172.21.15.1:0/3939811032 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f68a809c9f0 con 0x7f68b4101c20 2024-09-19T05:46:54.266 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 msgr2=0x7f689c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 0x7f689c0a5710 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f68b4101a80 tx=0x7f68a4005f90 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 msgr2=0x7f68b41982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c920 tx=0x7f68a800cde0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 shutdown_connections 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f689c0a3250 0x7f689c0a5710 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b41025e0 0x7f68b419f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b4101c20 0x7f68b41982b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 --2- 172.21.15.1:0/3939811032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68b4100a30 0x7f68b4197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 >> 172.21.15.1:0/3939811032 conn(0x7f68b40fc190 msgr2=0x7f68b4104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 shutdown_connections 2024-09-19T05:46:54.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.267+0000 7f68b8de4640 1 -- 172.21.15.1:0/3939811032 wait complete. 2024-09-19T05:46:54.280 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 -- 172.21.15.1:0/3297761356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098107830 msgr2=0x7ff098109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 --2- 172.21.15.1:0/3297761356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098107830 0x7ff098109ca0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff090009ca0 tx=0x7ff09002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 -- 172.21.15.1:0/3297761356 shutdown_connections 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 --2- 172.21.15.1:0/3297761356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff098107830 0x7ff098109ca0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 --2- 172.21.15.1:0/3297761356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff0981072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 --2- 172.21.15.1:0/3297761356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0981025d0 0x7ff0981049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 -- 172.21.15.1:0/3297761356 >> 172.21.15.1:0/3297761356 conn(0x7ff0980fc190 msgr2=0x7ff0980fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 -- 172.21.15.1:0/3297761356 shutdown_connections 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 -- 172.21.15.1:0/3297761356 wait complete. 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.385+0000 7ff09fd49640 1 Processor -- start 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 -- start start 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff098198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff098107830 0x7ff09819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810d840 con 0x7ff0981025d0 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810d6c0 con 0x7ff098107830 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09fd49640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff09810d9c0 con 0x7ff098104f00 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55334/0 (socket says 172.21.15.1:55334) 2024-09-19T05:46:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 -- 172.21.15.1:0/1408521013 learned_addr learned my addr 172.21.15.1:0/1408521013 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09d2e4640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff098198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09e2e6640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff098107830 0x7ff09819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 -- 172.21.15.1:0/1408521013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 msgr2=0x7ff098198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff098198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 -- 172.21.15.1:0/1408521013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff098107830 msgr2=0x7ff09819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff098107830 0x7ff09819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 -- 172.21.15.1:0/1408521013 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09819faf0 con 0x7ff0981025d0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09d2e4640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff098198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff09dae5640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff09400ea60 tx=0x7ff09400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.386+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09400cde0 con 0x7ff0981025d0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.387+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0940035f0 con 0x7ff0981025d0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.387+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09819fde0 con 0x7ff0981025d0 2024-09-19T05:46:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.387+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094010670 con 0x7ff0981025d0 2024-09-19T05:46:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.387+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a02a0 con 0x7ff0981025d0 2024-09-19T05:46:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.388+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0980fdc80 con 0x7ff0981025d0 2024-09-19T05:46:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.389+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff0940037a0 con 0x7ff0981025d0 2024-09-19T05:46:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.390+0000 7ff08effd640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 0x7ff0840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.390+0000 7ff09d2e4640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 0x7ff0840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.390+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7ff0940d0110 con 0x7ff0981025d0 2024-09-19T05:46:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.390+0000 7ff09d2e4640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 0x7ff0840a5790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff0981993e0 tx=0x7ff088005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.393+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff094054210 con 0x7ff0981025d0 2024-09-19T05:46:54.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.568+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff09802da10 con 0x7ff0981025d0 2024-09-19T05:46:54.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.569+0000 7ff08effd640 1 -- 172.21.15.1:0/1408521013 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7ff09409ca80 con 0x7ff0981025d0 2024-09-19T05:46:54.571 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 msgr2=0x7ff0840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 0x7ff0840a5790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff0981993e0 tx=0x7ff088005f90 comp rx=0 tx=0).stop 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 msgr2=0x7ff098197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff09400ea60 tx=0x7ff09400ef20 comp rx=0 tx=0).stop 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 shutdown_connections 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff0840a32d0 0x7ff0840a5790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff098107830 0x7ff09819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff098104f00 0x7ff098198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 --2- 172.21.15.1:0/1408521013 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0981025d0 0x7ff098197ed0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 >> 172.21.15.1:0/1408521013 conn(0x7ff0980fc190 msgr2=0x7ff098102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 shutdown_connections 2024-09-19T05:46:54.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.571+0000 7ff09fd49640 1 -- 172.21.15.1:0/1408521013 wait complete. 2024-09-19T05:46:54.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T05:46:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 -- 172.21.15.1:0/3026894405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f8104f00 msgr2=0x7f02f81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 --2- 172.21.15.1:0/3026894405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f8104f00 0x7f02f81072f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009900 tx=0x7f02ec02a410 comp rx=0 tx=0).stop 2024-09-19T05:46:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 -- 172.21.15.1:0/3026894405 shutdown_connections 2024-09-19T05:46:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 --2- 172.21.15.1:0/3026894405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f8109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 --2- 172.21.15.1:0/3026894405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f8104f00 0x7f02f81072f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 --2- 172.21.15.1:0/3026894405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f81025d0 0x7f02f81049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 -- 172.21.15.1:0/3026894405 >> 172.21.15.1:0/3026894405 conn(0x7f02f80fc190 msgr2=0x7f02f80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 -- 172.21.15.1:0/3026894405 shutdown_connections 2024-09-19T05:46:54.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.688+0000 7f02fcb86640 1 -- 172.21.15.1:0/3026894405 wait complete. 2024-09-19T05:46:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 Processor -- start 2024-09-19T05:46:54.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 -- start start 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f8104f00 0x7f02f8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02f810d7e0 con 0x7f02f81025d0 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02f810d660 con 0x7f02f8107830 2024-09-19T05:46:54.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02fcb86640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02f810d960 con 0x7f02f8104f00 2024-09-19T05:46:54.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55352/0 (socket says 172.21.15.1:55352) 2024-09-19T05:46:54.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 -- 172.21.15.1:0/4023423207 learned_addr learned my addr 172.21.15.1:0/4023423207 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:54.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f5d9b640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f8104f00 0x7f02f8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f6d9d640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 -- 172.21.15.1:0/4023423207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f8104f00 msgr2=0x7f02f8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f8104f00 0x7f02f8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 -- 172.21.15.1:0/4023423207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 msgr2=0x7f02f819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f659c640 1 -- 172.21.15.1:0/4023423207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f819fa30 con 0x7f02f81025d0 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.689+0000 7f02f6d9d640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:54.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02f659c640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c920 tx=0x7f02e800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8007c70 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e8007e10 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f819fd20 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8018890 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.690+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f81a0190 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.691+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f80fdc80 con 0x7f02f81025d0 2024-09-19T05:46:54.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.692+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f02e8018a70 con 0x7f02f81025d0 2024-09-19T05:46:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.693+0000 7f02e77fe640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 0x7f02e00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.693+0000 7f02f5d9b640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 0x7f02e00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.693+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f02e80cfe70 con 0x7f02f81025d0 2024-09-19T05:46:54.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.693+0000 7f02f5d9b640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 0x7f02e00a5710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0314e0 tx=0x7f02ec0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:54.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.697+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02e8014030 con 0x7f02f81025d0 2024-09-19T05:46:54.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:54 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/408188547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:46:54.841 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:54 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3939811032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:46:54.842 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:54 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1408521013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:46:54.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.873+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f02f8062e90 con 0x7f02f81025d0 2024-09-19T05:46:54.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.873+0000 7f02e77fe640 1 -- 172.21.15.1:0/4023423207 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f02e809c780 con 0x7f02f81025d0 2024-09-19T05:46:54.875 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-19T05:46:54.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 msgr2=0x7f02e00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 0x7f02e00a5710 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0314e0 tx=0x7f02ec0315b0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 msgr2=0x7f02f8197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c920 tx=0x7f02e800cde0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 shutdown_connections 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02e00a3250 0x7f02e00a5710 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02f8107830 0x7f02f819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02f8104f00 0x7f02f8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 --2- 172.21.15.1:0/4023423207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02f81025d0 0x7f02f8197e10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.875+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 >> 172.21.15.1:0/4023423207 conn(0x7f02f80fc190 msgr2=0x7f02f8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.876+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 shutdown_connections 2024-09-19T05:46:54.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.876+0000 7f02fcb86640 1 -- 172.21.15.1:0/4023423207 wait complete. 2024-09-19T05:46:54.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T05:46:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 -- 172.21.15.1:0/2010298407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201003c0 msgr2=0x7f78201007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2010298407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201003c0 0x7f78201007c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7810009900 tx=0x7f781002a410 comp rx=0 tx=0).stop 2024-09-19T05:46:54.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 -- 172.21.15.1:0/2010298407 shutdown_connections 2024-09-19T05:46:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2010298407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78201016a0 0x7f7820101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2010298407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7820100d00 0x7f7820101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2010298407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201003c0 0x7f78201007c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 -- 172.21.15.1:0/2010298407 >> 172.21.15.1:0/2010298407 conn(0x7f78200fc190 msgr2=0x7f78200fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.992+0000 7f7825eb7640 1 -- 172.21.15.1:0/2010298407 shutdown_connections 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 -- 172.21.15.1:0/2010298407 wait complete. 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 Processor -- start 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 -- start start 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 0x7f782019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7820100d00 0x7f782019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f782010f9c0 con 0x7f78201016a0 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f782010f840 con 0x7f78201003c0 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.993+0000 7f7825eb7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f782010fb40 con 0x7f7820100d00 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55362/0 (socket says 172.21.15.1:55362) 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 -- 172.21.15.1:0/2186538645 learned_addr learned my addr 172.21.15.1:0/2186538645 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:55.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781f7fe640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 0x7f782019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781effd640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7820100d00 0x7f782019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 -- 172.21.15.1:0/2186538645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7820100d00 msgr2=0x7f782019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7820100d00 0x7f782019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 -- 172.21.15.1:0/2186538645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 msgr2=0x7f782019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 0x7f782019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 -- 172.21.15.1:0/2186538645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78201a1d60 con 0x7f78201016a0 2024-09-19T05:46:55.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781f7fe640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 0x7f782019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781ffff640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f781800eb10 tx=0x7f781800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818004b20 con 0x7f78201016a0 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7818004cc0 con 0x7f78201016a0 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78201a1ff0 con 0x7f78201016a0 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818010760 con 0x7f78201016a0 2024-09-19T05:46:55.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.994+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78201a2510 con 0x7f78201016a0 2024-09-19T05:46:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.995+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782010b110 con 0x7f78201016a0 2024-09-19T05:46:55.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.997+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7818005000 con 0x7f78201016a0 2024-09-19T05:46:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.997+0000 7f781cff9640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 0x7f78080a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.998+0000 7f781f7fe640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 0x7f78080a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.998+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f78180d0810 con 0x7f78201016a0 2024-09-19T05:46:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:54.998+0000 7f781f7fe640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 0x7f78080a5710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7810000c00 tx=0x7f78100315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.001+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f781809d120 con 0x7f78201016a0 2024-09-19T05:46:55.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.180+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7820062df0 con 0x7f78201016a0 2024-09-19T05:46:55.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.181+0000 7f781cff9640 1 -- 172.21.15.1:0/2186538645 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f781809ca20 con 0x7f78201016a0 2024-09-19T05:46:55.183 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T05:46:55.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 msgr2=0x7f78080a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 0x7f78080a5710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7810000c00 tx=0x7f78100315b0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 msgr2=0x7f78201a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f781800eb10 tx=0x7f781800c2d0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 shutdown_connections 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f78080a3250 0x7f78080a5710 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f78201016a0 0x7f78201a16f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7820100d00 0x7f782019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 --2- 172.21.15.1:0/2186538645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78201003c0 0x7f782019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 >> 172.21.15.1:0/2186538645 conn(0x7f78200fc190 msgr2=0x7f78200fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 shutdown_connections 2024-09-19T05:46:55.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.183+0000 7f7825eb7640 1 -- 172.21.15.1:0/2186538645 wait complete. 2024-09-19T05:46:55.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T05:46:55.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:54 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/408188547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:46:55.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:54 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3939811032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:46:55.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:54 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1408521013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:46:55.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:54 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/408188547' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:46:55.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:54 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3939811032' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:46:55.267 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:54 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1408521013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:46:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- 172.21.15.1:0/3323801448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 msgr2=0x7f4bbc100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 --2- 172.21.15.1:0/3323801448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc100e50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009900 tx=0x7f4bac02a410 comp rx=0 tx=0).stop 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- 172.21.15.1:0/3323801448 shutdown_connections 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 --2- 172.21.15.1:0/3323801448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc102600 0x7f4bbc108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 --2- 172.21.15.1:0/3323801448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc101c40 0x7f4bbc1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 --2- 172.21.15.1:0/3323801448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc100e50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- 172.21.15.1:0/3323801448 >> 172.21.15.1:0/3323801448 conn(0x7f4bbc0fc190 msgr2=0x7f4bbc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- 172.21.15.1:0/3323801448 shutdown_connections 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- 172.21.15.1:0/3323801448 wait complete. 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 Processor -- start 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.311+0000 7f4bc2986640 1 -- start start 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc101c40 0x7f4bbc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc102600 0x7f4bbc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc10c6b0 con 0x7f4bbc100a50 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc10c530 con 0x7f4bbc101c40 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc2986640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc10c830 con 0x7f4bbc102600 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55380/0 (socket says 172.21.15.1:55380) 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 -- 172.21.15.1:0/1587249681 learned_addr learned my addr 172.21.15.1:0/1587249681 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bc0f23640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc102600 0x7f4bbc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbb7fe640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc101c40 0x7f4bbc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 -- 172.21.15.1:0/1587249681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc102600 msgr2=0x7f4bbc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc102600 0x7f4bbc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 -- 172.21.15.1:0/1587249681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc101c40 msgr2=0x7f4bbc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc101c40 0x7f4bbc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 -- 172.21.15.1:0/1587249681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc19fab0 con 0x7f4bbc100a50 2024-09-19T05:46:55.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.312+0000 7f4bbbfff640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4bac031610 tx=0x7f4bac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.313+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac03f030 con 0x7f4bbc100a50 2024-09-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.313+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bac003ad0 con 0x7f4bbc100a50 2024-09-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.313+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac035070 con 0x7f4bbc100a50 2024-09-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.313+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc19fd40 con 0x7f4bbc100a50 2024-09-19T05:46:55.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.313+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc1a01d0 con 0x7f4bbc100a50 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.314+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bbc1a0400 con 0x7f4bbc100a50 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.315+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4bac042030 con 0x7f4bbc100a50 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.315+0000 7f4bb97fa640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 0x7f4ba40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.316+0000 7f4bbb7fe640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 0x7f4ba40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.316+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f4bac0f02d0 con 0x7f4bbc100a50 2024-09-19T05:46:55.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.316+0000 7f4bbb7fe640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 0x7f4ba40a5790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc1993a0 tx=0x7f4bb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:55.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.320+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4bac0bc5f0 con 0x7f4bbc100a50 2024-09-19T05:46:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.543+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f4bbc1a0760 con 0x7f4bbc100a50 2024-09-19T05:46:55.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.551+0000 7f4bb97fa640 1 -- 172.21.15.1:0/1587249681 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742328 (secure 0 0 0) 0x7f4bac0c08f0 con 0x7f4bbc100a50 2024-09-19T05:46:55.553 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 18, 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 427915191 2024-09-19T05:46:55.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 427915191 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/427915191", 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-19T05:12:09.746142+0000", 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-19T05:46:55.555 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24106, 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.558 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.561 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T05:46:55.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T05:46:55.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.571 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.580 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.596 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.597 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.598 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.599 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.600 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T05:46:55.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T05:46:55.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T05:46:55.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T05:46:55.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.613 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.614 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.615 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.616 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T05:46:55.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T05:46:55.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:55.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T05:46:55.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:55.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:46:55.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:46:55.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:46:55.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.640 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.644 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:46:55.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T05:46:55.666 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.667 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:46:55.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:46:55.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:46:55.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:46:55.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:46:55.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:46:55.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.680 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:46:55.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T05:46:55.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T05:46:55.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.726 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T05:46:55.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:46:55.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:55.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:55.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:55.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T05:46:55.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:55.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.741 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.742 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T05:46:55.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T05:46:55.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T05:46:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T05:46:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.748 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.751 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.755 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T05:46:55.760 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.768 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T05:46:55.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.776 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.777 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.781 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.785 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.790 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T05:46:55.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.799 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T05:46:55.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T05:46:55.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T05:46:55.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.806 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.810 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.812 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.813 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.816 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.819 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.821 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:46:55.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.825 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T05:46:55.830 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.831 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.832 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.833 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.838 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.840 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T05:46:55.842 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.843 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.844 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.848 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T05:46:55.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:55.851 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.855 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T05:46:55.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.865 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.869 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.874 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.877 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.879 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.884 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.885 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.887 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.890 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.895 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:46:55.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.904 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.906 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T05:46:55.907 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.908 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.911 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.912 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.920 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.923 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.925 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.926 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.927 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.928 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.931 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.934 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.936 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.937 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T05:46:55.938 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.939 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T05:46:55.944 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:55.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.950 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.951 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.952 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.968 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.969 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T05:46:55.972 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.973 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.974 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.977 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.979 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.980 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T05:46:55.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:55.995 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:55.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:55.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:55.998 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.000 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24113, 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T05:46:56.003 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:46:56.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.005 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.006 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.008 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.015 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.016 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.018 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:46:56.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:56.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T05:46:56.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T05:46:56.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T05:46:56.025 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.028 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.030 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.031 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T05:46:56.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.033 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T05:46:56.034 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.039 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.040 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:46:56.043 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:46:56.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.046 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.047 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.049 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T05:46:56.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.054 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:46:56.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T05:46:56.056 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T05:46:56.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T05:46:56.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T05:46:56.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T05:46:56.060 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T05:46:56.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T05:46:56.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T05:46:56.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T05:46:56.064 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T05:46:56.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T05:46:56.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.067 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.071 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.074 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.077 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.078 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.079 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.082 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.084 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T05:46:56.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.088 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T05:46:56.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:46:56.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T05:46:56.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.093 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.094 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.095 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.098 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.101 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:46:56.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.104 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.105 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.106 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.108 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.111 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.113 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.115 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.118 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.122 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.128 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:46:56.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:46:56.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:46:56.134 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:46:56.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:46:56.136 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:46:56.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:46:56.138 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.139 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.143 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.144 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.146 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.147 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.149 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.156 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.157 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:46:56.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.164 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.165 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.167 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.172 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.176 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T05:46:56.177 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.178 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.181 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.183 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:46:56.185 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.189 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.191 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.192 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T05:46:56.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:46:56.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.203 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.204 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:46:56.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.206 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.208 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.209 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.211 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.212 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T05:46:56.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.216 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.217 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.218 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.219 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.221 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.222 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.224 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.225 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.226 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T05:46:56.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T05:46:56.229 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.230 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.231 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.234 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.235 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.240 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T05:46:56.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T05:46:56.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T05:46:56.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.249 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.250 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.251 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.253 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.254 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.256 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.257 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.258 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.261 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.262 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.264 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.266 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.268 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:56.270 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.271 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.272 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.275 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.278 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.280 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.284 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.285 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T05:46:56.289 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.290 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.293 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.294 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.296 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.300 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.303 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.305 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.307 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.308 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.309 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.312 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T05:46:56.314 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:56.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.316 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.317 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.319 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.321 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.326 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.327 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.330 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.333 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.334 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.338 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T05:46:56.341 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.342 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.345 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.349 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T05:46:56.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T05:46:56.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T05:46:56.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.356 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.357 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.358 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.359 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.363 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T05:46:56.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.370 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.371 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.372 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.373 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.374 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.377 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.380 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.382 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.383 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.385 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.388 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.389 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.391 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T05:46:56.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T05:46:56.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T05:46:56.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.398 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.399 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.400 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.408 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.411 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.419 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.421 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.424 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.425 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T05:46:56.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.430 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.431 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.436 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.437 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.438 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:46:56.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.443 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.444 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.445 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.446 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:46:56.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T05:46:56.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.453 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.459 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:46:56.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:46:56.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:46:56.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:46:56.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.468 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.474 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T05:46:56.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T05:46:56.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T05:46:56.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.479 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:46:56.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T05:46:56.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:46:56.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:46:56.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:46:56.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:46:56.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.497 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T05:46:56.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.504 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T05:46:56.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:46:56.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T05:46:56.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.508 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.519 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.522 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.523 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T05:46:56.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T05:46:56.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T05:46:56.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T05:46:56.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.535 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:46:56.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T05:46:56.546 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.547 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.554 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.557 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.576 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:46:56.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:46:56.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.586 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.607 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T05:46:56.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:46:56.610 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:56.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T05:46:56.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.623 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T05:46:56.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T05:46:56.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T05:46:56.627 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T05:46:56.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.629 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T05:46:56.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.649 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T05:46:56.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T05:46:56.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T05:46:56.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T05:46:56.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T05:46:56.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T05:46:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.659 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.661 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.663 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.664 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.669 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.556+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 msgr2=0x7f4ba40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.556+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 0x7f4ba40a5790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc1993a0 tx=0x7f4bb000b410 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.556+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 msgr2=0x7f4bbc197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.556+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4bac031610 tx=0x7f4bac004270 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 shutdown_connections 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4ba40a32d0 0x7f4ba40a5790 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bbc102600 0x7f4bbc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bbc101c40 0x7f4bbc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 --2- 172.21.15.1:0/1587249681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bbc100a50 0x7f4bbc197e90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 >> 172.21.15.1:0/1587249681 conn(0x7f4bbc0fc190 msgr2=0x7f4bbc06a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 shutdown_connections 2024-09-19T05:46:56.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:55.557+0000 7f4bc2986640 1 -- 172.21.15.1:0/1587249681 wait complete. 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T05:46:56.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.675 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.679 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:46:56.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.681 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:46:56.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:46:56.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:46:56.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.692 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.697 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.698 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.704 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.707 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.708 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.713 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T05:46:56.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.720 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.723 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.728 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.729 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.731 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.732 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.733 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.734 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.735 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.738 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.741 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.742 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T05:46:56.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T05:46:56.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.749 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.750 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.751 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T05:46:56.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T05:46:56.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T05:46:56.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T05:46:56.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.761 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.762 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.765 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.767 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.770 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.772 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.773 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.775 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.776 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.777 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.780 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.781 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.782 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.783 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.784 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:46:56.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.786 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.790 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T05:46:56.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.793 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.794 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.795 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.798 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.806 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.809 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.810 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.811 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.813 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.815 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.816 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T05:46:56.818 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.819 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.825 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.827 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.828 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.833 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.834 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.835 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:46:56.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.841 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.844 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.848 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.852 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.854 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T05:46:56.857 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T05:46:56.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.859 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.860 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.863 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.865 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.866 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.867 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.869 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T05:46:56.881 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.882 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T05:46:56.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T05:46:56.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.886 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T05:46:56.887 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T05:46:56.888 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-19T05:46:56.889 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T05:46:56.890 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 708825613 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T05:46:56.892 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 2090276333 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3856069381 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 705911444 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T05:46:56.894 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T05:46:56.901 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T05:46:57.281 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T05:46:57.281 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:46:57.281 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:57.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:55 smithi001 ceph-mon[30968]: pgmap v1123: 129 pgs: 129 active+clean; 330 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 298 op/s 2024-09-19T05:46:57.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:55 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4023423207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:55 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2186538645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:55 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1587249681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:55 smithi082 ceph-mon[35195]: pgmap v1123: 129 pgs: 129 active+clean; 330 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 298 op/s 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:55 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4023423207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:55 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2186538645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:55 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1587249681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:55 smithi060 ceph-mon[35058]: pgmap v1123: 129 pgs: 129 active+clean; 330 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 298 op/s 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:55 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4023423207' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:55 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2186538645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T05:46:57.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:55 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1587249681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:46:57.303 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T05:46:57.303 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:46:57.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:46:57.674 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:46:58.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:57 smithi001 ceph-mon[30968]: pgmap v1124: 129 pgs: 129 active+clean; 321 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-19T05:46:58.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:57 smithi060 ceph-mon[35058]: pgmap v1124: 129 pgs: 129 active+clean; 321 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-19T05:46:58.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:57 smithi082 ceph-mon[35195]: pgmap v1124: 129 pgs: 129 active+clean; 321 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.383+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2868238134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 msgr2=0x7fb1b0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.383+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2868238134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b0110250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009900 tx=0x7fb1a002a400 comp rx=0 tx=0).stop 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2868238134 shutdown_connections 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2868238134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b011b140 0x7fb1b011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2868238134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1b0109830 0x7fb1b0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2868238134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b0110250 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2868238134 >> 172.21.15.1:0/2868238134 conn(0x7fb1b006e140 msgr2=0x7fb1b006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2868238134 shutdown_connections 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.384+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2868238134 wait complete. 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 Processor -- start 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 -- start start 2024-09-19T05:46:58.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b01a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1b011b140 0x7fb1b01abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0120df0 con 0x7fb1b0109450 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0120c70 con 0x7fb1b0109830 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.385+0000 7fb1b5d6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0120f70 con 0x7fb1b011b140 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.1:43362/0 (socket says 172.21.15.1:43362) 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1aeffd640 1 -- 172.21.15.1:0/2375836162 learned_addr learned my addr 172.21.15.1:0/2375836162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1af7fe640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b01a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1aeffd640 1 -- 172.21.15.1:0/2375836162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1b011b140 msgr2=0x7fb1b01abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.386+0000 7fb1aeffd640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1b011b140 0x7fb1b01abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.387+0000 7fb1aeffd640 1 -- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 msgr2=0x7fb1b01a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.387+0000 7fb1aeffd640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b01a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.387+0000 7fb1aeffd640 1 -- 172.21.15.1:0/2375836162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b01ac220 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.387+0000 7fb1af7fe640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b01a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.387+0000 7fb1aeffd640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400d950 tx=0x7fb1a400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.391+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4017070 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.391+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1a4009c30 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.391+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400f6b0 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.391+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b01ac510 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.391+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b01b3df0 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.392+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b01a85d0 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.394+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb1a40109d0 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.395+0000 7fb1acff9640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 0x7fb1980a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.395+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fb1a40cf990 con 0x7fb1b0109830 2024-09-19T05:46:58.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.395+0000 7fb1af7fe640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 0x7fb1980a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:46:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.396+0000 7fb1af7fe640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 0x7fb1980a57c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a002a900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:46:58.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.399+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1a4009de0 con 0x7fb1b0109830 2024-09-19T05:46:58.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.752+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1b010b3a0 con 0x7fb1b0109830 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.753+0000 7fb1acff9640 1 -- 172.21.15.1:0/2375836162 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+578 (secure 0 0 0) 0x7fb1b010b3a0 con 0x7fb1b0109830 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/809983124 2024-09-20T05:12:09.745993+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/2966742919 2024-09-20T05:12:09.745993+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2268063463 2024-09-20T05:12:09.745993+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/449595009 2024-09-20T05:12:09.745993+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/3800466162 2024-09-20T05:11:44.793185+0000 2024-09-19T05:46:58.755 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/899239314 2024-09-20T05:11:44.793185+0000 2024-09-19T05:46:58.756 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1905634441 2024-09-20T05:11:44.793185+0000 2024-09-19T05:46:58.756 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/149790801 2024-09-20T05:11:44.793185+0000 2024-09-19T05:46:58.756 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-19T05:46:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.756+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 msgr2=0x7fb1980a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.756+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 0x7fb1980a57c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0000c00 tx=0x7fb1a002a900 comp rx=0 tx=0).stop 2024-09-19T05:46:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.756+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 msgr2=0x7fb1b01a77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:46:58.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.756+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400d950 tx=0x7fb1a400de10 comp rx=0 tx=0).stop 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.757+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 shutdown_connections 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.757+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fb1980a3300 0x7fb1980a57c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.757+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1b011b140 0x7fb1b01abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.757+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1b0109830 0x7fb1b01a77b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.758+0000 7fb1b5d6a640 1 --2- 172.21.15.1:0/2375836162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb1b0109450 0x7fb1b01a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.758+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 >> 172.21.15.1:0/2375836162 conn(0x7fb1b006e140 msgr2=0x7fb1b011bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.758+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 shutdown_connections 2024-09-19T05:46:58.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:46:58.758+0000 7fb1b5d6a640 1 -- 172.21.15.1:0/2375836162 wait complete. 2024-09-19T05:46:59.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:58 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2375836162' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:46:59.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:58 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2375836162' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:46:59.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:58 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2375836162' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:46:59.599 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T05:46:59.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:46:59.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T05:47:00.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:46:59 smithi001 ceph-mon[30968]: pgmap v1125: 129 pgs: 129 active+clean; 318 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 3.4 MiB/s wr, 226 op/s 2024-09-19T05:47:00.151 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:46:59 smithi060 ceph-mon[35058]: pgmap v1125: 129 pgs: 129 active+clean; 318 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 3.4 MiB/s wr, 226 op/s 2024-09-19T05:47:00.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:46:59 smithi082 ceph-mon[35195]: pgmap v1125: 129 pgs: 129 active+clean; 318 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 3.4 MiB/s wr, 226 op/s 2024-09-19T05:47:01.126 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T05:47:01.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:01.126 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:47:01.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:01.171 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T05:47:01.200 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:47:01.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:01.200 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:47:01.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:47:01.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T05:47:01.379 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T05:47:01.405 INFO:tasks.cephadm:Teardown begin 2024-09-19T05:47:01.405 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T05:47:01.406 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:47:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:02.029 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:01 smithi001 ceph-mon[30968]: pgmap v1126: 129 pgs: 129 active+clean; 323 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 4.0 MiB/s wr, 233 op/s 2024-09-19T05:47:02.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:01 smithi060 ceph-mon[35058]: pgmap v1126: 129 pgs: 129 active+clean; 323 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 4.0 MiB/s wr, 233 op/s 2024-09-19T05:47:02.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:01 smithi082 ceph-mon[35195]: pgmap v1126: 129 pgs: 129 active+clean; 323 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 4.0 MiB/s wr, 233 op/s 2024-09-19T05:47:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3657509554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc110220 msgr2=0x7fc3dc06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3657509554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc110220 0x7fc3dc06e4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a400 comp rx=0 tx=0).stop 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3657509554 shutdown_connections 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3657509554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc11b140 0x7fc3dc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3657509554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3657509554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc110220 0x7fc3dc06e4f0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a400 comp rx=0 tx=0).stop 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.508+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3657509554 >> 172.21.15.1:0/3657509554 conn(0x7fc3dc073210 msgr2=0x7fc3dc073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.509+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3657509554 shutdown_connections 2024-09-19T05:47:02.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.509+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3657509554 wait complete. 2024-09-19T05:47:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.510+0000 7fc3e15f1640 1 Processor -- start 2024-09-19T05:47:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.511+0000 7fc3e15f1640 1 -- start start 2024-09-19T05:47:02.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.511+0000 7fc3e15f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc1a7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.511+0000 7fc3e15f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 0x7fc3dc1a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.511+0000 7fc3e15f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 0x7fc3dc1ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.512+0000 7fc3e15f1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc120dc0 con 0x7fc3dc11b140 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.512+0000 7fc3e15f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc120c40 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.512+0000 7fc3e15f1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc120f40 con 0x7fc3dc06ea30 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.512+0000 7fc3daffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc1a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 0x7fc3dc1ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3daffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc1a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.1:55854/0 (socket says 172.21.15.1:55854) 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3daffd640 1 -- 172.21.15.1:0/3682432619 learned_addr learned my addr 172.21.15.1:0/3682432619 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3da7fc640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 0x7fc3dc1a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 -- 172.21.15.1:0/3682432619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 msgr2=0x7fc3dc1a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc1a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 -- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 msgr2=0x7fc3dc1a7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 0x7fc3dc1a7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3db7fe640 1 -- 172.21.15.1:0/3682432619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc1ac890 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.513+0000 7fc3da7fc640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 0x7fc3dc1a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.514+0000 7fc3db7fe640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 0x7fc3dc1ac280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b410 tx=0x7fc3cc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.514+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc015020 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.514+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3cc011d10 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.514+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00f2e0 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.515+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc1acb80 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.515+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc1b4310 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.516+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3dc06e4f0 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.518+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc3cc018020 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.519+0000 7fc3c3fff640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 0x7fc3c40a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:02.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.519+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7fc3cc0cf7e0 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.520+0000 7fc3daffd640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 0x7fc3c40a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:02.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.521+0000 7fc3daffd640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 0x7fc3c40a5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005ab0 tx=0x7fc3d0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.524+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3cc01f020 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.903+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3dc1b46c0 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.904+0000 7fc3c3fff640 1 -- 172.21.15.1:0/3682432619 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7fc3cc01f020 con 0x7fc3dc1abdd0 2024-09-19T05:47:02.907 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:47:02.907 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:47:02.907 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:47:02.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 msgr2=0x7fc3c40a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 0x7fc3c40a5840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0005ab0 tx=0x7fc3d0005fd0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 msgr2=0x7fc3dc1ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 0x7fc3dc1ac280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00b410 tx=0x7fc3cc00b8d0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 shutdown_connections 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7fc3c40a3380 0x7fc3c40a5840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc1abdd0 0x7fc3dc1ac280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3dc11b140 0x7fc3dc1a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 --2- 172.21.15.1:0/3682432619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3dc06ea30 0x7fc3dc1a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.907+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 >> 172.21.15.1:0/3682432619 conn(0x7fc3dc073210 msgr2=0x7fc3dc119130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.908+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 shutdown_connections 2024-09-19T05:47:02.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:02.908+0000 7fc3e15f1640 1 -- 172.21.15.1:0/3682432619 wait complete. 2024-09-19T05:47:04.069 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:47:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:03 smithi001 ceph-mon[30968]: pgmap v1127: 129 pgs: 129 active+clean; 346 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 7.4 MiB/s wr, 265 op/s 2024-09-19T05:47:04.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:03 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3682432619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:03 smithi060 ceph-mon[35058]: pgmap v1127: 129 pgs: 129 active+clean; 346 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 7.4 MiB/s wr, 265 op/s 2024-09-19T05:47:04.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:03 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3682432619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:03 smithi082 ceph-mon[35195]: pgmap v1127: 129 pgs: 129 active+clean; 346 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 7.4 MiB/s wr, 265 op/s 2024-09-19T05:47:04.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:03 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3682432619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:04.336 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 -- 172.21.15.1:0/2561961286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41036e0 msgr2=0x7f9ed4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/2561961286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41036e0 0x7f9ed4107b90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8009930 tx=0x7f9ec802a420 comp rx=0 tx=0).stop 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 -- 172.21.15.1:0/2561961286 shutdown_connections 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/2561961286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 0x7f9ed410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/2561961286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed41036e0 0x7f9ed4107b90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/2561961286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed4102d30 0x7f9ed4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 -- 172.21.15.1:0/2561961286 >> 172.21.15.1:0/2561961286 conn(0x7f9ed40fc7d0 msgr2=0x7f9ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:04.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 -- 172.21.15.1:0/2561961286 shutdown_connections 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.845+0000 7f9ed9a43640 1 -- 172.21.15.1:0/2561961286 wait complete. 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 Processor -- start 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 -- start start 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed41036e0 0x7f9ed4198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 0x7f9ed419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed41120a0 con 0x7f9ed4102d30 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4111f20 con 0x7f9ed41036e0 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed9a43640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4112220 con 0x7f9ed41082a0 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44668/0 (socket says 172.21.15.1:44668) 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed2ffd640 1 -- 172.21.15.1:0/1390652712 learned_addr learned my addr 172.21.15.1:0/1390652712 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:04.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed27fc640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed41036e0 0x7f9ed4198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.846+0000 7f9ed37fe640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 0x7f9ed419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 -- 172.21.15.1:0/1390652712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 msgr2=0x7f9ed419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 0x7f9ed419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 -- 172.21.15.1:0/1390652712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed41036e0 msgr2=0x7f9ed4198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed41036e0 0x7f9ed4198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 -- 172.21.15.1:0/1390652712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed419d5b0 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed2ffd640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400eab0 tx=0x7f9ec400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400ce40 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec4011950 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed419d8a0 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4010ae0 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.847+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41a5180 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.848+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4103110 con 0x7f9ed4102d30 2024-09-19T05:47:04.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.849+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9ec4011b00 con 0x7f9ed4102d30 2024-09-19T05:47:04.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.850+0000 7f9ed8a41640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 0x7f9ebc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:04.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.850+0000 7f9ed27fc640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 0x7f9ebc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:04.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.850+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f9ec40d0390 con 0x7f9ed4102d30 2024-09-19T05:47:04.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.850+0000 7f9ed27fc640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 0x7f9ebc0a5780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8005940 tx=0x7f9ec80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:04.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:04.854+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ec4016030 con 0x7f9ed4102d30 2024-09-19T05:47:05.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.066+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed410a2b0 con 0x7f9ed4102d30 2024-09-19T05:47:05.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.066+0000 7f9ed8a41640 1 -- 172.21.15.1:0/1390652712 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11827 (secure 0 0 0) 0x7f9ec409cca0 con 0x7f9ed4102d30 2024-09-19T05:47:05.068 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:47:05.069 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T05:19:47:132667+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/499392248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":499392248},{"type":"v1","addr":"172.21.15.1:6835","nonce":499392248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4202429907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4202429907},{"type":"v1","addr":"172.21.15.1:6837","nonce":4202429907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/3689811065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":3689811065},{"type":"v1","addr":"172.21.15.1:6839","nonce":3689811065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3860921021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3860921021},{"type":"v1","addr":"172.21.15.1:6841","nonce":3860921021}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/3384631993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3384631993},{"type":"v1","addr":"172.21.15.60:6833","nonce":3384631993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2252846405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2252846405},{"type":"v1","addr":"172.21.15.60:6835","nonce":2252846405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/4115388228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":4115388228},{"type":"v1","addr":"172.21.15.82:6833","nonce":4115388228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1092440333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1092440333},{"type":"v1","addr":"172.21.15.60:6837","nonce":1092440333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3661072126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3661072126},{"type":"v1","addr":"172.21.15.82:6835","nonce":3661072126}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3379829204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":3379829204},{"type":"v1","addr":"172.21.15.82:6837","nonce":3379829204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:19:02.579382+0000","modified":"2024-09-19T05:19:46.933700+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/1625002585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1625002585},{"type":"v1","addr":"172.21.15.60:6839","nonce":1625002585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.82:6839/1656123730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1656123730},{"type":"v1","addr":"172.21.15.82:6839","nonce":1656123730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472]},"id":1}]} 2024-09-19T05:47:05.069 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 msgr2=0x7f9ebc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 0x7f9ebc0a5780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8005940 tx=0x7f9ec80058d0 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 msgr2=0x7f9ed4198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400eab0 tx=0x7f9ec400ef70 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 shutdown_connections 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f9ebc0a32c0 0x7f9ebc0a5780 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed41082a0 0x7f9ed419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ed41036e0 0x7f9ed4198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 --2- 172.21.15.1:0/1390652712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ed4102d30 0x7f9ed4198600 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:05.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 >> 172.21.15.1:0/1390652712 conn(0x7f9ed40fc7d0 msgr2=0x7f9ed4105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:05.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 shutdown_connections 2024-09-19T05:47:05.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:05.069+0000 7f9ed9a43640 1 -- 172.21.15.1:0/1390652712 wait complete. 2024-09-19T05:47:05.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:47:06.075 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:06.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:05 smithi001 ceph-mon[30968]: pgmap v1128: 129 pgs: 129 active+clean; 319 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 7.6 MiB/s wr, 237 op/s 2024-09-19T05:47:06.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:05 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1390652712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:06.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:05 smithi060 ceph-mon[35058]: pgmap v1128: 129 pgs: 129 active+clean; 319 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 7.6 MiB/s wr, 237 op/s 2024-09-19T05:47:06.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:05 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1390652712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:05 smithi082 ceph-mon[35195]: pgmap v1128: 129 pgs: 129 active+clean; 319 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 7.6 MiB/s wr, 237 op/s 2024-09-19T05:47:06.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:05 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1390652712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:47:06.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 -- 172.21.15.1:0/3971280592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7080103660 msgr2=0x7f708010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 --2- 172.21.15.1:0/3971280592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7080103660 0x7f708010bb50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7074009900 tx=0x7f707402a480 comp rx=0 tx=0).stop 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 -- 172.21.15.1:0/3971280592 shutdown_connections 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 --2- 172.21.15.1:0/3971280592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f708010c170 0x7f708010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 --2- 172.21.15.1:0/3971280592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7080103660 0x7f708010bb50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 --2- 172.21.15.1:0/3971280592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 0x7f7080103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:06.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 -- 172.21.15.1:0/3971280592 >> 172.21.15.1:0/3971280592 conn(0x7f70800fc7a0 msgr2=0x7f70800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:06.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 -- 172.21.15.1:0/3971280592 shutdown_connections 2024-09-19T05:47:06.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.843+0000 7f7085108640 1 -- 172.21.15.1:0/3971280592 wait complete. 2024-09-19T05:47:06.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.844+0000 7f7085108640 1 Processor -- start 2024-09-19T05:47:06.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.844+0000 7f7085108640 1 -- start start 2024-09-19T05:47:06.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.844+0000 7f7085108640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 0x7f70801009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:06.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f7085108640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7080103660 0x7f7080100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:06.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f7085108640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:06.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f7085108640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7080111f70 con 0x7f708010c170 2024-09-19T05:47:06.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f7085108640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7080111df0 con 0x7f7080102d40 2024-09-19T05:47:06.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f7085108640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70801120f0 con 0x7f7080103660 2024-09-19T05:47:06.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44692/0 (socket says 172.21.15.1:44692) 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 -- 172.21.15.1:0/4207389948 learned_addr learned my addr 172.21.15.1:0/4207389948 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707e59c640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7080103660 0x7f7080100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707ed9d640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 0x7f70801009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 -- 172.21.15.1:0/4207389948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7080103660 msgr2=0x7f7080100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:06.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7080103660 0x7f7080100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:06.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 -- 172.21.15.1:0/4207389948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 msgr2=0x7f70801009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:06.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 0x7f70801009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:06.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 -- 172.21.15.1:0/4207389948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70801a68d0 con 0x7f708010c170 2024-09-19T05:47:06.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.845+0000 7f707f59e640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f707800eaa0 tx=0x7f707800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:06.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.846+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707800cdb0 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.846+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7078005020 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.846+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70801a6bc0 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.846+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70780116b0 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.846+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70801a7080 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.847+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7080103120 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.848+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7078005560 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.848+0000 7f7067fff640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 0x7f70680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.849+0000 7f707ed9d640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 0x7f70680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.849+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f70780cfe20 con 0x7f708010c170 2024-09-19T05:47:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.849+0000 7f707ed9d640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 0x7f70680a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f707000bbe0 tx=0x7f707000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:06.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:06.853+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7078016030 con 0x7f708010c170 2024-09-19T05:47:07.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.028+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70801071e0 con 0x7f708010c170 2024-09-19T05:47:07.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.030+0000 7f7067fff640 1 -- 172.21.15.1:0/4207389948 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24749 (secure 0 0 0) 0x7f707809c140 con 0x7f708010c170 2024-09-19T05:47:07.033 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T05:47:07.033 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":91,"fsid":"7ab08e8a-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:11:21.229693+0000","modified":"2024-09-19T05:21:11.868828+0000","last_up_change":"2024-09-19T05:18:11.672955+0000","last_in_change":"2024-09-19T05:17:48.783066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:14:26.275871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:18:58.627182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:19:00.914639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T05:19:07.429054+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a55e2ad0-856c-4327-b992-1d8269cb4822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6803","nonce":1004052295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6805","nonce":1004052295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6809","nonce":1004052295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":1004052295},{"type":"v1","addr":"172.21.15.1:6807","nonce":1004052295}]},"public_addr":"172.21.15.1:6803/1004052295","cluster_addr":"172.21.15.1:6805/1004052295","heartbeat_back_addr":"172.21.15.1:6809/1004052295","heartbeat_front_addr":"172.21.15.1:6807/1004052295","state":["exists","up"]},{"osd":1,"uuid":"8ab3f0a0-9572-420a-a9bd-b0bf499761b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6801","nonce":2687395785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6803","nonce":2687395785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6807","nonce":2687395785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2687395785},{"type":"v1","addr":"172.21.15.60:6805","nonce":2687395785}]},"public_addr":"172.21.15.60:6801/2687395785","cluster_addr":"172.21.15.60:6803/2687395785","heartbeat_back_addr":"172.21.15.60:6807/2687395785","heartbeat_front_addr":"172.21.15.60:6805/2687395785","state":["exists","up"]},{"osd":2,"uuid":"d8f3e5ee-cf96-490f-b3e1-125f018ed9ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6801","nonce":1735149029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6803","nonce":1735149029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6807","nonce":1735149029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1735149029},{"type":"v1","addr":"172.21.15.82:6805","nonce":1735149029}]},"public_addr":"172.21.15.82:6801/1735149029","cluster_addr":"172.21.15.82:6803/1735149029","heartbeat_back_addr":"172.21.15.82:6807/1735149029","heartbeat_front_addr":"172.21.15.82:6805/1735149029","state":["exists","up"]},{"osd":3,"uuid":"a561d3ad-02a1-4328-8553-d1974ff00b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6811","nonce":1943710877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6813","nonce":1943710877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6817","nonce":1943710877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1943710877},{"type":"v1","addr":"172.21.15.1:6815","nonce":1943710877}]},"public_addr":"172.21.15.1:6811/1943710877","cluster_addr":"172.21.15.1:6813/1943710877","heartbeat_back_addr":"172.21.15.1:6817/1943710877","heartbeat_front_addr":"172.21.15.1:6815/1943710877","state":["exists","up"]},{"osd":4,"uuid":"fc98f99a-3a3b-471f-b883-2288983fea40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6809","nonce":2639203045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6811","nonce":2639203045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6815","nonce":2639203045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":2639203045},{"type":"v1","addr":"172.21.15.60:6813","nonce":2639203045}]},"public_addr":"172.21.15.60:6809/2639203045","cluster_addr":"172.21.15.60:6811/2639203045","heartbeat_back_addr":"172.21.15.60:6815/2639203045","heartbeat_front_addr":"172.21.15.60:6813/2639203045","state":["exists","up"]},{"osd":5,"uuid":"41f74801-2f20-401e-832b-dda19c19dc0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6809","nonce":3813280468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6811","nonce":3813280468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6815","nonce":3813280468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":3813280468},{"type":"v1","addr":"172.21.15.82:6813","nonce":3813280468}]},"public_addr":"172.21.15.82:6809/3813280468","cluster_addr":"172.21.15.82:6811/3813280468","heartbeat_back_addr":"172.21.15.82:6815/3813280468","heartbeat_front_addr":"172.21.15.82:6813/3813280468","state":["exists","up"]},{"osd":6,"uuid":"8042adc6-6495-4a69-b68d-80eb89b0bb10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6819","nonce":362262349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6821","nonce":362262349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6825","nonce":362262349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":362262349},{"type":"v1","addr":"172.21.15.1:6823","nonce":362262349}]},"public_addr":"172.21.15.1:6819/362262349","cluster_addr":"172.21.15.1:6821/362262349","heartbeat_back_addr":"172.21.15.1:6825/362262349","heartbeat_front_addr":"172.21.15.1:6823/362262349","state":["exists","up"]},{"osd":7,"uuid":"92e56ba4-2266-4114-ae5a-b1ad70466a80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6817","nonce":2153188266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6819","nonce":2153188266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6823","nonce":2153188266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2153188266},{"type":"v1","addr":"172.21.15.60:6821","nonce":2153188266}]},"public_addr":"172.21.15.60:6817/2153188266","cluster_addr":"172.21.15.60:6819/2153188266","heartbeat_back_addr":"172.21.15.60:6823/2153188266","heartbeat_front_addr":"172.21.15.60:6821/2153188266","state":["exists","up"]},{"osd":8,"uuid":"92651b21-a5b1-4a2c-9184-f7b0aba6d80b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6817","nonce":500561278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6819","nonce":500561278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6823","nonce":500561278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":500561278},{"type":"v1","addr":"172.21.15.82:6821","nonce":500561278}]},"public_addr":"172.21.15.82:6817/500561278","cluster_addr":"172.21.15.82:6819/500561278","heartbeat_back_addr":"172.21.15.82:6823/500561278","heartbeat_front_addr":"172.21.15.82:6821/500561278","state":["exists","up"]},{"osd":9,"uuid":"79a1f3bd-2ff5-46bd-83e6-f7e5d7bf0129","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6827","nonce":2188836925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6829","nonce":2188836925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6833","nonce":2188836925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":2188836925},{"type":"v1","addr":"172.21.15.1:6831","nonce":2188836925}]},"public_addr":"172.21.15.1:6827/2188836925","cluster_addr":"172.21.15.1:6829/2188836925","heartbeat_back_addr":"172.21.15.1:6833/2188836925","heartbeat_front_addr":"172.21.15.1:6831/2188836925","state":["exists","up"]},{"osd":10,"uuid":"2d933695-bb7f-45e0-a78b-63c8c46416cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6825","nonce":1005024509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6827","nonce":1005024509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6831","nonce":1005024509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1005024509},{"type":"v1","addr":"172.21.15.60:6829","nonce":1005024509}]},"public_addr":"172.21.15.60:6825/1005024509","cluster_addr":"172.21.15.60:6827/1005024509","heartbeat_back_addr":"172.21.15.60:6831/1005024509","heartbeat_front_addr":"172.21.15.60:6829/1005024509","state":["exists","up"]},{"osd":11,"uuid":"6a116c52-7fb1-4b79-af77-9624f9bf686e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6825","nonce":2019890108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6827","nonce":2019890108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6831","nonce":2019890108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2019890108},{"type":"v1","addr":"172.21.15.82:6829","nonce":2019890108}]},"public_addr":"172.21.15.82:6825/2019890108","cluster_addr":"172.21.15.82:6827/2019890108","heartbeat_back_addr":"172.21.15.82:6831/2019890108","heartbeat_front_addr":"172.21.15.82:6829/2019890108","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:33.621339+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:59.016935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:22.774884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:47.602225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:13.564307+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:38.640111+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:03.549133+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:28.248044+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:53.506298+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:20.299935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:17:45.149476+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:18:10.325770+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.18","mappings":[{"from":5,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:0/809983124":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6800/2966742919":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/2268063463":"2024-09-20T05:12:09.745993+0000","172.21.15.1:0/449595009":"2024-09-20T05:12:09.745993+0000","172.21.15.1:6801/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:6800/3800466162":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/899239314":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/1905634441":"2024-09-20T05:11:44.793185+0000","172.21.15.1:0/149790801":"2024-09-20T05:11:44.793185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 msgr2=0x7f70680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 0x7f70680a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f707000bbe0 tx=0x7f707000b390 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 msgr2=0x7f7080101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f707800eaa0 tx=0x7f707800ef60 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 shutdown_connections 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f70680a3240 0x7f70680a5700 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708010c170 0x7f7080101420 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7080103660 0x7f7080100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 --2- 172.21.15.1:0/4207389948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7080102d40 0x7f70801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 >> 172.21.15.1:0/4207389948 conn(0x7f70800fc7a0 msgr2=0x7f70800fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:07.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 shutdown_connections 2024-09-19T05:47:07.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:07.033+0000 7f7085108640 1 -- 172.21.15.1:0/4207389948 wait complete. 2024-09-19T05:47:07.785 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T05:47:08.051 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:07 smithi001 ceph-mon[30968]: pgmap v1129: 129 pgs: 129 active+clean; 252 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 8.2 MiB/s wr, 287 op/s 2024-09-19T05:47:08.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:07 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4207389948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:47:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:07 smithi060 ceph-mon[35058]: pgmap v1129: 129 pgs: 129 active+clean; 252 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 8.2 MiB/s wr, 287 op/s 2024-09-19T05:47:08.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:07 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4207389948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:47:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:07 smithi082 ceph-mon[35195]: pgmap v1129: 129 pgs: 129 active+clean; 252 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 8.2 MiB/s wr, 287 op/s 2024-09-19T05:47:08.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:07 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4207389948' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:47:08.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.581+0000 7f4a542ae640 1 -- 172.21.15.1:0/3494911534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c102790 msgr2=0x7f4a4c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.581+0000 7f4a542ae640 1 --2- 172.21.15.1:0/3494911534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c102790 0x7f4a4c1067e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009900 tx=0x7f4a4002a410 comp rx=0 tx=0).stop 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 -- 172.21.15.1:0/3494911534 shutdown_connections 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 --2- 172.21.15.1:0/3494911534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 0x7f4a4c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 --2- 172.21.15.1:0/3494911534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c102790 0x7f4a4c1067e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 --2- 172.21.15.1:0/3494911534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c101de0 0x7f4a4c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 -- 172.21.15.1:0/3494911534 >> 172.21.15.1:0/3494911534 conn(0x7f4a4c0fd8c0 msgr2=0x7f4a4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 -- 172.21.15.1:0/3494911534 shutdown_connections 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 -- 172.21.15.1:0/3494911534 wait complete. 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 Processor -- start 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 -- start start 2024-09-19T05:47:08.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.582+0000 7f4a542ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c102790 0x7f4a4c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a542ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 0x7f4a4c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a542ae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c112010 con 0x7f4a4c101de0 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a542ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c111e90 con 0x7f4a4c106f10 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a542ae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c112190 con 0x7f4a4c102790 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44706/0 (socket says 172.21.15.1:44706) 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 -- 172.21.15.1:0/1339909447 learned_addr learned my addr 172.21.15.1:0/1339909447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5284b640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 0x7f4a4c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a51849640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c102790 0x7f4a4c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 -- 172.21.15.1:0/1339909447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c102790 msgr2=0x7f4a4c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c102790 0x7f4a4c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 -- 172.21.15.1:0/1339909447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 msgr2=0x7f4a4c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 0x7f4a4c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 -- 172.21.15.1:0/1339909447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4c1a6a70 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.583+0000 7f4a5204a640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00ba50 tx=0x7f4a3c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.584+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c019070 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.584+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4c1a6d60 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.584+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3c00cbe0 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.584+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c0076e0 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.584+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a4c1a71c0 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.585+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4c102240 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.586+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4a3c01c070 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.587+0000 7f4a4b7fe640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.587+0000 7f4a51849640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.587+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9179+0+0 (secure 0 0 0) 0x7f4a3c0cf320 con 0x7f4a4c101de0 2024-09-19T05:47:08.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.587+0000 7f4a51849640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 0x7f4a340a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000c00 tx=0x7f4a400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:08.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.591+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a3c09b5e0 con 0x7f4a4c101de0 2024-09-19T05:47:08.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.803+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4a4c10a0f0 con 0x7f4a4c101de0 2024-09-19T05:47:08.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.805+0000 7f4a4b7fe640 1 -- 172.21.15.1:0/1339909447 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f4a3c09f8e0 con 0x7f4a4c101de0 2024-09-19T05:47:08.807 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T05:47:08.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 msgr2=0x7f4a340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:08.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 0x7f4a340a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000c00 tx=0x7f4a400058d0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 msgr2=0x7f4a4c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:08.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00ba50 tx=0x7f4a3c00bf10 comp rx=0 tx=0).stop 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 shutdown_connections 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4a340a3240 0x7f4a340a5700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a4c106f10 0x7f4a4c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c102790 0x7f4a4c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 --2- 172.21.15.1:0/1339909447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a4c101de0 0x7f4a4c0744f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.808+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 >> 172.21.15.1:0/1339909447 conn(0x7f4a4c0fd8c0 msgr2=0x7f4a4c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.809+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 shutdown_connections 2024-09-19T05:47:08.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:08.809+0000 7f4a542ae640 1 -- 172.21.15.1:0/1339909447 wait complete. 2024-09-19T05:47:09.091 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a[30964]: 2024-09-19T05:47:08.804+0000 7f14b2981640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:47:09.092 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:08 smithi001 ceph-mon[30968]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mon[35058]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:47:09.251 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: ignoring --setuser ceph since I am not root 2024-09-19T05:47:09.252 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: ignoring --setgroup ceph since I am not root 2024-09-19T05:47:09.252 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-mds[64529]: -- 172.21.15.60:0/2032323804 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562b7405860 con 0x5562b73e3000 2024-09-19T05:47:09.252 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:47:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: starting mds.b at 2024-09-19T05:47:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T05:47:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T05:47:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T05:47:09.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1339909447' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mon[35195]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: ignoring --setuser ceph since I am not root 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: ignoring --setgroup ceph since I am not root 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-mds[66075]: -- 172.21.15.82:0/4095859236 <== mon.1 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652223ab860 con 0x565222389400 2024-09-19T05:47:09.259 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:47:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: starting mds.i at 2024-09-19T05:47:10.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:09 smithi060 ceph-mon[35058]: pgmap v1130: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 7.6 MiB/s wr, 289 op/s 2024-09-19T05:47:10.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:09 smithi082 ceph-mon[35195]: pgmap v1130: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 7.6 MiB/s wr, 289 op/s 2024-09-19T05:47:10.314 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:09 smithi001 ceph-mon[30968]: pgmap v1130: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 7.6 MiB/s wr, 289 op/s 2024-09-19T05:47:10.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T05:47:10.617 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:11.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:10 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.60:6838/3420001522,v1:172.21.15.60:6839/3420001522] up:boot 2024-09-19T05:47:11.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:10 smithi001 ceph-mon[30968]: mds.? [v2:172.21.15.82:6838/1006229756,v1:172.21.15.82:6839/1006229756] up:boot 2024-09-19T05:47:11.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:10 smithi001 ceph-mon[30968]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:47:11.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:47:11.044 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:10 smithi001 ceph-mon[30968]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:47:11.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.126+0000 7ff491501640 1 -- 172.21.15.1:0/886145390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c102d30 msgr2=0x7ff48c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:11.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.126+0000 7ff491501640 1 --2- 172.21.15.1:0/886145390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c102d30 0x7ff48c103110 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009930 tx=0x7ff47c02a440 comp rx=0 tx=0).stop 2024-09-19T05:47:11.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.126+0000 7ff491501640 1 -- 172.21.15.1:0/886145390 shutdown_connections 2024-09-19T05:47:11.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.126+0000 7ff491501640 1 --2- 172.21.15.1:0/886145390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.126+0000 7ff491501640 1 --2- 172.21.15.1:0/886145390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c1036e0 0x7ff48c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 --2- 172.21.15.1:0/886145390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c102d30 0x7ff48c103110 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 -- 172.21.15.1:0/886145390 >> 172.21.15.1:0/886145390 conn(0x7ff48c0fc7d0 msgr2=0x7ff48c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 -- 172.21.15.1:0/886145390 shutdown_connections 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 -- 172.21.15.1:0/886145390 wait complete. 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 Processor -- start 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.127+0000 7ff491501640 1 -- start start 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c102d30 0x7ff48c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c1120a0 con 0x7ff48c1036e0 2024-09-19T05:47:11.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c111f20 con 0x7ff48c102d30 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff491501640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c112220 con 0x7ff48c1082a0 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44726/0 (socket says 172.21.15.1:44726) 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 -- 172.21.15.1:0/1408271272 learned_addr learned my addr 172.21.15.1:0/1408271272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48affd640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c102d30 0x7ff48c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48b7fe640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 -- 172.21.15.1:0/1408271272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 msgr2=0x7ff48c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 -- 172.21.15.1:0/1408271272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c102d30 msgr2=0x7ff48c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c102d30 0x7ff48c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 -- 172.21.15.1:0/1408271272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1a6960 con 0x7ff48c1036e0 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48b7fe640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:11.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff48a7fc640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c8c0 tx=0x7ff48000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.128+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480007bb0 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.129+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff480007d50 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.129+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c1a6c50 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.129+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480018830 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.129+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1a7190 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.130+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c06a850 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.132+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff4800189f0 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.132+0000 7ff473fff640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 0x7ff4740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.132+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9265+0+0 (secure 0 0 0) 0x7ff4800d00f0 con 0x7ff48c1036e0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.132+0000 7ff48affd640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 0x7ff4740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.133+0000 7ff48affd640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 0x7ff4740a5700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009900 tx=0x7ff47c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:11.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.135+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff480014030 con 0x7ff48c1036e0 2024-09-19T05:47:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:10 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.60:6838/3420001522,v1:172.21.15.60:6839/3420001522] up:boot 2024-09-19T05:47:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:10 smithi060 ceph-mon[35058]: mds.? [v2:172.21.15.82:6838/1006229756,v1:172.21.15.82:6839/1006229756] up:boot 2024-09-19T05:47:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:10 smithi060 ceph-mon[35058]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:47:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:47:11.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:10 smithi060 ceph-mon[35058]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:47:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:10 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.60:6838/3420001522,v1:172.21.15.60:6839/3420001522] up:boot 2024-09-19T05:47:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:10 smithi082 ceph-mon[35195]: mds.? [v2:172.21.15.82:6838/1006229756,v1:172.21.15.82:6839/1006229756] up:boot 2024-09-19T05:47:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:10 smithi082 ceph-mon[35195]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T05:47:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:47:11.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:10 smithi082 ceph-mon[35195]: from='mgr.14150 172.21.15.1:0/3022912307' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:47:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.346+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff48c1a73c0 con 0x7ff48c1036e0 2024-09-19T05:47:11.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.851+0000 7ff473fff640 1 -- 172.21.15.1:0/1408271272 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7ff48009ca30 con 0x7ff48c1036e0 2024-09-19T05:47:11.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.853+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 msgr2=0x7ff4740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.853+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 0x7ff4740a5700 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009900 tx=0x7ff47c0058d0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.853+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 msgr2=0x7ff48c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.853+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c8c0 tx=0x7ff48000cd80 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 shutdown_connections 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7ff4740a3240 0x7ff4740a5700 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff48c1082a0 0x7ff48c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff48c1036e0 0x7ff48c100ed0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 --2- 172.21.15.1:0/1408271272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff48c102d30 0x7ff48c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 >> 172.21.15.1:0/1408271272 conn(0x7ff48c0fc7d0 msgr2=0x7ff48c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 shutdown_connections 2024-09-19T05:47:11.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:11.854+0000 7ff491501640 1 -- 172.21.15.1:0/1408271272 wait complete. 2024-09-19T05:47:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:11 smithi060 ceph-mon[35058]: pgmap v1132: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.3 MiB/s wr, 290 op/s 2024-09-19T05:47:12.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:11 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:47:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:11 smithi082 ceph-mon[35195]: pgmap v1132: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.3 MiB/s wr, 290 op/s 2024-09-19T05:47:12.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:11 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:47:12.341 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:11 smithi001 ceph-mon[30968]: pgmap v1132: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 7.3 MiB/s wr, 290 op/s 2024-09-19T05:47:12.342 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:11 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:47:12.887 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T05:47:13.150 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:12 smithi060 ceph-mon[35058]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:47:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:12 smithi060 ceph-mon[35058]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:47:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:12 smithi060 ceph-mon[35058]: Cluster is now healthy 2024-09-19T05:47:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:12 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:47:13.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:12 smithi060 ceph-mon[35058]: fsmap 12 up:standby 2024-09-19T05:47:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:12 smithi082 ceph-mon[35195]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:47:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:12 smithi082 ceph-mon[35195]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:47:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:12 smithi082 ceph-mon[35195]: Cluster is now healthy 2024-09-19T05:47:13.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:12 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:47:13.259 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:12 smithi082 ceph-mon[35195]: fsmap 12 up:standby 2024-09-19T05:47:13.271 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:12 smithi001 ceph-mon[30968]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T05:47:13.271 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:12 smithi001 ceph-mon[30968]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T05:47:13.271 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:12 smithi001 ceph-mon[30968]: Cluster is now healthy 2024-09-19T05:47:13.272 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:12 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/1408271272' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:47:13.272 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:12 smithi001 ceph-mon[30968]: fsmap 12 up:standby 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 -- 172.21.15.1:0/1860143342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03181008d0 msgr2=0x7f0318100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 --2- 172.21.15.1:0/1860143342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03181008d0 0x7f0318100cb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0314009900 tx=0x7f031402a410 comp rx=0 tx=0).stop 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 -- 172.21.15.1:0/1860143342 shutdown_connections 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 --2- 172.21.15.1:0/1860143342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f031810e480 0x7f0318110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 --2- 172.21.15.1:0/1860143342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0318101280 0x7f031810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 --2- 172.21.15.1:0/1860143342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f03181008d0 0x7f0318100cb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.670+0000 7f031f394640 1 -- 172.21.15.1:0/1860143342 >> 172.21.15.1:0/1860143342 conn(0x7f03180fc7a0 msgr2=0x7f03180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- 172.21.15.1:0/1860143342 shutdown_connections 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- 172.21.15.1:0/1860143342 wait complete. 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 Processor -- start 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- start start 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 0x7f03181a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 0x7f03181a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0318114260 con 0x7f031810e480 2024-09-19T05:47:13.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03181140e0 con 0x7f03181008d0 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.671+0000 7f031f394640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03181143e0 con 0x7f0318101280 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44736/0 (socket says 172.21.15.1:44736) 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 -- 172.21.15.1:0/3757334545 learned_addr learned my addr 172.21.15.1:0/3757334545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d130640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 0x7f03181a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031c92f640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 0x7f03181a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 -- 172.21.15.1:0/3757334545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 msgr2=0x7f03181a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 0x7f03181a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 -- 172.21.15.1:0/3757334545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 msgr2=0x7f03181a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 0x7f03181a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 -- 172.21.15.1:0/3757334545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031819aee0 con 0x7f031810e480 2024-09-19T05:47:13.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d130640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 0x7f03181a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031c92f640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 0x7f03181a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031d931640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f031000b9e0 tx=0x7f031000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310019070 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0310014440 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031819b1d0 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03100125a0 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.672+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03181a7520 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.673+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031806b070 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.675+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f031001c070 con 0x7f031810e480 2024-09-19T05:47:13.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.675+0000 7f030e7fc640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 0x7f03040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.675+0000 7f031d130640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 0x7f03040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.676+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9265+0+0 (secure 0 0 0) 0x7f03100cf800 con 0x7f031810e480 2024-09-19T05:47:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.676+0000 7f031d130640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 0x7f03040a5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0314005940 tx=0x7f03140058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:13.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.678+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f031009c0b0 con 0x7f031810e480 2024-09-19T05:47:13.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.855+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0318109610 con 0x7f031810e480 2024-09-19T05:47:13.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.862+0000 7f030e7fc640 1 -- 172.21.15.1:0/3757334545 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f031009b9b0 con 0x7f031810e480 2024-09-19T05:47:13.864 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.865+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 msgr2=0x7f03040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.865+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 0x7f03040a5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0314005940 tx=0x7f03140058b0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.865+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 msgr2=0x7f031819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.865+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f031000b9e0 tx=0x7f031000bea0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 shutdown_connections 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f03040a32c0 0x7f03040a5780 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f031810e480 0x7f031819a670 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0318101280 0x7f03181a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 --2- 172.21.15.1:0/3757334545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03181008d0 0x7f03181a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:13.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.866+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 >> 172.21.15.1:0/3757334545 conn(0x7f03180fc7a0 msgr2=0x7f03180feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.867+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 shutdown_connections 2024-09-19T05:47:13.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:13.867+0000 7f031f394640 1 -- 172.21.15.1:0/3757334545 wait complete. 2024-09-19T05:47:14.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:13 smithi001 ceph-mon[30968]: pgmap v1133: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.7 MiB/s wr, 193 op/s 2024-09-19T05:47:14.208 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:13 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:13 smithi060 ceph-mon[35058]: pgmap v1133: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.7 MiB/s wr, 193 op/s 2024-09-19T05:47:14.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:13 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:13 smithi082 ceph-mon[35195]: pgmap v1133: 129 pgs: 129 active+clean; 212 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.7 MiB/s wr, 193 op/s 2024-09-19T05:47:14.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:13 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:14.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T05:47:14.802 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:15.220 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:14 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:15.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:14 smithi001 ceph-mon[30968]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:47:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:14 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:15.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:14 smithi060 ceph-mon[35058]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:47:15.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:14 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/3757334545' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:15.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:14 smithi082 ceph-mon[35195]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:47:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 -- 172.21.15.1:0/2297471896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 msgr2=0x7f4b1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 --2- 172.21.15.1:0/2297471896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b1010d950 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009cd0 tx=0x7f4b0802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 -- 172.21.15.1:0/2297471896 shutdown_connections 2024-09-19T05:47:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 --2- 172.21.15.1:0/2297471896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b1010d950 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 --2- 172.21.15.1:0/2297471896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 0x7f4b10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 --2- 172.21.15.1:0/2297471896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 -- 172.21.15.1:0/2297471896 >> 172.21.15.1:0/2297471896 conn(0x7f4b100fc7a0 msgr2=0x7f4b100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 -- 172.21.15.1:0/2297471896 shutdown_connections 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.305+0000 7f4b18314640 1 -- 172.21.15.1:0/2297471896 wait complete. 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 Processor -- start 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 -- start start 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 0x7f4b10199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b101a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10110e80 con 0x7f4b10101420 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10110d00 con 0x7f4b10100a80 2024-09-19T05:47:15.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b18314640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10111000 con 0x7f4b10106a80 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b158af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b158af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46664/0 (socket says 172.21.15.1:46664) 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.306+0000 7f4b158af640 1 -- 172.21.15.1:0/4030899904 learned_addr learned my addr 172.21.15.1:0/4030899904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b168b1640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b101a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b160b0640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 0x7f4b10199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 -- 172.21.15.1:0/4030899904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 msgr2=0x7f4b101a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b101a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 -- 172.21.15.1:0/4030899904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 msgr2=0x7f4b10199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 0x7f4b10199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 -- 172.21.15.1:0/4030899904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b101a47c0 con 0x7f4b10101420 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b168b1640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b101a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b158af640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d950 tx=0x7f4b0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00017030 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b101a4990 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b00004020 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000047a0 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.307+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b101a4ed0 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.308+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b10100ee0 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.309+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4b000041d0 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.310+0000 7f4b077fe640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 0x7f4afc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.310+0000 7f4b160b0640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 0x7f4afc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.310+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8682+0+0 (secure 0 0 0) 0x7f4b000cfc10 con 0x7f4b10101420 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.311+0000 7f4b160b0640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 0x7f4afc0a5700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00cac0 tx=0x7f4b0c00c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:15.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.313+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b0009c770 con 0x7f4b10101420 2024-09-19T05:47:15.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.492+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b1006ad80 con 0x7f4b10101420 2024-09-19T05:47:15.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.875+0000 7f4b077fe640 1 -- 172.21.15.1:0/4030899904 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f4b0009c070 con 0x7f4b10101420 2024-09-19T05:47:15.877 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-19T05:47:15.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.881+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 msgr2=0x7f4afc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:15.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.881+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 0x7f4afc0a5700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00cac0 tx=0x7f4b0c00c4a0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.881+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 msgr2=0x7f4b10199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:15.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.881+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000d950 tx=0x7f4b0000de10 comp rx=0 tx=0).stop 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 shutdown_connections 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f4afc0a3240 0x7f4afc0a5700 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10106a80 0x7f4b101a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b10101420 0x7f4b10199740 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 --2- 172.21.15.1:0/4030899904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b10100a80 0x7f4b10199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.882+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 >> 172.21.15.1:0/4030899904 conn(0x7f4b100fc7a0 msgr2=0x7f4b100fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:15.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.883+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 shutdown_connections 2024-09-19T05:47:15.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:15.883+0000 7f4b18314640 1 -- 172.21.15.1:0/4030899904 wait complete. 2024-09-19T05:47:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:15 smithi060 ceph-mon[35058]: pgmap v1135: 97 pgs: 97 active+clean; 577 KiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:16.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:15 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:16.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:15 smithi082 ceph-mon[35195]: pgmap v1135: 97 pgs: 97 active+clean; 577 KiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:16.260 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:15 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:16.267 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:15 smithi001 ceph-mon[30968]: pgmap v1135: 97 pgs: 97 active+clean; 577 KiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:16.267 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:15 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:16.684 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T05:47:16.967 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:47:17.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:16 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:17.090 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:16 smithi001 ceph-mon[30968]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:47:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:16 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:17.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:16 smithi060 ceph-mon[35058]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:47:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:16 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/4030899904' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:17.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:16 smithi082 ceph-mon[35195]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T05:47:17.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 -- 172.21.15.1:0/1623474982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 msgr2=0x7f023810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:17.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 --2- 172.21.15.1:0/1623474982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023810ea90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0228009ca0 tx=0x7f022802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 -- 172.21.15.1:0/1623474982 shutdown_connections 2024-09-19T05:47:17.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 --2- 172.21.15.1:0/1623474982 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023810ea90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 --2- 172.21.15.1:0/1623474982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f02381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 --2- 172.21.15.1:0/1623474982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 0x7f02381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 -- 172.21.15.1:0/1623474982 >> 172.21.15.1:0/1623474982 conn(0x7f02380fd8c0 msgr2=0x7f02380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:17.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 -- 172.21.15.1:0/1623474982 shutdown_connections 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 -- 172.21.15.1:0/1623474982 wait complete. 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.469+0000 7f023d294640 1 Processor -- start 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 -- start start 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 0x7f02381983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f0238198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:17.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:17.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0238111f70 con 0x7f0238106f10 2024-09-19T05:47:17.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0238111df0 con 0x7f0238102790 2024-09-19T05:47:17.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f023d294640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02381120f0 con 0x7f0238101de0 2024-09-19T05:47:17.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:17.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46688/0 (socket says 172.21.15.1:46688) 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 -- 172.21.15.1:0/2301370532 learned_addr learned my addr 172.21.15.1:0/2301370532 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f0236ffd640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 0x7f02381983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02367fc640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f0238198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 -- 172.21.15.1:0/2301370532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 msgr2=0x7f02381983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 0x7f02381983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 -- 172.21.15.1:0/2301370532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 msgr2=0x7f0238198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f0238198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 -- 172.21.15.1:0/2301370532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023819d3a0 con 0x7f0238106f10 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02367fc640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f0238198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.470+0000 7f02377fe640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0228031a20 tx=0x7f0228031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.471+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228003c30 con 0x7f0238106f10 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.471+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023819d630 con 0x7f0238106f10 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.471+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0228003dd0 con 0x7f0238106f10 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.471+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022802fcf0 con 0x7f0238106f10 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.471+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381a4f70 con 0x7f0238106f10 2024-09-19T05:47:17.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.472+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02381021c0 con 0x7f0238106f10 2024-09-19T05:47:17.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.473+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0228004050 con 0x7f0238106f10 2024-09-19T05:47:17.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.473+0000 7f022ffff640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 0x7f02240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:47:17.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.474+0000 7f0236ffd640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 0x7f02240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:47:17.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.474+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8152+0+0 (secure 0 0 0) 0x7f02280f0c60 con 0x7f0238106f10 2024-09-19T05:47:17.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.474+0000 7f0236ffd640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 0x7f02240a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f023000bbe0 tx=0x7f023000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:47:17.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.478+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02280bda10 con 0x7f0238106f10 2024-09-19T05:47:17.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.653+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f023810a1b0 con 0x7f0238106f10 2024-09-19T05:47:17.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.895+0000 7f022ffff640 1 -- 172.21.15.1:0/2301370532 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v95) ==== 178+0+0 (secure 0 0 0) 0x7f022802fe90 con 0x7f0238106f10 2024-09-19T05:47:17.897 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data_ec' removed 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 msgr2=0x7f02240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 0x7f02240a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f023000bbe0 tx=0x7f023000b390 comp rx=0 tx=0).stop 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 msgr2=0x7f023819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0228031a20 tx=0x7f0228031a50 comp rx=0 tx=0).stop 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 shutdown_connections 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:6800/427915191,v1:172.21.15.1:6801/427915191] conn(0x7f02240a3240 0x7f02240a5700 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0238106f10 0x7f023819ccc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0238102790 0x7f0238198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 --2- 172.21.15.1:0/2301370532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0238101de0 0x7f02381983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:47:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 >> 172.21.15.1:0/2301370532 conn(0x7f02380fd8c0 msgr2=0x7f02380feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:47:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 shutdown_connections 2024-09-19T05:47:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T05:47:17.899+0000 7f023d294640 1 -- 172.21.15.1:0/2301370532 wait complete. 2024-09-19T05:47:17.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:17 smithi001 ceph-mon[30968]: pgmap v1137: 33 pgs: 33 active+clean; 577 KiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:17.922 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:17 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:18.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:17 smithi060 ceph-mon[35058]: pgmap v1137: 33 pgs: 33 active+clean; 577 KiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:18.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:17 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:17 smithi082 ceph-mon[35195]: pgmap v1137: 33 pgs: 33 active+clean; 577 KiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:47:18.258 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:17 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T05:47:18.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:47:18.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:47:18.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:47:18.767 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T05:47:18.767 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:47:18.783 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:47:18.812 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:47:18.828 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T05:47:18.829 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T05:47:18.829 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:47:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:18 smithi060 ceph-mon[35058]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:19.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:18 smithi060 ceph-mon[35058]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:47:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:18 smithi082 ceph-mon[35195]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:19.009 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:18 smithi082 ceph-mon[35195]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:47:19.133 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:18 smithi001 systemd[1]: Stopping Ceph mon.a for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:19.134 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:18 smithi001 ceph-mon[30968]: from='client.? 172.21.15.1:0/2301370532' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T05:47:19.134 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:18 smithi001 ceph-mon[30968]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T05:47:19.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a[30964]: 2024-09-19T05:47:19.130+0000 7f14b818c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a[30964]: 2024-09-19T05:47:19.130+0000 7f14b818c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T05:47:19.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 podman[102934]: 2024-09-19 05:47:19.263953809 +0000 UTC m=+0.241511771 container died 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T05:47:19.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 podman[102934]: 2024-09-19 05:47:19.706991379 +0000 UTC m=+0.684549330 container cleanup 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T05:47:19.926 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 bash[102934]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:47:20.183 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 05:47:19 smithi001 podman[102945]: 2024-09-19 05:47:19.925224876 +0000 UTC m=+0.657328629 container remove 17bf5b3fba5ebad58537d90bd66c121861f6cc1911a27baa2fc5e710fcc0c241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T05:47:20.187 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T05:47:20.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:20.237 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T05:47:20.237 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T05:47:20.237 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.b 2024-09-19T05:47:20.578 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:20 smithi060 systemd[1]: Stopping Ceph mon.b for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:20.862 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b[35054]: 2024-09-19T05:47:20.576+0000 7f50ed3fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:20.862 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b[35054]: 2024-09-19T05:47:20.576+0000 7f50ed3fc640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:47:20.863 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:20 smithi060 podman[71791]: 2024-09-19 05:47:20.607561011 +0000 UTC m=+0.153967562 container died 39084cdb32da397570636daf26efeb6bc81bb93bd8366fe1fb5afd9022f85286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T05:47:21.250 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 podman[71791]: 2024-09-19 05:47:21.052751024 +0000 UTC m=+0.599157573 container cleanup 39084cdb32da397570636daf26efeb6bc81bb93bd8366fe1fb5afd9022f85286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:47:21.251 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 bash[71791]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b 2024-09-19T05:47:21.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T05:47:21.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 podman[71803]: 2024-09-19 05:47:21.296180538 +0000 UTC m=+0.680732079 container remove 39084cdb32da397570636daf26efeb6bc81bb93bd8366fe1fb5afd9022f85286 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T05:47:21.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T05:47:21.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 systemd[1]: Stopped Ceph mon.b for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:47:21.553 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 19 05:47:21 smithi060 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.b.service: Consumed 32.184s CPU time. 2024-09-19T05:47:21.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:21.594 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T05:47:21.594 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T05:47:21.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.c 2024-09-19T05:47:22.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:21 smithi082 systemd[1]: Stopping Ceph mon.c for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:22.327 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c[35191]: 2024-09-19T05:47:22.070+0000 7f2438f12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:22.327 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c[35191]: 2024-09-19T05:47:22.070+0000 7f2438f12640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:47:22.640 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:22 smithi082 podman[72295]: 2024-09-19 05:47:22.326080845 +0000 UTC m=+0.372968292 container died c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T05:47:23.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:22 smithi082 podman[72295]: 2024-09-19 05:47:22.83813551 +0000 UTC m=+0.885023001 container cleanup c422e25bdeae81a634c5179b16b57d3bb05ed32d56e1e0b46542a3a6698be984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T05:47:23.008 INFO:journalctl@ceph.mon.c.smithi082.stdout:Sep 19 05:47:22 smithi082 bash[72295]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mon-c 2024-09-19T05:47:23.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T05:47:23.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:23.333 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T05:47:23.333 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T05:47:23.333 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:47:23.656 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:23 smithi001 systemd[1]: Stopping Ceph mgr.x for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:23.989 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:47:23.653+0000 7fec293d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:23.989 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x[31193]: 2024-09-19T05:47:23.653+0000 7fec293d1640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T05:47:23.989 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:23 smithi001 podman[103053]: 2024-09-19 05:47:23.685227229 +0000 UTC m=+0.149231015 container died d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T05:47:24.340 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:24 smithi001 podman[103053]: 2024-09-19 05:47:24.09611792 +0000 UTC m=+0.560121718 container cleanup d9275f4b4c116532c3a395a1e0af611b3dfc779a446aa208e3b615b4b8adc33b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:47:24.340 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 05:47:24 smithi001 bash[103053]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-x 2024-09-19T05:47:24.480 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T05:47:24.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:24.517 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T05:47:24.518 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T05:47:24.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.y 2024-09-19T05:47:24.855 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:47:24 smithi060 systemd[1]: Stopping Ceph mgr.y for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:25.250 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:47:24 smithi060 podman[71915]: 2024-09-19 05:47:24.853968793 +0000 UTC m=+0.138137560 container died a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:47:25.587 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:47:25 smithi060 podman[71915]: 2024-09-19 05:47:25.342092595 +0000 UTC m=+0.626261362 container cleanup a4fcf6ba826d26255b292e10088676c35c3030070ead79487ccda14dbbd30c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:47:25.587 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 19 05:47:25 smithi060 bash[71915]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-y 2024-09-19T05:47:25.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T05:47:25.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:25.758 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T05:47:25.758 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T05:47:25.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z 2024-09-19T05:47:26.089 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:25 smithi082 systemd[1]: Stopping Ceph mgr.z for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:26.388 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 podman[72417]: 2024-09-19 05:47:26.088029446 +0000 UTC m=+0.138359996 container died 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:47:26.755 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 podman[72417]: 2024-09-19 05:47:26.494268291 +0000 UTC m=+0.544598829 container cleanup 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T05:47:26.756 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 bash[72417]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z 2024-09-19T05:47:26.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T05:47:27.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 podman[72431]: 2024-09-19 05:47:26.754429462 +0000 UTC m=+0.658936454 container remove 0f9c3518cba5e9411eda6bbb20cc1c7a0faee09b7c9b88936c4b83866092390f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:47:27.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T05:47:27.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-19T05:47:27.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 systemd[1]: Stopped Ceph mgr.z for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:47:27.008 INFO:journalctl@ceph.mgr.z.smithi082.stdout:Sep 19 05:47:26 smithi082 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mgr.z.service: Consumed 7.087s CPU time. 2024-09-19T05:47:27.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:27.012 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T05:47:27.013 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T05:47:27.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.0 2024-09-19T05:47:27.341 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:27 smithi001 systemd[1]: Stopping Ceph osd.0 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:27.841 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:27 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:47:27.367+0000 7f387bfc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:27.842 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:27 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:47:27.367+0000 7f387bfc7640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-19T05:47:27.842 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:27 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0[45119]: 2024-09-19T05:47:27.367+0000 7f387bfc7640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:47:33.195 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:32 smithi001 podman[103176]: 2024-09-19 05:47:32.904295299 +0000 UTC m=+5.689441764 container died 90c4b81f63caafec2d00e1532a6b781203490af423f5f2c01b28098f32d1a507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T05:47:33.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:33 smithi001 podman[103176]: 2024-09-19 05:47:33.368550573 +0000 UTC m=+6.153697084 container cleanup 90c4b81f63caafec2d00e1532a6b781203490af423f5f2c01b28098f32d1a507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T05:47:33.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:33 smithi001 bash[103176]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0 2024-09-19T05:47:34.004 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:33 smithi001 podman[103190]: 2024-09-19 05:47:33.645519258 +0000 UTC m=+0.735010609 container remove 90c4b81f63caafec2d00e1532a6b781203490af423f5f2c01b28098f32d1a507 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T05:47:34.300 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:33.905463292 +0000 UTC m=+0.016626594 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:47:34.300 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:34.030869444 +0000 UTC m=+0.142032777 container create 04c8755be757e958536208e04a7f5d33e37a77e8d332ddf62fe9f596c8c33240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T05:47:34.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:34.299420513 +0000 UTC m=+0.410583809 container init 04c8755be757e958536208e04a7f5d33e37a77e8d332ddf62fe9f596c8c33240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T05:47:34.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:34.303034002 +0000 UTC m=+0.414197294 container start 04c8755be757e958536208e04a7f5d33e37a77e8d332ddf62fe9f596c8c33240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T05:47:34.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:34.391056958 +0000 UTC m=+0.502220250 container attach 04c8755be757e958536208e04a7f5d33e37a77e8d332ddf62fe9f596c8c33240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T05:47:34.592 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 05:47:34 smithi001 podman[103281]: 2024-09-19 05:47:34.503649126 +0000 UTC m=+0.614812418 container died 04c8755be757e958536208e04a7f5d33e37a77e8d332ddf62fe9f596c8c33240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T05:47:35.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T05:47:35.245 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:35.245 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T05:47:35.245 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T05:47:35.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.1 2024-09-19T05:47:35.500 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:35 smithi060 systemd[1]: Stopping Ceph osd.1 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:35.840 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:47:35.688+0000 7ff13063e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:35.840 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:47:35.688+0000 7ff13063e640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-19T05:47:35.840 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1[39510]: 2024-09-19T05:47:35.688+0000 7ff13063e640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:47:41.408 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:41 smithi060 podman[72040]: 2024-09-19 05:47:41.104216974 +0000 UTC m=+5.651059167 container died a36fc5f200fb737f47785360abd3e5027de9791ea1bfb4206458fb590883825e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:47:41.750 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:41 smithi060 podman[72040]: 2024-09-19 05:47:41.497794611 +0000 UTC m=+6.044636804 container cleanup a36fc5f200fb737f47785360abd3e5027de9791ea1bfb4206458fb590883825e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:47:41.751 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:41 smithi060 bash[72040]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1 2024-09-19T05:47:42.251 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:41 smithi060 podman[72070]: 2024-09-19 05:47:41.874687576 +0000 UTC m=+0.770135438 container remove a36fc5f200fb737f47785360abd3e5027de9791ea1bfb4206458fb590883825e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:47:42.588 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.161325778 +0000 UTC m=+0.016549774 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:47:42.588 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.300489404 +0000 UTC m=+0.155713386 container create b67e1431802e6f44d2a3abd902d384ed16f1c34d380d8ef0aa4fcb4d9beaaf96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:47:42.588 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.586512016 +0000 UTC m=+0.441736003 container init b67e1431802e6f44d2a3abd902d384ed16f1c34d380d8ef0aa4fcb4d9beaaf96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T05:47:43.001 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.590097618 +0000 UTC m=+0.445321603 container start b67e1431802e6f44d2a3abd902d384ed16f1c34d380d8ef0aa4fcb4d9beaaf96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T05:47:43.001 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.686732315 +0000 UTC m=+0.541956313 container attach b67e1431802e6f44d2a3abd902d384ed16f1c34d380d8ef0aa4fcb4d9beaaf96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:47:43.001 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 19 05:47:42 smithi060 podman[72159]: 2024-09-19 05:47:42.813958378 +0000 UTC m=+0.669182372 container died b67e1431802e6f44d2a3abd902d384ed16f1c34d380d8ef0aa4fcb4d9beaaf96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:47:43.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T05:47:43.616 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:43.616 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T05:47:43.616 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T05:47:43.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.2 2024-09-19T05:47:44.008 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:43 smithi082 systemd[1]: Stopping Ceph osd.2 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:44.508 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:47:44.005+0000 7fbbb3362640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:44.508 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:47:44.005+0000 7fbbb3362640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-19T05:47:44.508 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2[40165]: 2024-09-19T05:47:44.005+0000 7fbbb3362640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:47:49.905 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:49 smithi082 podman[72556]: 2024-09-19 05:47:49.581529628 +0000 UTC m=+5.774497483 container died 5062b9079a2f38537dbdec1dc4fae46459aa65a7d90dc22ee80189dc792ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:47:50.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72556]: 2024-09-19 05:47:50.014296736 +0000 UTC m=+6.207264585 container cleanup 5062b9079a2f38537dbdec1dc4fae46459aa65a7d90dc22ee80189dc792ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:47:50.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 bash[72556]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2 2024-09-19T05:47:50.651 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72575]: 2024-09-19 05:47:50.257526083 +0000 UTC m=+0.667527361 container remove 5062b9079a2f38537dbdec1dc4fae46459aa65a7d90dc22ee80189dc792ade2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T05:47:50.995 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72661]: 2024-09-19 05:47:50.552587447 +0000 UTC m=+0.015498631 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:47:50.996 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72661]: 2024-09-19 05:47:50.683678944 +0000 UTC m=+0.146590162 container create bd5fa26f0770e1ec5a02d90bdd8143adef7de1c0a5fb113eab6914d19ba19566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T05:47:51.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72661]: 2024-09-19 05:47:50.994871756 +0000 UTC m=+0.457782929 container init bd5fa26f0770e1ec5a02d90bdd8143adef7de1c0a5fb113eab6914d19ba19566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T05:47:51.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:50 smithi082 podman[72661]: 2024-09-19 05:47:50.998283053 +0000 UTC m=+0.461194234 container start bd5fa26f0770e1ec5a02d90bdd8143adef7de1c0a5fb113eab6914d19ba19566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:47:51.258 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:51 smithi082 podman[72661]: 2024-09-19 05:47:51.15359354 +0000 UTC m=+0.616504725 container attach bd5fa26f0770e1ec5a02d90bdd8143adef7de1c0a5fb113eab6914d19ba19566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:47:51.758 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 19 05:47:51 smithi082 podman[72684]: 2024-09-19 05:47:51.438470785 +0000 UTC m=+0.016767560 container died bd5fa26f0770e1ec5a02d90bdd8143adef7de1c0a5fb113eab6914d19ba19566 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T05:47:52.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T05:47:52.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:47:52.165 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T05:47:52.165 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T05:47:52.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.3 2024-09-19T05:47:52.502 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:52 smithi001 systemd[1]: Stopping Ceph osd.3 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:47:52.842 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:52 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:52.499+0000 7fbf8963b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:47:52.842 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:52 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:52.499+0000 7fbf8963b640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-19T05:47:52.843 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:52 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:52.499+0000 7fbf8963b640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:47:54.841 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:54 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:54.358+0000 7fbf81c49640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.682990+0000 front 2024-09-19T05:47:31.683019+0000 (oldest deadline 2024-09-19T05:47:53.983281+0000) 2024-09-19T05:47:55.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:47:55 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:47:55.085+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:47:55.841 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:55 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:55.389+0000 7fbf81c49640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.682990+0000 front 2024-09-19T05:47:31.683019+0000 (oldest deadline 2024-09-19T05:47:53.983281+0000) 2024-09-19T05:47:56.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:47:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:47:55.567+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:47:56.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:47:56 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:47:56.115+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:47:56.652 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:56 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:56.384+0000 7fbf81c49640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.682990+0000 front 2024-09-19T05:47:31.683019+0000 (oldest deadline 2024-09-19T05:47:53.983281+0000) 2024-09-19T05:47:56.911 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:47:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:47:56.603+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:47:57.258 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:47:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:47:56.910+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:47:57.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:47:57 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:47:57.160+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:47:57.591 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:57 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3[51590]: 2024-09-19T05:47:57.357+0000 7fbf81c49640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.682990+0000 front 2024-09-19T05:47:31.683019+0000 (oldest deadline 2024-09-19T05:47:53.983281+0000) 2024-09-19T05:47:57.923 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:47:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:47:57.587+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:47:58.258 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:47:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:47:57.921+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:47:58.487 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:58 smithi001 podman[103402]: 2024-09-19 05:47:58.167465656 +0000 UTC m=+5.782599496 container died 60c120c3d63527dac8e2f4de01f3d942fcb26942d6ae255b215157524fc63c22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T05:47:58.487 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:47:58 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:47:58.298+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:47:58.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:47:58 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:47:58.167+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:47:58.841 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:58 smithi001 podman[103402]: 2024-09-19 05:47:58.675956951 +0000 UTC m=+6.291090782 container cleanup 60c120c3d63527dac8e2f4de01f3d942fcb26942d6ae255b215157524fc63c22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T05:47:58.842 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:58 smithi001 bash[103402]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3 2024-09-19T05:47:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:47:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:47:58.877+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:47:59.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:47:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:47:58.629+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:47:59.326 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:58 smithi001 podman[103420]: 2024-09-19 05:47:58.928090602 +0000 UTC m=+0.757727744 container remove 60c120c3d63527dac8e2f4de01f3d942fcb26942d6ae255b215157524fc63c22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T05:47:59.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:47:59 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:47:59.134+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:47:59.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:47:59 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:47:59.324+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:47:59.592 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.260592158 +0000 UTC m=+0.016971206 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:47:59.592 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.379120505 +0000 UTC m=+0.135499543 container create 6c0cc63481f2a0d0104d0da40fd33de66a457ad7750a87ca85c83c2747a1cefa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T05:48:00.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:47:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:47:59.655+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:47:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:47:59.830+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:00.091 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.640312987 +0000 UTC m=+0.396692033 container init 6c0cc63481f2a0d0104d0da40fd33de66a457ad7750a87ca85c83c2747a1cefa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:48:00.092 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.643936078 +0000 UTC m=+0.400315119 container start 6c0cc63481f2a0d0104d0da40fd33de66a457ad7750a87ca85c83c2747a1cefa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T05:48:00.092 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.731694992 +0000 UTC m=+0.488074045 container attach 6c0cc63481f2a0d0104d0da40fd33de66a457ad7750a87ca85c83c2747a1cefa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T05:48:00.092 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 05:47:59 smithi001 podman[103506]: 2024-09-19 05:47:59.846226744 +0000 UTC m=+0.602605784 container died 6c0cc63481f2a0d0104d0da40fd33de66a457ad7750a87ca85c83c2747a1cefa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:48:00.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:00 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:00.100+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:00.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:00 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:00.284+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:00.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T05:48:00.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:00.657 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T05:48:00.658 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T05:48:00.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.4 2024-09-19T05:48:00.970 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:00 smithi060 systemd[1]: Stopping Ceph osd.4 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:01.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:00.784+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:01.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:00.684+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:01.251 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:01 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:01.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:01.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:00 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:48:00.968+0000 7f8b3d87f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:01.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:00 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:48:00.968+0000 7f8b3d87f640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-19T05:48:01.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:00 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:48:00.968+0000 7f8b3d87f640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:01.593 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:01 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:01.329+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:02.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:01.751+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:02.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:01.715+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:02.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:01.715+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:02.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:02 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:02.143+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:02.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:02 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:02.143+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:02.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:02 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:02.295+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:02.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:02 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:02.295+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:03.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:02 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:02.713+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:03.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:02 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:02.713+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:03.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:02 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:02.689+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:03.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:02 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:02.689+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:03.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:03 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:03.116+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:03.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:03 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:03.116+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:03.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:03 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:03.316+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:03.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:03 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:03.301+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:03.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:03 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:03.301+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:04.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:03 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:03.688+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:04.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:03 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:03.688+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:04.009 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:03 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:03.859+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:04.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:03 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:03.684+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:04.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:03 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:03.684+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:04.402 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:04 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:04.068+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:04.402 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:04 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:04.068+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:04.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:04.365+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:04.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:04.259+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:04.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:04 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:04.259+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:04.684 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:04 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:04.549+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:04.936 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:04 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:04.847+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:04.936 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:04 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:04.716+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:04.936 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:04 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:04.716+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:04.937 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:04 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:04.682+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:04.937 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:04 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:04.682+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:05.001 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:04 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:48:04.766+0000 7f8b35e8d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.686798+0000 front 2024-09-19T05:47:38.686829+0000 (oldest deadline 2024-09-19T05:48:03.987124+0000) 2024-09-19T05:48:05.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:05 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:05.031+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:05.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:05 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:05.031+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:05.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:05.399+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:05.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:05.245+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:05.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:05.245+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:06.001 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:05 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4[46115]: 2024-09-19T05:48:05.754+0000 7f8b35e8d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.686798+0000 front 2024-09-19T05:47:38.686829+0000 (oldest deadline 2024-09-19T05:48:03.987124+0000) 2024-09-19T05:48:06.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:05 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:05.534+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:06.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:05 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:05.828+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:06.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:05 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:05.734+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:06.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:05 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:05.734+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:06.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:05 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:05.671+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:06.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:05 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:05.671+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:06.423 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:06 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:06.000+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:06.423 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:06 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:06.000+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:06.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:06 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:06.371+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:06.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:06 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:06.217+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:06.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:06 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:06.217+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:06.750 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:06 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:06.515+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:06.751 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:06 smithi060 podman[72262]: 2024-09-19 05:48:06.422298283 +0000 UTC m=+5.571769407 container died 0e4d04694e71cbea2ae7068235858dd595d772ece8b955655b57400129005372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T05:48:07.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:06 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:06.844+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:07.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:06 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:06.754+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:07.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:06 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:06.754+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:07.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:06 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:06.682+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:07.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:06 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:06.682+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:07.164 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:07 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:07.035+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:07.165 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:07 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:07.035+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:07.165 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:06 smithi060 podman[72262]: 2024-09-19 05:48:06.928210175 +0000 UTC m=+6.077681300 container cleanup 0e4d04694e71cbea2ae7068235858dd595d772ece8b955655b57400129005372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T05:48:07.165 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:06 smithi060 bash[72262]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4 2024-09-19T05:48:07.475 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72289]: 2024-09-19 05:48:07.163038611 +0000 UTC m=+0.740518907 container remove 0e4d04694e71cbea2ae7068235858dd595d772ece8b955655b57400129005372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T05:48:07.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:07.357+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:07.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:07.174+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:07.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:07 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:07.174+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:07.750 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:07 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:07.548+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:07.751 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.377241637 +0000 UTC m=+0.016091604 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:07.751 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.480450433 +0000 UTC m=+0.119300404 container create 084a8a00f4ab0fea710b21c353fb1c65d2a4f7d402520fd1c2075c8bb94826fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:48:08.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:07.893+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:08.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:07.764+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:08.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:07.764+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:08.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:07.725+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:08.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:07 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:07.725+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:08.000+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:08.000+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.758526437 +0000 UTC m=+0.397376416 container init 084a8a00f4ab0fea710b21c353fb1c65d2a4f7d402520fd1c2075c8bb94826fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.76205192 +0000 UTC m=+0.400901893 container start 084a8a00f4ab0fea710b21c353fb1c65d2a4f7d402520fd1c2075c8bb94826fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.833215932 +0000 UTC m=+0.472065906 container attach 084a8a00f4ab0fea710b21c353fb1c65d2a4f7d402520fd1c2075c8bb94826fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T05:48:08.251 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 19 05:48:07 smithi060 podman[72377]: 2024-09-19 05:48:07.947615572 +0000 UTC m=+0.586465550 container died 084a8a00f4ab0fea710b21c353fb1c65d2a4f7d402520fd1c2075c8bb94826fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:48:08.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:08.405+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:08.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:08.184+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:08.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:08 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:08.184+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:08.713 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:08 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:08.558+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:08.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T05:48:08.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:08.785 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T05:48:08.785 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T05:48:08.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.5 2024-09-19T05:48:09.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:08.918+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:09.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:08.752+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:09.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:08.752+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:09.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:08 smithi082 systemd[1]: Stopping Ceph osd.5 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:09.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:08.702+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:09.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:08 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:08.702+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:09.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:09 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:09.026+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:09.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:09 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:09.026+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:09.508 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:09.101+0000 7f2ebb781640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:09.508 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:09.101+0000 7f2ebb781640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-19T05:48:09.508 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:09.101+0000 7f2ebb781640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:09.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:09 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:09.410+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:09.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:09 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:09.164+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:09.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:09 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:09.164+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:10.000 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:09 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:09.512+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:10.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:09.742+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:10.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:09.742+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:10.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:09.882+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:10.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:09.709+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:10.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:09 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:09.709+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:10.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:09 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:09.998+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:10.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:09 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:09.998+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:10.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:10.369+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:10.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:10.369+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:10.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:10.153+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:10.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:10.153+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:11.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:10.554+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:11.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:10 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:10.554+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:11.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:10.891+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:11.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:10.693+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:11.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:10.693+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:11.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:10.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:11.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:10.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:11.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:10 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:10.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.579745+0000 front 2024-09-19T05:47:47.579721+0000 (oldest deadline 2024-09-19T05:48:10.479849+0000) 2024-09-19T05:48:11.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:11.016+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:11.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:11.016+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:11.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:11 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:11.189+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:11.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:11 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:11.189+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:11.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:11 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:11.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:11.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:11 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:11.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:12.000 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:11.571+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:12.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:11 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:11.571+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:12.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:11.906+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:12.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:11.693+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:12.008 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:11.693+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:12.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:11.693+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.579745+0000 front 2024-09-19T05:47:47.579721+0000 (oldest deadline 2024-09-19T05:48:10.479849+0000) 2024-09-19T05:48:12.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:11.723+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:12.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:11.723+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:12.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:11 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:11.723+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:12.417 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:12.154+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:12.417 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:12.154+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:12.417 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:12.154+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:12.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:12.036+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:12.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:12.036+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:12.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:12.036+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:12.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:12.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:12.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:12 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:12.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:13.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:12.599+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:13.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:12 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:12.599+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:13.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:12.946+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:13.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:12.753+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:13.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:12.753+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:13.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:12.753+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:13.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:12.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:13.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:12.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:13.009 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:12 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:12.722+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.579745+0000 front 2024-09-19T05:47:47.579721+0000 (oldest deadline 2024-09-19T05:48:10.479849+0000) 2024-09-19T05:48:13.454 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:13 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:13.110+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:13.454 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:13 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:13.110+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:13.454 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:13 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:13.110+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:13.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:13.082+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:13.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:13.082+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:13.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:13.082+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:13.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:13 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:13.452+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:13.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:13 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:13.452+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:13.972 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:13.719+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:29.377604+0000 front 2024-09-19T05:47:29.377543+0000 (oldest deadline 2024-09-19T05:47:54.677570+0000) 2024-09-19T05:48:13.972 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:13.719+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.178660+0000 front 2024-09-19T05:47:38.178800+0000 (oldest deadline 2024-09-19T05:48:01.678638+0000) 2024-09-19T05:48:13.972 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5[47018]: 2024-09-19T05:48:13.719+0000 7f2eb3d8f640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.579745+0000 front 2024-09-19T05:47:47.579721+0000 (oldest deadline 2024-09-19T05:48:10.479849+0000) 2024-09-19T05:48:13.972 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:13.763+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:13.973 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:13.763+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:13.973 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:13.763+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:14.000 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:13.594+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:14.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:13 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:13.594+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:14.258 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:13.970+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:14.258 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:13 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:13.970+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:14.412 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:14.095+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:14.412 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:14.095+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:14.412 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:14.095+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:14.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:14.064+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:14.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:14.064+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:14.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:14.064+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:14.793 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:14 smithi082 podman[72777]: 2024-09-19 05:48:14.511178223 +0000 UTC m=+5.530329304 container died ab134441ae19b408e1c817d4c5a9905d225ac04f8375f195514eff9c2889ce15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T05:48:14.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:14.410+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:14.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:14.410+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:15.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:14.564+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:15.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:14 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:14.564+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:15.170 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:14 smithi082 podman[72777]: 2024-09-19 05:48:14.926375604 +0000 UTC m=+5.945526675 container cleanup ab134441ae19b408e1c817d4c5a9905d225ac04f8375f195514eff9c2889ce15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:14 smithi082 bash[72777]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:15 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:15.008+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:15 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:15.008+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:14 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:14.791+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:14 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:14.791+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:15.171 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:14 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:14.791+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:15.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:15 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:15.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:15.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:15 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:15.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:15.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:15 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:15.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:15.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:15.112+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:15.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:15.112+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:15.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:15.112+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:15.508 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72792]: 2024-09-19 05:48:15.169626935 +0000 UTC m=+0.656941067 container remove ab134441ae19b408e1c817d4c5a9905d225ac04f8375f195514eff9c2889ce15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:15.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:15 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:15.369+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:15.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:15 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:15.369+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:15.900 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72885]: 2024-09-19 05:48:15.491814553 +0000 UTC m=+0.015771613 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:15.900 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72885]: 2024-09-19 05:48:15.612253521 +0000 UTC m=+0.136210579 container create b224df401289985e6475f93f803617063d7fa77862d05c4a778ecdc6b8996b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:15.900 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:15 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:15.760+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:15.900 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:15 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:15.760+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:15.900 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:15 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:15.761+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:16.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:15.527+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:16.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:15 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:15.527+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:16.203 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:16 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:16.054+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:16.204 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:16 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:16.054+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:16.204 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72885]: 2024-09-19 05:48:15.898616779 +0000 UTC m=+0.422573837 container init b224df401289985e6475f93f803617063d7fa77862d05c4a778ecdc6b8996b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T05:48:16.204 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72885]: 2024-09-19 05:48:15.901973196 +0000 UTC m=+0.425930258 container start b224df401289985e6475f93f803617063d7fa77862d05c4a778ecdc6b8996b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T05:48:16.204 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:15 smithi082 podman[72885]: 2024-09-19 05:48:15.99860683 +0000 UTC m=+0.522563890 container attach b224df401289985e6475f93f803617063d7fa77862d05c4a778ecdc6b8996b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T05:48:16.204 INFO:journalctl@ceph.osd.5.smithi082.stdout:Sep 19 05:48:16 smithi082 podman[72885]: 2024-09-19 05:48:16.08920141 +0000 UTC m=+0.613158477 container died b224df401289985e6475f93f803617063d7fa77862d05c4a778ecdc6b8996b0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T05:48:16.417 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:16 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:16.121+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:16.418 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:16 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:16.121+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:16.418 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:16 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:16.121+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:16.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:16 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:16.106+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:16.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:16 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:16.106+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:16.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:16 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:16.106+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:16.701 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:16 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:16.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:16.701 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:16 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:16.415+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:16.862 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:16 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:16.724+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:16.862 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:16 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:16.724+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:16.863 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:16 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:16.724+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:16.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T05:48:16.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:16.922 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T05:48:16.922 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T05:48:16.923 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.6 2024-09-19T05:48:17.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:16 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:16.556+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:17.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:16 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:16.556+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:17.257 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:16 smithi001 systemd[1]: Stopping Ceph osd.6 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:17.257 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:17.105+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:17.257 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:17.105+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:17.258 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:17.105+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:17.258 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:17 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:17.088+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:17.258 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:17 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:17.088+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:17.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:17 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:17.084+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:17.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:17 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:17.084+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:17.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:17 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:17.084+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:17.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:17.255+0000 7fa75ac3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:17.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:17.255+0000 7fa75ac3a640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-19T05:48:17.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:17.255+0000 7fa75ac3a640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:17.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:17.386+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:17.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:17 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:17.386+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:18.000 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:17 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:17.565+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:18.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:17 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:17.565+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:18.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:17 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:17.684+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:18.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:17 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:17.684+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:18.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:17 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:17.684+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:18.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:18.060+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:18.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:18.060+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:18.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:18.060+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:18.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:18 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:18.053+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:18.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:18 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:18.053+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:18.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:18 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:18.053+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:18.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:18 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:18.069+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:18.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:18 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:18.069+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:18.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:18.348+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:18.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:18.348+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:19.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:18 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:18.593+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:19.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:18 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:18.593+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:19.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:18 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:18.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:19.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:18 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:18.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:19.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:18 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:18.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:19.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:19.050+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:19.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:19.050+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:19.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:19.050+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:19.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:19 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:19.096+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:19.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:19 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:19.096+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:19.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:19 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:19.096+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:19.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:19.073+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:19.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:19.073+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:19.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:19.073+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:19.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:19.391+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:19.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:19.391+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:19.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:19 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:19.391+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:52.901556+0000 front 2024-09-19T05:47:52.901579+0000 (oldest deadline 2024-09-19T05:48:18.801783+0000) 2024-09-19T05:48:20.000 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:19 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:19.640+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:20.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:19 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:19.640+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:20.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:19.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:20.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:19.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:20.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:19 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:19.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:20.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:20.030+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:20.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:20.030+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:20.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:20.030+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:20.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:20.119+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:20.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:20.119+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:20.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:20.119+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:20.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:20.115+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:20.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:20.115+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:20.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:20.115+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:20.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:20.390+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:20.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:20.390+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:20.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:20 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:20.390+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:52.901556+0000 front 2024-09-19T05:47:52.901579+0000 (oldest deadline 2024-09-19T05:48:18.801783+0000) 2024-09-19T05:48:21.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:20.657+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:21.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:20 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:20.658+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:21.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:20.664+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:21.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:20.664+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:21.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:20 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:20.664+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:21.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:21.056+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:21.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:21.056+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:21.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:21.056+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:21.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:21.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:21.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:21.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:21.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:21.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:21.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:21.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:21.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:21.081+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:21.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:21.081+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:21.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:21.081+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:21.841 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:21.408+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.397208+0000 front 2024-09-19T05:47:40.397237+0000 (oldest deadline 2024-09-19T05:48:02.697112+0000) 2024-09-19T05:48:21.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:21.408+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:48.999981+0000 front 2024-09-19T05:47:49.000002+0000 (oldest deadline 2024-09-19T05:48:10.000503+0000) 2024-09-19T05:48:21.842 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:21 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6[58366]: 2024-09-19T05:48:21.408+0000 7fa753248640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:52.901556+0000 front 2024-09-19T05:47:52.901579+0000 (oldest deadline 2024-09-19T05:48:18.801783+0000) 2024-09-19T05:48:22.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:21.683+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:22.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:21 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:21.683+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:22.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:21.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:22.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:21.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:22.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:21 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:21.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:22.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:22 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:22.037+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:22.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:22 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:22.037+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:22.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:22 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:22.037+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:22.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:22 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:22.037+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:22.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:22.083+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:22.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:22.083+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:22.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:22.083+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:22.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:22.083+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:22.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:22.093+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:22.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:22.093+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:22.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:22.093+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:23.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:22.719+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:23.082 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:22 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:22.719+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:23.083 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:22.577+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:23.083 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:22.577+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:23.083 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:22 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:22.577+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:23.092 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:22 smithi001 podman[103619]: 2024-09-19 05:48:22.834441323 +0000 UTC m=+5.693624529 container died d959a6592d1f9401734f54cfce336277e6a7dab8fe0b24a96bcab7a3b3a35331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T05:48:23.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.001+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:23.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.001+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:23.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.001+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:23.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.001+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:23.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:23.132+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:23.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:23.132+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:23.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:23.132+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:23.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:23.132+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:23.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:23.120+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:23.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:23.120+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:23.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:23.120+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:23.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:23 smithi001 podman[103619]: 2024-09-19 05:48:23.213759553 +0000 UTC m=+6.072942817 container cleanup d959a6592d1f9401734f54cfce336277e6a7dab8fe0b24a96bcab7a3b3a35331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:48:23.591 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:23 smithi001 bash[103619]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6 2024-09-19T05:48:23.592 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:23 smithi001 podman[103637]: 2024-09-19 05:48:23.381637781 +0000 UTC m=+0.542500786 container remove d959a6592d1f9401734f54cfce336277e6a7dab8fe0b24a96bcab7a3b3a35331 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T05:48:24.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:23.748+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:24.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:23.748+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:24.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:23.748+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:24.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:23.555+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:24.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:23.555+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:24.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:23 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:23.555+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:24.091 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:23 smithi001 podman[103728]: 2024-09-19 05:48:23.735335011 +0000 UTC m=+0.016318558 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:24.092 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:23 smithi001 podman[103728]: 2024-09-19 05:48:23.857577687 +0000 UTC m=+0.138561260 container create 7a89ea9a2fcbb8c7eae777e380810e0dbc0e6f29a466b5664fcd5c60fcf3559d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:48:24.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.967+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:24.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.967+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:24.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.967+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:24.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:23 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:23.967+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:24.353 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:24 smithi001 podman[103728]: 2024-09-19 05:48:24.127673677 +0000 UTC m=+0.408657216 container init 7a89ea9a2fcbb8c7eae777e380810e0dbc0e6f29a466b5664fcd5c60fcf3559d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:24.354 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:24 smithi001 podman[103728]: 2024-09-19 05:48:24.131170121 +0000 UTC m=+0.412153659 container start 7a89ea9a2fcbb8c7eae777e380810e0dbc0e6f29a466b5664fcd5c60fcf3559d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:48:24.354 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:24 smithi001 podman[103728]: 2024-09-19 05:48:24.352114591 +0000 UTC m=+0.633098136 container attach 7a89ea9a2fcbb8c7eae777e380810e0dbc0e6f29a466b5664fcd5c60fcf3559d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T05:48:24.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:24.086+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:24.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:24.086+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:24.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:24.086+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:24.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:24.086+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:24.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:24.159+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:24.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:24.159+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:24.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:24.159+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:24.682 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 05:48:24 smithi001 podman[103728]: 2024-09-19 05:48:24.352373388 +0000 UTC m=+0.633356936 container died 7a89ea9a2fcbb8c7eae777e380810e0dbc0e6f29a466b5664fcd5c60fcf3559d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:48:25.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T05:48:25.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:24.525+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:25.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:24.525+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:25.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:24 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:24.525+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:25.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:25.049 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T05:48:25.049 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T05:48:25.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.7 2024-09-19T05:48:25.076 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:24.753+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:25.076 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:24.753+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:25.076 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:24 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:24.753+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:25.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:24 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:24.932+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:25.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:24 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:24.932+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:25.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:24 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:24.932+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:25.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:24 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:24.932+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 systemd[1]: Stopping Ceph osd.7 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.481+0000 7f8b999b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:25.085+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:25.085+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:25.085+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:25.485 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:25.085+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:25.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:25.199+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:25.509 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:25.199+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:25.509 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:25.199+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:25.739 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.481+0000 7f8b999b6640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-19T05:48:25.739 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.481+0000 7f8b999b6640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:25.739 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.737+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:25.739 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.737+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:25.739 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:25 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:25.737+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:26.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:25.563+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:26.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:25.563+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:26.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:25 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:25.563+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:26.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:25.962+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:26.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:25.962+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:26.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:25.962+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:26.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:25 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:25.962+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:26.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:26.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:26.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:26.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:26.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:26.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:26.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:26.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:26.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:26.152+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:26.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:26.152+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:26.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:26.152+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:27.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:26.713+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:27.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:26.713+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:27.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:26.713+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:27.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:26.534+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:27.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:26.534+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:27.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:26 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:26.534+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:27.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:26 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:26.988+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:27.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:26 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:26.988+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:27.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:26 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:26.988+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:27.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:26 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:26.988+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:27.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:27.097+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:27.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:27.097+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:27.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:27.097+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:27.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:27.097+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:27.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:27.143+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:27.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:27.143+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:27.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:27.143+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:27.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:27.143+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:28.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:27.690+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:28.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:27.690+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:28.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:27.690+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:28.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:27 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:27.690+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:05.054213+0000 front 2024-09-19T05:48:05.054290+0000 (oldest deadline 2024-09-19T05:48:27.354293+0000) 2024-09-19T05:48:28.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:27.580+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:28.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:27.580+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:28.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:27 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:27.580+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:28.091 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:28 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:28.024+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:28.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:28 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:28.024+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:28.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:28 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:28.024+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:28.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:28 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:28.024+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:28.092 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:28 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:28.024+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:28.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:28.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:28.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:28.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:28.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:28.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:28.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:28.098+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:28.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:28.164+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:28.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:28.164+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:28.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:28.164+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:28.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:28.164+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:28.734+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:28.734+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:28.734+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:29.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:28 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:28.734+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:05.054213+0000 front 2024-09-19T05:48:05.054290+0000 (oldest deadline 2024-09-19T05:48:27.354293+0000) 2024-09-19T05:48:29.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:28.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:29.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:28.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:29.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:28.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:29.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:28 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:28.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:29.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:29.005+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:29.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:29.005+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:29.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:29.005+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:29.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:29.005+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:29.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:29 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:29.005+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:29.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:29.057+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:29.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:29.057+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:29.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:29.057+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:29.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:29.057+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:29.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:29.121+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:29.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:29.121+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:29.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:29.121+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:29.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:29.121+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:30.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:29.714+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:38.150868+0000 front 2024-09-19T05:47:38.151096+0000 (oldest deadline 2024-09-19T05:48:04.051010+0000) 2024-09-19T05:48:30.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:29.714+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:44.051350+0000 front 2024-09-19T05:47:44.051375+0000 (oldest deadline 2024-09-19T05:48:09.951568+0000) 2024-09-19T05:48:30.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:29.714+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.853765+0000 front 2024-09-19T05:47:56.853682+0000 (oldest deadline 2024-09-19T05:48:22.753611+0000) 2024-09-19T05:48:30.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7[52614]: 2024-09-19T05:48:29.714+0000 7f8b95fcc640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:05.054213+0000 front 2024-09-19T05:48:05.054290+0000 (oldest deadline 2024-09-19T05:48:27.354293+0000) 2024-09-19T05:48:30.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:29.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:30.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:29.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:30.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:29.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:30.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:29 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:29.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:30.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:30.054+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:30.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:30.054+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:30.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:30.054+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:30.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:30.054+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:30.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:30 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:30.054+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:30.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:30 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:30.008+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:30.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:30 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:30.008+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:30.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:30 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:30.008+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:30.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:30 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:30.008+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:30.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:30 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:30.008+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:30.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:30.091+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:30.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:30.091+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:30.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:30.091+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:30.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:30.091+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:31.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:30.610+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:31.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:30.610+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:31.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:30.610+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:31.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:30 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:30.610+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:31.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:31.042+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:31.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:31.042+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:31.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:31.042+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:31.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:31.042+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:31.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:31 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:31.042+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:31.417 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:31 smithi060 podman[72482]: 2024-09-19 05:48:31.017706597 +0000 UTC m=+5.775052082 container died 3046aa3299032ae8219bf75b8a3bb4a5d6550c7e906354a2321f88078d02ba9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T05:48:31.417 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:31 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:31.056+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:31.417 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:31 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:31.056+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:31.417 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:31 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:31.056+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:31.417 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:31 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:31.056+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:31.418 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:31 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:31.056+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:31.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:31.078+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:31.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:31.078+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:31.509 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:31.078+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:31.509 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:31.078+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:31.751 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:31 smithi060 podman[72482]: 2024-09-19 05:48:31.498279214 +0000 UTC m=+6.255624686 container cleanup 3046aa3299032ae8219bf75b8a3bb4a5d6550c7e906354a2321f88078d02ba9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T05:48:31.751 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:31 smithi060 bash[72482]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7 2024-09-19T05:48:32.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:31.640+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:32.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:31.640+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:32.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:31.640+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:32.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:31 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:31.640+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:32.105 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:31 smithi060 podman[72499]: 2024-09-19 05:48:31.782950057 +0000 UTC m=+0.760027156 container remove 3046aa3299032ae8219bf75b8a3bb4a5d6550c7e906354a2321f88078d02ba9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:48:32.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:32.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:32.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:32.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:32.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:32.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:32.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:32.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:32.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:32 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:32.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.026780994 +0000 UTC m=+0.015576511 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.233806404 +0000 UTC m=+0.222601952 container create 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:32.104+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:32.104+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:32.104+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:32.359 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:32.104+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:32.360 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:32 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:32.104+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:32.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:32.105+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:32.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:32.105+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:32.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:32.105+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:32.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:32.105+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:32.711 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.520007924 +0000 UTC m=+0.508803429 container init 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T05:48:32.711 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.523388741 +0000 UTC m=+0.512184253 container start 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T05:48:32.711 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.586491898 +0000 UTC m=+0.575287409 container attach 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T05:48:33.001 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:32 smithi060 podman[72585]: 2024-09-19 05:48:32.710140843 +0000 UTC m=+0.698936348 container died 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:33.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:32.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:33.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:32.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:33.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:32.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:33.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:32 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:32.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:33.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:33 smithi060 podman[72609]: 2024-09-19 05:48:33.248306757 +0000 UTC m=+0.531113810 container remove 8accc0a00797a41cb01794277f752159f83c2463c4c9fd2e111e419a30cdbc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:33 smithi060 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:33 smithi060 systemd[1]: Stopped Ceph osd.7 for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 19 05:48:33 smithi060 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.7.service: Consumed 7min 13.363s CPU time. 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:33.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:33.332 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:33.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:33.333 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:33.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:33.333 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:33.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:33.333 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:33.080+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:33.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:33.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:33.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:33.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:33.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:33.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:33.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:33.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:33.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:33 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:33.044+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:33.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:33.345 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T05:48:33.346 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T05:48:33.346 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.8 2024-09-19T05:48:33.358 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.126+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:33.358 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.126+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:33.358 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.126+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:33.358 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.126+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:33.630 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 systemd[1]: Stopping Ceph osd.8 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:34.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.662+0000 7ff1ececd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:34.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.662+0000 7ff1ececd640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-19T05:48:34.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:33.662+0000 7ff1ececd640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:34.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:33.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:34.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:33.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:34.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:33.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:34.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:33 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:33.628+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:34.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:34.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:34.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:34.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:34.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:34.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:34.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:34.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:34.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:34 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:34.079+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:34.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:34 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:34.124+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:34.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:34 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:34.124+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:34.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:34 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:34.124+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:34.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:34 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:34.124+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:34.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:34 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:34.124+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:34.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:34.124+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:34.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:34.124+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:34.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:34.124+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:34.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:34.124+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:35.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:34.599+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:35.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:34.599+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:35.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:34.599+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:35.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:34 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:34.599+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:35.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:35.153+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:35.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:35.153+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:35.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:35.153+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:35.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:35.153+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:35.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:35 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:35.153+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:35.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:35.147+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:35.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:35.147+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:35.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:35.147+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:35.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:35.147+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:35.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:35.147+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.993831+0000 front 2024-09-19T05:48:13.993763+0000 (oldest deadline 2024-09-19T05:48:35.093937+0000) 2024-09-19T05:48:35.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:35 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:35.093+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:35.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:35 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:35.093+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:35.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:35 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:35.093+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:35.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:35 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:35.093+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:35.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:35 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:35.093+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:36.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:35.564+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:36.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:35.564+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:36.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:35.564+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:36.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:35.564+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:36.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:36 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:36.057+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:36.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:36 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:36.057+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:36.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:36 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:36.057+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:36.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:36 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:36.057+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:36.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:36 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:36.057+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:36.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:36 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:36.173+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:36.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:36.130+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:36.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:36.130+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:36.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:36.130+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:36.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:36.130+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:36.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:36.130+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.993831+0000 front 2024-09-19T05:48:13.993763+0000 (oldest deadline 2024-09-19T05:48:35.093937+0000) 2024-09-19T05:48:37.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:36.605+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:37.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:36.605+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:37.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:36.605+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:37.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:36 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:36.605+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:37.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:37.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:37.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:37.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:37.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:37.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:37 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:37.145+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:37.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:37.145+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:37.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:37.145+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:37.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:37.145+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:37.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:37.145+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:37.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:37.145+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.993831+0000 front 2024-09-19T05:48:13.993763+0000 (oldest deadline 2024-09-19T05:48:35.093937+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:37.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:37 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:37.101+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:38.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:37.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:38.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:37.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:38.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:37.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:38.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:37 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:37.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:38.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:38.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:38.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:38.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:38.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:38.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:38 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:38.053+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:38.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:38 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:38.157+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:38.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:38.174+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.088945+0000 front 2024-09-19T05:47:40.088876+0000 (oldest deadline 2024-09-19T05:48:03.589008+0000) 2024-09-19T05:48:38.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:38.174+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.090007+0000 front 2024-09-19T05:47:47.090113+0000 (oldest deadline 2024-09-19T05:48:12.990106+0000) 2024-09-19T05:48:38.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:38.174+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.691167+0000 front 2024-09-19T05:47:54.691106+0000 (oldest deadline 2024-09-19T05:48:18.791289+0000) 2024-09-19T05:48:38.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:38.174+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.492457+0000 front 2024-09-19T05:48:03.492525+0000 (oldest deadline 2024-09-19T05:48:26.992461+0000) 2024-09-19T05:48:38.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8[53685]: 2024-09-19T05:48:38.174+0000 7ff1e94e3640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.993831+0000 front 2024-09-19T05:48:13.993763+0000 (oldest deadline 2024-09-19T05:48:35.093937+0000) 2024-09-19T05:48:39.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:38.642+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:39.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:38.642+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:39.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:38.642+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:39.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:38.642+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:39.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:39.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:39.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:39.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:39.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:39.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:39 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:39.059+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:39.490 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:39 smithi082 podman[72989]: 2024-09-19 05:48:39.196565389 +0000 UTC m=+5.660083167 container died c3b50d567a086c8f6843e4dd6ab33cfa8ab053de02bf3f620215b0e047bc6e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T05:48:39.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:39.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:39.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:39.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:39.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:39.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:39 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:39.192+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:39.758 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:39 smithi082 podman[72989]: 2024-09-19 05:48:39.587479404 +0000 UTC m=+6.050997182 container cleanup c3b50d567a086c8f6843e4dd6ab33cfa8ab053de02bf3f620215b0e047bc6e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T05:48:39.758 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:39 smithi082 bash[72989]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8 2024-09-19T05:48:39.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:39.597+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:39.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:39.597+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:39.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:39.597+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:39.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:39.597+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:39.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:39 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:39.597+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:40.242 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:39 smithi082 podman[73015]: 2024-09-19 05:48:39.825968502 +0000 UTC m=+0.631754327 container remove c3b50d567a086c8f6843e4dd6ab33cfa8ab053de02bf3f620215b0e047bc6e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T05:48:40.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:40.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:40.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:40.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:40.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:40.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:40 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:40.041+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:40.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:40 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:40.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:40.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.144016857 +0000 UTC m=+0.015868561 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:40.508 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.248090018 +0000 UTC m=+0.119941713 container create a73f4c1e066127532371a30aee711d33b65c523ce5eb5de97fef40c856eb55ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:48:41.008 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.554684104 +0000 UTC m=+0.426535803 container init a73f4c1e066127532371a30aee711d33b65c523ce5eb5de97fef40c856eb55ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.557913387 +0000 UTC m=+0.429765085 container start a73f4c1e066127532371a30aee711d33b65c523ce5eb5de97fef40c856eb55ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.642751664 +0000 UTC m=+0.514603362 container attach a73f4c1e066127532371a30aee711d33b65c523ce5eb5de97fef40c856eb55ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.8.smithi082.stdout:Sep 19 05:48:40 smithi082 podman[73102]: 2024-09-19 05:48:40.749730863 +0000 UTC m=+0.621582556 container died a73f4c1e066127532371a30aee711d33b65c523ce5eb5de97fef40c856eb55ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:40 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:40.631+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:40 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:40.631+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:40 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:40.631+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:40 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:40.631+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:41.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:40 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:40.631+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:41.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.022+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:41.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T05:48:41.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:41.470 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T05:48:41.470 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T05:48:41.471 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.9 2024-09-19T05:48:41.500 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:41.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:41.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:41.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:41.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:41.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:41 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:41.189+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:41.768 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 systemd[1]: Stopping Ceph osd.9 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:42.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:41 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:41.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:42.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:41 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:41.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:42.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:41 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:41.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:42.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:41 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:41.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:42.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:41 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:41.625+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:42.051 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.766+0000 7f355e212640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:42.051 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.766+0000 7f355e212640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-19T05:48:42.051 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:41 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:41.766+0000 7f355e212640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:42.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:42.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:42.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:42.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:42.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:42.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:42 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:42.049+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:42.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:42 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:42.230+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:43.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:42.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:43.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:42.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:43.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:42.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:43.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:42.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:43.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:42 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:42.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:43.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:43.591 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:43.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:43.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:43.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:43.592 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:43 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:43.097+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:43.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:43 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:43.258+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:44.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:43 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:43.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:44.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:43 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:43.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:44.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:43 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:43.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:44.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:43 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:43.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:44.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:43 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:43.607+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:44.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:44.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:44.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:44.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:44.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:44.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:44 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:44.084+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:44.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:44.502 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:44 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:44.222+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:45.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:45.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:45.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:45.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:45.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:45.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:44.589+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:45.341 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:45.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:45.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:45.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:45.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:45.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:45 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:45.045+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:45.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:45 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:45.227+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:46.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:45 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:45.627+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.078624+0000 front 2024-09-19T05:47:32.078655+0000 (oldest deadline 2024-09-19T05:47:57.978803+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:40.280364+0000 front 2024-09-19T05:47:40.280346+0000 (oldest deadline 2024-09-19T05:48:01.980164+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.681267+0000 front 2024-09-19T05:47:46.681242+0000 (oldest deadline 2024-09-19T05:48:11.981338+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:56.483297+0000 front 2024-09-19T05:47:56.483322+0000 (oldest deadline 2024-09-19T05:48:21.783551+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:03.385414+0000 front 2024-09-19T05:48:03.385302+0000 (oldest deadline 2024-09-19T05:48:27.485350+0000) 2024-09-19T05:48:46.342 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:46 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9[64902]: 2024-09-19T05:48:46.017+0000 7f3556820640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.386623+0000 front 2024-09-19T05:48:13.386443+0000 (oldest deadline 2024-09-19T05:48:36.286297+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:46.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:46 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:46.232+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:47.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:47.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:47.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:47.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:47.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:47.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:46 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:46.670+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:47.502 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:47 smithi001 podman[103832]: 2024-09-19 05:48:47.231883234 +0000 UTC m=+5.560391533 container died 0a0e8fc1b20a269c7e0c669b8aa55e5b5222ea8b2d8449474bb370bd73e97d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:47.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:47 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:47.254+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:47.760 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:47 smithi001 podman[103832]: 2024-09-19 05:48:47.59119031 +0000 UTC m=+5.919698608 container cleanup 0a0e8fc1b20a269c7e0c669b8aa55e5b5222ea8b2d8449474bb370bd73e97d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T05:48:47.760 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:47 smithi001 bash[103832]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9 2024-09-19T05:48:48.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:48.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:48.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:48.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:48.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:48.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:47 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:47.688+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:48.091 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:47 smithi001 podman[103846]: 2024-09-19 05:48:47.900941477 +0000 UTC m=+0.660385881 container remove 0a0e8fc1b20a269c7e0c669b8aa55e5b5222ea8b2d8449474bb370bd73e97d64 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T05:48:48.492 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.142595514 +0000 UTC m=+0.016544976 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:48.492 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.243532093 +0000 UTC m=+0.117481556 container create d325b33acfc63ba5d308d80730b3198980c663b0333e125b6094426ab0b79969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T05:48:48.493 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.487571095 +0000 UTC m=+0.361520564 container init d325b33acfc63ba5d308d80730b3198980c663b0333e125b6094426ab0b79969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T05:48:48.493 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.491381816 +0000 UTC m=+0.365331277 container start d325b33acfc63ba5d308d80730b3198980c663b0333e125b6094426ab0b79969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:48.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:48 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:48.287+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:48.842 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.612754398 +0000 UTC m=+0.486703870 container attach d325b33acfc63ba5d308d80730b3198980c663b0333e125b6094426ab0b79969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T05:48:48.842 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 05:48:48 smithi001 podman[103946]: 2024-09-19 05:48:48.702275845 +0000 UTC m=+0.576225306 container died d325b33acfc63ba5d308d80730b3198980c663b0333e125b6094426ab0b79969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:49.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:48 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:48.728+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:49.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T05:48:49.389 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:49.390 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T05:48:49.390 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T05:48:49.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.10 2024-09-19T05:48:49.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.293+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 systemd[1]: Stopping Ceph osd.10 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.700+0000 7f0188d4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.700+0000 7f0188d4b640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-19T05:48:49.704 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:49 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:49.700+0000 7f0188d4b640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:50.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:50.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:50.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:50.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:50.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:50.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:49.687+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:50.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:50 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:50.247+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:51.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:50 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:50.665+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:51.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:51 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:51.241+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:51.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:51.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:51.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:51.758 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:51.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:51.759 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:51 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:51.661+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:52.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:52 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:52.224+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:53.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:53.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:53.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:53.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:53.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:53.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:53.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:52 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:52.653+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:53.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:53 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:53.238+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:54.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:54.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:54.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:54.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:54.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:54.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:54.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:53 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:53.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:31.520535+0000 front 2024-09-19T05:47:31.520506+0000 (oldest deadline 2024-09-19T05:47:55.020690+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:39.721940+0000 front 2024-09-19T05:47:39.721971+0000 (oldest deadline 2024-09-19T05:48:02.022175+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:46.723240+0000 front 2024-09-19T05:47:46.723146+0000 (oldest deadline 2024-09-19T05:48:12.023214+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T05:47:54.324262+0000 front 2024-09-19T05:47:54.324291+0000 (oldest deadline 2024-09-19T05:48:20.224348+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:04.925184+0000 front 2024-09-19T05:48:04.925223+0000 (oldest deadline 2024-09-19T05:48:29.625426+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:09.626028+0000 front 2024-09-19T05:48:09.625922+0000 (oldest deadline 2024-09-19T05:48:35.526036+0000) 2024-09-19T05:48:54.751 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:54 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10[59189]: 2024-09-19T05:48:54.257+0000 7f0181359640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:21.927710+0000 front 2024-09-19T05:48:21.927664+0000 (oldest deadline 2024-09-19T05:48:44.227467+0000) 2024-09-19T05:48:55.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:55.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:55.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:55.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:55.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:55.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:55.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:54 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:54.626+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:55.644 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:55 smithi060 podman[72703]: 2024-09-19 05:48:55.334906019 +0000 UTC m=+5.736486794 container died 412c49b66ed059b71143d06237fced8b83a7231cc0ee15f050f2c0f150239f9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:48:55.644 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:55 smithi060 podman[72703]: 2024-09-19 05:48:55.642915827 +0000 UTC m=+6.044496602 container cleanup 412c49b66ed059b71143d06237fced8b83a7231cc0ee15f050f2c0f150239f9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:48:56.000 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:55 smithi060 bash[72703]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10 2024-09-19T05:48:56.001 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:55 smithi060 podman[72719]: 2024-09-19 05:48:55.88581994 +0000 UTC m=+0.548563177 container remove 412c49b66ed059b71143d06237fced8b83a7231cc0ee15f050f2c0f150239f9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:56.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:56.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:55 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:55.601+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:56.498 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.097706039 +0000 UTC m=+0.015962556 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:48:56.498 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.203144157 +0000 UTC m=+0.121400674 container create 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:48:56.498 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.422315404 +0000 UTC m=+0.340571923 container init 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:48:56.498 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.425463784 +0000 UTC m=+0.343720301 container start 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:48:56.498 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.497048553 +0000 UTC m=+0.415305070 container attach 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:48:56.750 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:56 smithi060 podman[72805]: 2024-09-19 05:48:56.6204505 +0000 UTC m=+0.538707027 container died 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T05:48:57.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:57.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:57.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:57.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:57.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:57.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:57.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:56 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:56.647+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:57.188 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 19 05:48:57 smithi060 podman[72828]: 2024-09-19 05:48:57.160789491 +0000 UTC m=+0.531175586 container remove 643037c231c9a538af7ea21a23ecac060175019cf6e8e2e03ccdc8df87490eb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:48:57.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T05:48:57.232 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:48:57.232 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T05:48:57.233 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T05:48:57.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.11 2024-09-19T05:48:57.532 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 systemd[1]: Stopping Ceph osd.11 for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:48:57.533 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.530+0000 7fae9fe6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:48:57.533 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.530+0000 7fae9fe6c640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-19T05:48:57.533 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.530+0000 7fae9fe6c640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:48:58.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:58.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:58.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:58.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:58.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:58.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:58.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:57 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:57.620+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:48:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:48:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:48:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:48:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:48:59.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:48:59.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:48:59.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:58 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:58.657+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:49:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:49:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:49:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:49:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:49:00.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:49:00.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:49:00.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:48:59 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:48:59.617+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:49:01.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:49:01.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:49:01.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:49:01.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:49:01.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:49:01.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:49:01.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:00 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:00.604+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:49:02.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T05:47:32.059148+0000 front 2024-09-19T05:47:32.059162+0000 (oldest deadline 2024-09-19T05:47:56.759031+0000) 2024-09-19T05:49:02.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-19T05:47:36.759851+0000 front 2024-09-19T05:47:36.759656+0000 (oldest deadline 2024-09-19T05:48:02.059780+0000) 2024-09-19T05:49:02.008 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6804 osd.2 since back 2024-09-19T05:47:47.261501+0000 front 2024-09-19T05:47:47.261547+0000 (oldest deadline 2024-09-19T05:48:11.361663+0000) 2024-09-19T05:49:02.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-19T05:48:01.863887+0000 front 2024-09-19T05:48:01.863998+0000 (oldest deadline 2024-09-19T05:48:27.764004+0000) 2024-09-19T05:49:02.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6812 osd.5 since back 2024-09-19T05:48:13.065016+0000 front 2024-09-19T05:48:13.065035+0000 (oldest deadline 2024-09-19T05:48:38.965228+0000) 2024-09-19T05:49:02.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.1:6822 osd.6 since back 2024-09-19T05:48:18.965924+0000 front 2024-09-19T05:48:18.965759+0000 (oldest deadline 2024-09-19T05:48:43.665646+0000) 2024-09-19T05:49:02.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-19T05:48:27.766594+0000 front 2024-09-19T05:48:27.766559+0000 (oldest deadline 2024-09-19T05:48:52.466480+0000) 2024-09-19T05:49:02.009 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:01 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11[60679]: 2024-09-19T05:49:01.650+0000 7fae9c482640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.82:6820 osd.8 since back 2024-09-19T05:48:37.167192+0000 front 2024-09-19T05:48:37.167236+0000 (oldest deadline 2024-09-19T05:49:01.267176+0000) 2024-09-19T05:49:03.200 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:02 smithi082 podman[73205]: 2024-09-19 05:49:02.915392721 +0000 UTC m=+5.486464728 container died 452ebe63f75ca548d7944f73b6c5a0be74b882679e86a7ebaf48aa6d0379657b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:49:03.508 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:03 smithi082 podman[73205]: 2024-09-19 05:49:03.305647121 +0000 UTC m=+5.876719128 container cleanup 452ebe63f75ca548d7944f73b6c5a0be74b882679e86a7ebaf48aa6d0379657b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:49:03.508 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:03 smithi082 bash[73205]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11 2024-09-19T05:49:03.867 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:03 smithi082 podman[73225]: 2024-09-19 05:49:03.548640418 +0000 UTC m=+0.629674361 container remove 452ebe63f75ca548d7944f73b6c5a0be74b882679e86a7ebaf48aa6d0379657b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:49:04.144 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:03 smithi082 podman[73310]: 2024-09-19 05:49:03.768724107 +0000 UTC m=+0.015583482 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:49:04.144 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:03 smithi082 podman[73310]: 2024-09-19 05:49:03.914633601 +0000 UTC m=+0.161492969 container create a22fe7956972b5068a0047970a31b8145e4b939452507709b00b5d5a35035154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T05:49:04.144 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:04 smithi082 podman[73310]: 2024-09-19 05:49:04.143260153 +0000 UTC m=+0.390119521 container init a22fe7956972b5068a0047970a31b8145e4b939452507709b00b5d5a35035154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T05:49:04.508 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:04 smithi082 podman[73310]: 2024-09-19 05:49:04.146527301 +0000 UTC m=+0.393386677 container start a22fe7956972b5068a0047970a31b8145e4b939452507709b00b5d5a35035154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T05:49:04.508 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:04 smithi082 podman[73310]: 2024-09-19 05:49:04.218404304 +0000 UTC m=+0.465263674 container attach a22fe7956972b5068a0047970a31b8145e4b939452507709b00b5d5a35035154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:49:04.508 INFO:journalctl@ceph.osd.11.smithi082.stdout:Sep 19 05:49:04 smithi082 podman[73310]: 2024-09-19 05:49:04.334789914 +0000 UTC m=+0.581649292 container died a22fe7956972b5068a0047970a31b8145e4b939452507709b00b5d5a35035154 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T05:49:04.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T05:49:04.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:04.930 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T05:49:04.930 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T05:49:04.931 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.a 2024-09-19T05:49:05.237 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:04 smithi001 systemd[1]: Stopping Ceph mds.a for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:05.591 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a[71967]: 2024-09-19T05:49:05.234+0000 7f0c719b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:05.592 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:05 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a[71967]: 2024-09-19T05:49:05.234+0000 7f0c719b1640 -1 mds.a *** got signal Terminated *** 2024-09-19T05:49:09.342 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 podman[104052]: 2024-09-19 05:49:09.084775296 +0000 UTC m=+3.953423165 container died 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T05:49:09.629 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 podman[104052]: 2024-09-19 05:49:09.41784864 +0000 UTC m=+4.286496498 container cleanup 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:49:09.629 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 bash[104052]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a 2024-09-19T05:49:09.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T05:49:09.881 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 podman[104065]: 2024-09-19 05:49:09.627406274 +0000 UTC m=+0.535992904 container remove 6aa7dd50c5c7140c207836ab58a1762efa5538f76c69ad58aee6c02c97e24625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:49:09.882 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-19T05:49:09.882 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 systemd[1]: Stopped Ceph mds.a for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:49:09.882 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 05:49:09 smithi001 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.a.service: Consumed 1.270s CPU time. 2024-09-19T05:49:09.894 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:09.894 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T05:49:09.894 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T05:49:09.894 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.d 2024-09-19T05:49:10.223 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:09 smithi001 systemd[1]: Stopping Ceph mds.d for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:10.591 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d[70776]: 2024-09-19T05:49:10.220+0000 7fab6c5cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:10.592 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:10 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d[70776]: 2024-09-19T05:49:10.220+0000 7fab6c5cd640 -1 mds.d *** got signal Terminated *** 2024-09-19T05:49:14.091 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:13 smithi001 podman[104175]: 2024-09-19 05:49:13.837578068 +0000 UTC m=+3.709182613 container died 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:49:14.474 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:14 smithi001 podman[104175]: 2024-09-19 05:49:14.188464343 +0000 UTC m=+4.060068894 container cleanup 00f2f7a7c7fcea0eab4fadb6063344026da2187a2b042688fe2ecca529a4ea4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T05:49:14.474 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 05:49:14 smithi001 bash[104175]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-d 2024-09-19T05:49:14.634 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T05:49:14.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:14.669 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T05:49:14.670 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T05:49:14.670 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.g 2024-09-19T05:49:14.993 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:14 smithi001 systemd[1]: Stopping Ceph mds.g for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:15.341 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g[71585]: 2024-09-19T05:49:14.991+0000 7fc2cbb06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:15.342 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:14 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g[71585]: 2024-09-19T05:49:14.991+0000 7fc2cbb06640 -1 mds.g *** got signal Terminated *** 2024-09-19T05:49:17.810 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:17 smithi001 podman[104297]: 2024-09-19 05:49:17.548652753 +0000 UTC m=+2.660036241 container died 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T05:49:18.091 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:17 smithi001 podman[104297]: 2024-09-19 05:49:17.912859132 +0000 UTC m=+3.024242607 container cleanup 9fafa7b1172b9043f27a36c46cc1a63f2f9956b947dc872a36ee8f19cd4140ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:49:18.091 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 05:49:17 smithi001 bash[104297]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-g 2024-09-19T05:49:18.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T05:49:18.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:18.398 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T05:49:18.399 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T05:49:18.399 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.j 2024-09-19T05:49:18.722 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:18 smithi001 systemd[1]: Stopping Ceph mds.j for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:19.091 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j[70377]: 2024-09-19T05:49:18.720+0000 7fa24f27a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:19.092 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:18 smithi001 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j[70377]: 2024-09-19T05:49:18.720+0000 7fa24f27a640 -1 mds.j *** got signal Terminated *** 2024-09-19T05:49:22.340 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:22 smithi001 podman[104419]: 2024-09-19 05:49:22.075021647 +0000 UTC m=+3.459047348 container died abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T05:49:22.591 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:22 smithi001 podman[104419]: 2024-09-19 05:49:22.437781776 +0000 UTC m=+3.821807453 container cleanup abf5fd1236f4c9e0aa492ed269643e5d85197226fe433c4bc1374be52bd80961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:49:22.591 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 05:49:22 smithi001 bash[104419]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-j 2024-09-19T05:49:22.821 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T05:49:22.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:22.858 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T05:49:22.859 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T05:49:22.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.b 2024-09-19T05:49:23.163 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:22 smithi060 systemd[1]: Stopping Ceph mds.b for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:23.429 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: 2024-09-19T05:49:23.161+0000 7fe62d750640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:23.430 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:23 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b[64525]: 2024-09-19T05:49:23.161+0000 7fe62d750640 -1 mds.b *** got signal Terminated *** 2024-09-19T05:49:25.251 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:24 smithi060 podman[72909]: 2024-09-19 05:49:24.869830645 +0000 UTC m=+1.816737787 container died 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T05:49:25.589 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:25 smithi060 podman[72909]: 2024-09-19 05:49:25.328346607 +0000 UTC m=+2.275253746 container cleanup 6b4807a11670687c22182d4b8ea4240ee6db08b6415952e5dc8e2aab6ebafa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T05:49:25.589 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 19 05:49:25 smithi060 bash[72909]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-b 2024-09-19T05:49:25.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T05:49:25.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:25.809 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T05:49:25.810 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T05:49:25.810 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.e 2024-09-19T05:49:26.251 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:25 smithi060 systemd[1]: Stopping Ceph mds.e for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:26.251 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e[63919]: 2024-09-19T05:49:26.115+0000 7fc25ef11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:26.251 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:26 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e[63919]: 2024-09-19T05:49:26.115+0000 7fc25ef11640 -1 mds.e *** got signal Terminated *** 2024-09-19T05:49:28.825 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:28 smithi060 podman[73042]: 2024-09-19 05:49:28.508368636 +0000 UTC m=+2.479444858 container died d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T05:49:29.149 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:28 smithi060 podman[73042]: 2024-09-19 05:49:28.823752909 +0000 UTC m=+2.794829128 container cleanup d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T05:49:29.149 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:28 smithi060 bash[73042]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e 2024-09-19T05:49:29.149 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 19 05:49:29 smithi060 podman[73053]: 2024-09-19 05:49:29.033298779 +0000 UTC m=+0.523163399 container remove d4fe43146d23c4c9171919c8b47e37164af9b1402d83ddc3712aed62f34ee048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T05:49:29.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T05:49:29.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:29.198 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T05:49:29.198 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T05:49:29.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.h 2024-09-19T05:49:29.501 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:29 smithi060 systemd[1]: Stopping Ceph mds.h for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:30.001 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h[64222]: 2024-09-19T05:49:29.543+0000 7f4665fca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:30.001 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:29 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h[64222]: 2024-09-19T05:49:29.543+0000 7f4665fca640 -1 mds.h *** got signal Terminated *** 2024-09-19T05:49:32.538 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:32 smithi060 podman[73164]: 2024-09-19 05:49:32.251124274 +0000 UTC m=+2.836433789 container died 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:49:32.955 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:32 smithi060 podman[73164]: 2024-09-19 05:49:32.744391339 +0000 UTC m=+3.329700888 container cleanup 48867725096b6013fd0c06c9ca36e8f33d1ff62c98999382a95668e3c6a1c6a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:49:32.955 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 19 05:49:32 smithi060 bash[73164]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-h 2024-09-19T05:49:33.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T05:49:33.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:33.136 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T05:49:33.136 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T05:49:33.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.k 2024-09-19T05:49:33.466 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:33 smithi060 systemd[1]: Stopping Ceph mds.k for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:33.750 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k[63605]: 2024-09-19T05:49:33.464+0000 7f917af4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:33.751 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:33 smithi060 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k[63605]: 2024-09-19T05:49:33.464+0000 7f917af4a640 -1 mds.k *** got signal Terminated *** 2024-09-19T05:49:35.100 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:34 smithi060 podman[73285]: 2024-09-19 05:49:34.81442406 +0000 UTC m=+1.460601522 container died edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T05:49:35.433 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:35 smithi060 podman[73285]: 2024-09-19 05:49:35.173432878 +0000 UTC m=+1.819610339 container cleanup edb9ec87f22d9d79cc75497ec6e303c9c08ffa10399ebfa2ad56141f2927fb57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T05:49:35.433 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 19 05:49:35 smithi060 bash[73285]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-k 2024-09-19T05:49:35.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T05:49:35.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:35.595 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T05:49:35.595 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T05:49:35.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.c 2024-09-19T05:49:35.897 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:35 smithi082 systemd[1]: Stopping Ceph mds.c for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:36.235 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c[65771]: 2024-09-19T05:49:35.894+0000 7f6c9a9b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:36.235 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:35 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c[65771]: 2024-09-19T05:49:35.894+0000 7f6c9a9b9640 -1 mds.c *** got signal Terminated *** 2024-09-19T05:49:38.005 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:37 smithi082 podman[73423]: 2024-09-19 05:49:37.710487333 +0000 UTC m=+1.920161238 container died e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T05:49:38.258 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:38 smithi082 podman[73423]: 2024-09-19 05:49:38.103140994 +0000 UTC m=+2.312814896 container cleanup e7dc0c56d504dd71b41f93f0a87c232173416b7e4023d05bc595c8879df33bea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:49:38.258 INFO:journalctl@ceph.mds.c.smithi082.stdout:Sep 19 05:49:38 smithi082 bash[73423]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-c 2024-09-19T05:49:38.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T05:49:38.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:38.520 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T05:49:38.520 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T05:49:38.520 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.f 2024-09-19T05:49:39.008 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:38 smithi082 systemd[1]: Stopping Ceph mds.f for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:39.008 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f[65469]: 2024-09-19T05:49:38.840+0000 7f830b2e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:39.008 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:38 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f[65469]: 2024-09-19T05:49:38.840+0000 7f830b2e1640 -1 mds.f *** got signal Terminated *** 2024-09-19T05:49:43.168 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:42 smithi082 podman[73554]: 2024-09-19 05:49:42.854992986 +0000 UTC m=+4.112792712 container died 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T05:49:43.467 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 podman[73554]: 2024-09-19 05:49:43.265329686 +0000 UTC m=+4.523129424 container cleanup 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T05:49:43.467 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 bash[73554]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f 2024-09-19T05:49:43.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T05:49:43.726 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 podman[73565]: 2024-09-19 05:49:43.466510484 +0000 UTC m=+0.611515492 container remove 670403dcc101228b170d4901bfd71131bd1e13190261a3740d7f145f4cc3acff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T05:49:43.727 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-19T05:49:43.727 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 systemd[1]: Stopped Ceph mds.f for 7ab08e8a-7645-11ef-bceb-c7b262605968. 2024-09-19T05:49:43.727 INFO:journalctl@ceph.mds.f.smithi082.stdout:Sep 19 05:49:43 smithi082 systemd[1]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.f.service: Consumed 1.181s CPU time. 2024-09-19T05:49:43.739 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:43.739 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T05:49:43.739 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T05:49:43.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.i 2024-09-19T05:49:44.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:43 smithi082 systemd[1]: Stopping Ceph mds.i for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:44.508 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: 2024-09-19T05:49:44.068+0000 7f12b3485640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:44.508 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:44 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i[66071]: 2024-09-19T05:49:44.068+0000 7f12b3485640 -1 mds.i *** got signal Terminated *** 2024-09-19T05:49:48.354 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:48 smithi082 podman[73675]: 2024-09-19 05:49:48.079276403 +0000 UTC m=+4.122254325 container died 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T05:49:49.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:48 smithi082 podman[73675]: 2024-09-19 05:49:48.618881381 +0000 UTC m=+4.661859301 container cleanup 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T05:49:49.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:48 smithi082 bash[73675]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i 2024-09-19T05:49:49.008 INFO:journalctl@ceph.mds.i.smithi082.stdout:Sep 19 05:49:48 smithi082 podman[73687]: 2024-09-19 05:49:48.794942094 +0000 UTC m=+0.713931484 container remove 0e0b736514292d33710f8f8a4d2bc3d6c2a66a7b007a3f356533716e126bb400 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T05:49:49.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T05:49:49.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:49.056 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T05:49:49.056 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T05:49:49.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.l 2024-09-19T05:49:49.382 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:49 smithi082 systemd[1]: Stopping Ceph mds.l for 7ab08e8a-7645-11ef-bceb-c7b262605968... 2024-09-19T05:49:49.758 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l[65171]: 2024-09-19T05:49:49.380+0000 7f8876e87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:49:49.758 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:49 smithi082 ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l[65171]: 2024-09-19T05:49:49.380+0000 7f8876e87640 -1 mds.l *** got signal Terminated *** 2024-09-19T05:49:52.416 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:52 smithi082 podman[73796]: 2024-09-19 05:49:52.116396604 +0000 UTC m=+2.845602873 container died 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:49:52.758 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:52 smithi082 podman[73796]: 2024-09-19 05:49:52.513987972 +0000 UTC m=+3.243194234 container cleanup 3d29327389f7d3add89535e93a0dd3b0cb80d37955b6d8b309fb3b4cacf3d954 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:49:52.758 INFO:journalctl@ceph.mds.l.smithi082.stdout:Sep 19 05:49:52 smithi082 bash[73796]: ceph-7ab08e8a-7645-11ef-bceb-c7b262605968-mds-l 2024-09-19T05:49:52.933 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ab08e8a-7645-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T05:49:52.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:49:52.965 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T05:49:52.965 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:49:53.178 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:49:55.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:49:55.902 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:49:58.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:49:58.621 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T05:50:01.265 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:50:01.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:50:01.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:50:01.367 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T05:50:01.369 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi001/crash 2024-09-19T05:50:01.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:50:01.406 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:50:01.406 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:50:01.408 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi060/crash 2024-09-19T05:50:01.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:50:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:50:01.443 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:50:01.446 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi082/crash 2024-09-19T05:50:01.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:50:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:50:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:50:01.484 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T05:50:01.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T05:50:01.527 INFO:tasks.cephadm:Compressing logs... 2024-09-19T05:50:01.528 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:50:01.568 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:50:01.571 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:50:01.594 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T05:50:01.594 INFO:teuthology.orchestra.run.smithi001.stderr:: No such file or directory 2024-09-19T05:50:01.595 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T05:50:01.596 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T05:50:01.596 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:50:01.596 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:50:01.596 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.a.log: 83.2% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T05:50:01.599 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.g.log: -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:50:01.602 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:50:01.602 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:: No such file or directory 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T05:50:01.605 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T05:50:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.d.log: 87.1% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.j.log 94.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-19T05:50:01.609 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T05:50:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T05:50:01.612 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:50:01.613 INFO:teuthology.orchestra.run.smithi001.stderr: 94.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T05:50:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:50:01.615 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T05:50:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:50:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T05:50:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:50:01.623 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T05:50:01.625 INFO:teuthology.orchestra.run.smithi001.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:50:01.640 INFO:teuthology.orchestra.run.smithi060.stderr: 83.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:50:01.700 INFO:teuthology.orchestra.run.smithi060.stderr: 87.1% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:50:01.810 INFO:teuthology.orchestra.run.smithi082.stderr: 93.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T05:50:01.864 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T05:50:01.913 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:50:01.913 INFO:teuthology.orchestra.run.smithi060.stderr: 90.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:50:01.943 INFO:teuthology.orchestra.run.smithi082.stderr: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T05:50:01.948 INFO:teuthology.orchestra.run.smithi082.stderr: 87.1% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:50:01.965 INFO:teuthology.orchestra.run.smithi060.stderr: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T05:50:01.969 INFO:teuthology.orchestra.run.smithi060.stderr: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T05:50:02.001 INFO:teuthology.orchestra.run.smithi082.stderr: 90.9% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:50:02.015 INFO:teuthology.orchestra.run.smithi001.stderr: 90.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T05:50:02.042 INFO:teuthology.orchestra.run.smithi060.stderr: 93.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T05:50:02.060 INFO:teuthology.orchestra.run.smithi082.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:50:02.063 INFO:teuthology.orchestra.run.smithi082.stderr: 83.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:50:02.177 INFO:teuthology.orchestra.run.smithi082.stderr: 90.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:50:02.213 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:50:02.894 INFO:teuthology.orchestra.run.smithi001.stderr: 90.2% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T05:50:04.127 INFO:teuthology.orchestra.run.smithi060.stderr: 93.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T05:50:17.026 INFO:teuthology.orchestra.run.smithi082.stderr: 91.9% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T05:50:41.348 INFO:teuthology.orchestra.run.smithi060.stderr: 91.8% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T05:50:43.404 INFO:teuthology.orchestra.run.smithi060.stderr: 94.6% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T05:50:44.445 INFO:teuthology.orchestra.run.smithi001.stderr: 91.7% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T05:50:44.960 INFO:teuthology.orchestra.run.smithi060.stderr: 91.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T05:50:48.718 INFO:teuthology.orchestra.run.smithi001.stderr: 91.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T05:50:52.863 INFO:teuthology.orchestra.run.smithi001.stderr: 91.3% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T05:50:53.246 INFO:teuthology.orchestra.run.smithi001.stderr: 91.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T05:50:53.248 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-19T05:50:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m51.665s 2024-09-19T05:50:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:user 3m8.794s 2024-09-19T05:50:53.248 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m5.494s 2024-09-19T05:51:11.105 INFO:teuthology.orchestra.run.smithi060.stderr: 91.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T05:51:19.682 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T05:51:19.684 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-19T05:51:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:real 1m18.098s 2024-09-19T05:51:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:user 3m55.145s 2024-09-19T05:51:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m6.740s 2024-09-19T05:59:39.086 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T06:00:01.587 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T06:00:08.024 INFO:teuthology.orchestra.run.smithi082.stderr: 91.2% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T06:02:42.406 INFO:teuthology.orchestra.run.smithi082.stderr: 91.2% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T06:11:50.175 INFO:teuthology.orchestra.run.smithi082.stderr: 93.2% -- replaced with /var/log/ceph/7ab08e8a-7645-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T06:11:50.210 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-09-19T06:11:50.210 INFO:teuthology.orchestra.run.smithi082.stderr:real 21m48.624s 2024-09-19T06:11:50.210 INFO:teuthology.orchestra.run.smithi082.stderr:user 12m16.469s 2024-09-19T06:11:50.210 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m31.134s 2024-09-19T06:11:50.211 INFO:tasks.cephadm:Archiving logs... 2024-09-19T06:11:50.212 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi001/log 2024-09-19T06:11:50.213 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:12:22.470 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi060/log 2024-09-19T06:12:22.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:12:59.230 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi082/log 2024-09-19T06:12:59.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:14:58.276 INFO:tasks.cephadm:Removing cluster... 2024-09-19T06:14:58.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force 2024-09-19T06:14:58.491 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T06:14:59.065 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force 2024-09-19T06:14:59.274 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T06:14:59.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ab08e8a-7645-11ef-bceb-c7b262605968 --force 2024-09-19T06:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 7ab08e8a-7645-11ef-bceb-c7b262605968 2024-09-19T06:15:01.511 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T06:15:01.512 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:15:01.532 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:15:01.552 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:15:01.568 INFO:tasks.cephadm:Teardown complete 2024-09-19T06:15:01.568 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T06:15:01.582 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T06:15:01.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:15:01.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:15:01.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:15:01.731 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T06:15:01.741 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T06:15:01.741 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:15:01.744 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:15:01.747 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:15:01.759 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:15:01.762 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:15:01.762 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:15:01.764 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:15:01.764 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T06:15:01.764 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -108us[ -96us] +/- 49ms 2024-09-19T06:15:01.764 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 58 +312us[ +312us] +/- 64ms 2024-09-19T06:15:01.765 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -288us[ -288us] +/- 88ms 2024-09-19T06:15:01.765 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:15:01.776 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:15:01.777 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-19T06:15:01.777 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 -92us[ -93us] +/- 49ms 2024-09-19T06:15:01.777 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 +327us[ +326us] +/- 64ms 2024-09-19T06:15:01.777 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -280us[ -281us] +/- 88ms 2024-09-19T06:15:01.777 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:15:01.851 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:15:01.851 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-19T06:15:01.852 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 -88us[ -79us] +/- 49ms 2024-09-19T06:15:01.852 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 +341us[ +350us] +/- 64ms 2024-09-19T06:15:01.852 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -269us[ -260us] +/- 88ms 2024-09-19T06:15:01.852 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:15:01.860 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T06:15:01.870 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T06:15:01.871 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T06:15:01.885 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:15:01.974 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:15:02.073 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:15:02.167 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:15:02.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:02.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:15:02.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:02.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:15:02.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:02.260 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T06:15:02.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T06:15:02.281 INFO:teuthology.task.internal:Duration was 4273.469671 seconds 2024-09-19T06:15:02.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T06:15:02.294 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T06:15:02.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:15:02.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:15:02.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:15:02.340 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:15:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:15:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:15:02.801 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T06:15:02.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T06:15:02.802 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:15:02.828 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-19T06:15:02.828 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:15:02.858 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-09-19T06:15:02.858 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:15:02.887 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T06:15:02.887 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:15:02.890 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:15:02.901 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:15:02.956 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T06:15:02.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:15:02.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:15:02.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:15:03.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T06:15:03.849 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T06:15:03.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:15:03.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:15:03.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:15:03.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T06:15:03.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:03.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:03.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:04.003 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-19T06:15:04.005 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-19T06:15:04.020 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-09-19T06:15:04.038 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:04.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:04.075 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:04.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:04.090 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:15:04.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:15:04.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T06:15:04.116 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T06:15:04.117 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi001 2024-09-19T06:15:04.117 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:15:04.177 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi060 2024-09-19T06:15:04.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:15:04.218 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911662/remote/smithi082 2024-09-19T06:15:04.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:15:04.258 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T06:15:04.259 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:15:04.261 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:15:04.263 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:15:04.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T06:15:04.327 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T06:15:04.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T06:15:04.424 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T06:15:04.424 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:15:04.427 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:15:04.429 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:15:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:15 /home/ubuntu/cephtest 2024-09-19T06:15:04.442 INFO:teuthology.orchestra.run.smithi060.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:15 /home/ubuntu/cephtest 2024-09-19T06:15:04.444 INFO:teuthology.orchestra.run.smithi082.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:15 /home/ubuntu/cephtest 2024-09-19T06:15:04.446 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T06:15:04.457 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T06:15:04.483 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/dbench}} duration: 4273.46967124939 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T06:15:04.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:15:04.567 INFO:teuthology.run:pass